Skip to Main Content
Table 6: 

Performance decomposition to answer types of our best generative/extractive systems and ranker. Gen and Ext are the same systems as in Table 5.

Answer TypeRatio(%)QA ROUGE-LRanker
GenExtROUGE-L
Concept - Entity 35.3 26.76 18.59 66.79 
Concept - Common Noun 16.9 31.53 12.90 51.03 
Concept - Book Specific 4.3 39.68 26.53 65.54 
Event - Expression 25.1 24.62 11.50 39.40 
Event - Name 2.8 24.79 5.54 42.88 
Attribute - State 4.2 38.75 17.03 53.82 
Attribute - Numeric 4.7 33.57 24.44 57.31 
Attribute - Description 6.1 26.13 11.15 41.70 
Attribute - Book Attribute 0.6 27.91 19.88 52.78 
Answer TypeRatio(%)QA ROUGE-LRanker
GenExtROUGE-L
Concept - Entity 35.3 26.76 18.59 66.79 
Concept - Common Noun 16.9 31.53 12.90 51.03 
Concept - Book Specific 4.3 39.68 26.53 65.54 
Event - Expression 25.1 24.62 11.50 39.40 
Event - Name 2.8 24.79 5.54 42.88 
Attribute - State 4.2 38.75 17.03 53.82 
Attribute - Numeric 4.7 33.57 24.44 57.31 
Attribute - Description 6.1 26.13 11.15 41.70 
Attribute - Book Attribute 0.6 27.91 19.88 52.78 
Close Modal

or Create an Account

Close Modal
Close Modal