Table 1: 

The NP chunks answer selection strategy covers 91% of the information represented by the Pyramid Method (SCU Coverage) with 21% of the questions representing new information. From this, we conclude that the QA pairs generated from selecting noun chunk answers provides a semantic representation of the reference summary with very high-coverage.

StrategyAvg #QAsQA PrecisionSCU Coverage
NER 11.7 83% 57% 
NP Chunks 28.8 79% 91% 
Max. NPs 17.3 82% 77% 
StrategyAvg #QAsQA PrecisionSCU Coverage
NER 11.7 83% 57% 
NP Chunks 28.8 79% 91% 
Max. NPs 17.3 82% 77% 
Close Modal

or Create an Account

Close Modal
Close Modal