The NP chunks answer selection strategy covers 91% of the information represented by the Pyramid Method (SCU Coverage) with 21% of the questions representing new information. From this, we conclude that the QA pairs generated from selecting noun chunk answers provides a semantic representation of the reference summary with very high-coverage.
Strategy . | Avg #QAs . | QA Precision . | SCU Coverage . |
---|---|---|---|
NER | 11.7 | 83% | 57% |
NP Chunks | 28.8 | 79% | 91% |
Max. NPs | 17.3 | 82% | 77% |
Strategy . | Avg #QAs . | QA Precision . | SCU Coverage . |
---|---|---|---|
NER | 11.7 | 83% | 57% |
NP Chunks | 28.8 | 79% | 91% |
Max. NPs | 17.3 | 82% | 77% |