Type . | Seq2seq . | PGNet . | DrQA . | Augmt. DrQA . | DrQA+ PGNet . | Human . |
---|---|---|---|---|---|---|
Answer Type | ||||||
Answerable | 27.5 | 45.4 | 54.7 | 67.3 | 66.3 | 89.9 |
Unanswerable | 33.9 | 38.2 | 55.0 | 49.1 | 51.2 | 72.3 |
Span found | 20.2 | 43.6 | 69.8 | 71.0 | 70.5 | 91.1 |
No span found | 43.1 | 49.0 | 22.7 | 59.4 | 57.0 | 86.8 |
Named Entity | 21.9 | 43.0 | 72.6 | 73.5 | 72.2 | 92.2 |
Noun Phrase | 17.2 | 37.2 | 64.9 | 65.3 | 64.1 | 88.6 |
Yes | 69.6 | 69.9 | 7.9 | 75.7 | 72.7 | 95.6 |
No | 60.2 | 60.3 | 18.4 | 59.6 | 58.7 | 95.7 |
Number | 15.0 | 48.6 | 66.3 | 69.0 | 71.7 | 91.2 |
Date/Time | 13.7 | 50.2 | 79.0 | 83.3 | 79.1 | 91.5 |
Other | 14.1 | 33.7 | 53.5 | 55.6 | 55.2 | 80.8 |
Question Type | ||||||
Lexical Mat. | 20.7 | 40.7 | 57.2 | 75.5 | 65.7 | 91.7 |
Paraphrasing | 23.7 | 33.9 | 46.9 | 62.6 | 64.4 | 88.8 |
Pragmatics | 33.9 | 43.1 | 57.4 | 64.1 | 60.6 | 84.2 |
No coref. | 16.1 | 31.7 | 54.3 | 70.9 | 58.8 | 90.3 |
Exp. coref. | 30.4 | 42.3 | 49.0 | 63.4 | 66.7 | 87.1 |
Imp. coref. | 31.4 | 39.0 | 60.1 | 70.6 | 65.3 | 88.7 |
Type . | Seq2seq . | PGNet . | DrQA . | Augmt. DrQA . | DrQA+ PGNet . | Human . |
---|---|---|---|---|---|---|
Answer Type | ||||||
Answerable | 27.5 | 45.4 | 54.7 | 67.3 | 66.3 | 89.9 |
Unanswerable | 33.9 | 38.2 | 55.0 | 49.1 | 51.2 | 72.3 |
Span found | 20.2 | 43.6 | 69.8 | 71.0 | 70.5 | 91.1 |
No span found | 43.1 | 49.0 | 22.7 | 59.4 | 57.0 | 86.8 |
Named Entity | 21.9 | 43.0 | 72.6 | 73.5 | 72.2 | 92.2 |
Noun Phrase | 17.2 | 37.2 | 64.9 | 65.3 | 64.1 | 88.6 |
Yes | 69.6 | 69.9 | 7.9 | 75.7 | 72.7 | 95.6 |
No | 60.2 | 60.3 | 18.4 | 59.6 | 58.7 | 95.7 |
Number | 15.0 | 48.6 | 66.3 | 69.0 | 71.7 | 91.2 |
Date/Time | 13.7 | 50.2 | 79.0 | 83.3 | 79.1 | 91.5 |
Other | 14.1 | 33.7 | 53.5 | 55.6 | 55.2 | 80.8 |
Question Type | ||||||
Lexical Mat. | 20.7 | 40.7 | 57.2 | 75.5 | 65.7 | 91.7 |
Paraphrasing | 23.7 | 33.9 | 46.9 | 62.6 | 64.4 | 88.8 |
Pragmatics | 33.9 | 43.1 | 57.4 | 64.1 | 60.6 | 84.2 |
No coref. | 16.1 | 31.7 | 54.3 | 70.9 | 58.8 | 90.3 |
Exp. coref. | 30.4 | 42.3 | 49.0 | 63.4 | 66.7 | 87.1 |
Imp. coref. | 31.4 | 39.0 | 60.1 | 70.6 | 65.3 | 88.7 |