MIT Press

Table 2:

The adversarially authored questions have similar n-gram overlap to the regular test questions. However, the overlap of the named entities (ne) decreases for ir Adversarial questions.

	Adversarial	Regular
Unigram overlap	0.40	0.37
Bigram overlap	0.08	0.05
Longest n-gram overlap	6.73	6.87
Average ne overlap	0.38	0.46
ir Adversarial	0.35
rnn Adversarial	0.44

Total Words	107.1	133.5
Total ne	9.1	12.5

	Adversarial	Regular
Unigram overlap	0.40	0.37
Bigram overlap	0.08	0.05
Longest n-gram overlap	6.73	6.87
Average ne overlap	0.38	0.46
ir Adversarial	0.35
rnn Adversarial	0.44

Total Words	107.1	133.5
Total ne	9.1	12.5

View Large

This Feature Is Available To Subscribers Only