MIT Press

Table 5:

The second category of adversarial questions consists of clues that are present in the training data but are written in a distracting manner. Training shows relevant snippets from the training data. Prediction displays the rnn model’s answer prediction (always correct on Training, always incorrect on Adversarial).

Set	Question	Prediction	Phenomenon
Training	Name this sociological phenomenon, the taking of one’s own life.	Suicide	Paraphrase
Adversarial	Name this self-inflicted method of death.	Arthur Miller
Training	Clinton played the saxophone on The Arsenio Hall Show.	Bill Clinton
Adversarial	He was edited to appear in the film “Contact”… For ten points, name this American president who played the saxophone on an appearance on the Arsenio Hall Show.	Don Cheadle	Entity Type Distractor

Set	Question	Prediction	Phenomenon
Training	Name this sociological phenomenon, the taking of one’s own life.	Suicide	Paraphrase
Adversarial	Name this self-inflicted method of death.	Arthur Miller
Training	Clinton played the saxophone on The Arsenio Hall Show.	Bill Clinton
Adversarial	He was edited to appear in the film “Contact”… For ten points, name this American president who played the saxophone on an appearance on the Arsenio Hall Show.	Don Cheadle	Entity Type Distractor

View Large

This Feature Is Available To Subscribers Only