Table 16

Example of a question that needs more than two sentences to answer.

Complex Inference — More sentences required to construct a complete answer
Question Which of the following would result in a decrease in the polar bear population in the arctic? (GR:5)
Focus Word(s) (JJ_polar, 0.29) (NN_population, 0.29) (NN_arctic, 0.29) (VB_result, 0.07) (NN_decrease, 0.04) (NN_bear, 0.02)
Issue Requires additional graphlets, including that bears eat fish, eating an animal makes you a predator and it your prey, and a decrease in prey population also causes a decrease in predator population. Here, with a limited justification length of two sentences, the system is not able to construct a justification that includes all the crucial focus words, and all answer candidates are left with the same general justification fragment that includes the highest-weighted focus words.

Correct Answer a decrease in the fish population
Focus Word(s) (NN_population, 0.80) (NN_decrease, 0.13) (NN_fish, 0.07)
Justification A polar bear is a big, white bear that lives in the arctic. (Wiktionary)
The population of a place is the people or animals that live there. (Wiktionary)

Chosen Answer a decrease in the human population
Focus Word(s) (NN_population, 0.92) (NN_decrease, 0.08)
Justification A polar bear is a big, white bear that lives in the arctic. (Wiktionary)
The population of a place is the people or animals that live there. (Wiktionary)
Complex Inference — More sentences required to construct a complete answer
Question Which of the following would result in a decrease in the polar bear population in the arctic? (GR:5)
Focus Word(s) (JJ_polar, 0.29) (NN_population, 0.29) (NN_arctic, 0.29) (VB_result, 0.07) (NN_decrease, 0.04) (NN_bear, 0.02)
Issue Requires additional graphlets, including that bears eat fish, eating an animal makes you a predator and it your prey, and a decrease in prey population also causes a decrease in predator population. Here, with a limited justification length of two sentences, the system is not able to construct a justification that includes all the crucial focus words, and all answer candidates are left with the same general justification fragment that includes the highest-weighted focus words.

Correct Answer a decrease in the fish population
Focus Word(s) (NN_population, 0.80) (NN_decrease, 0.13) (NN_fish, 0.07)
Justification A polar bear is a big, white bear that lives in the arctic. (Wiktionary)
The population of a place is the people or animals that live there. (Wiktionary)

Chosen Answer a decrease in the human population
Focus Word(s) (NN_population, 0.92) (NN_decrease, 0.08)
Justification A polar bear is a big, white bear that lives in the arctic. (Wiktionary)
The population of a place is the people or animals that live there. (Wiktionary)
Close Modal