| Answer Type . | Example . | Percentage . |
|---|---|---|
| Yes | Q: is MedlinePlus optimized for mobile? | 48.5% |
| A: Yes | ||
| R: There is also a site optimized for display on mobile devices | ||
| No | Q: Is it played outside? | 30.3% |
| A: No | ||
| R: AFL is the highest level of professional indoor American football | ||
| Fluency | Q: Why? | 14.3% |
| A: so the investigation could continue | ||
| R: while the investigation continued | ||
| Counting | Q: how many languages is it offered in? | 5.1% |
| A: Two | ||
| R: The service provides curated consumer health information in English and Spanish | ||
| Multiple choice | Q: Is Jenny older or younger? | 1.8% |
| A: Older | ||
| R: her baby sister is crying so loud that Jenny can’t hear herself | ||
| Fine grained breakdown of Fluency | ||
| Multiple edits | Q: What did she try just before that? | 41.4% |
| A: She gave her a toy horse. | ||
| R: She would give her baby sister one of her toy horses. | ||
| (morphology: give → gave, horses → horse; delete: would, baby sister one of her; insert: a) | ||
| Coreference insertion | Q: what is the cost to end users? | 16.0% |
| A: It is free | ||
| R: The service is funded by the NLM and is free to users | ||
| Morphology | Q: Who was messing up the neighborhoods? | 13.9% |
| A: vandals | ||
| R: vandalism in the neighborhoods | ||
| Article insertion | Q: What would they cut with? | 7.2% |
| A: an ax | ||
| R: the heavy ax | ||
| Adverb insertion | Q: How old was the diary? | 4.2% |
| A: 190 years old | ||
| R: kept 190 years ago | ||
| Adjective deletion | Q: What type of book? | 4.2% |
| A: A diary. | ||
| R: a 120-page diary | ||
| Preposition insertion | how long did it take to get to the fire? | 3.4% |
| A: Until supper time! | ||
| R: By the time they arrived, it was almost supper time. | ||
| Adverb deletion | Q: What had happened to the ice? | 3.0% |
| A: It had changed | ||
| R: It had somewhat changed its formation when they approached it | ||
| Conjunction insertion | Q: what else do they get for their work? | 1.3% |
| A: potatoes and carrots | ||
| R: paid well, both in potatoes, carrots | ||
| Noun insertion | Q: Who did | 1.3% |
| A: Comedy Central employee | ||
| R: But it was a Comedy Central account | ||
| Coreference deletion | Q: What is the story about? | 1.2% |
| A: A girl and a dog | ||
| R: This is the story of a young girl and her dog | ||
| Noun deletion | Q: What is the ranking in the country in terms of people studying? | 0.8% |
| A: the fourth largest population | ||
| R: and has the fourth largest student population | ||
| Possesive insertion | Q: Whose diary was it? | 0.8% |
| A: Deborah Logan’s | ||
| R: a 120-page diary kept 190 years ago by Deborah Logan | ||
| Article deletion | Q: why? | 0.8% |
| A: They were going to the circus | ||
| R: They all were going to the circus to see the clowns | ||
| Answer Type . | Example . | Percentage . |
|---|---|---|
| Yes | Q: is MedlinePlus optimized for mobile? | 48.5% |
| A: Yes | ||
| R: There is also a site optimized for display on mobile devices | ||
| No | Q: Is it played outside? | 30.3% |
| A: No | ||
| R: AFL is the highest level of professional indoor American football | ||
| Fluency | Q: Why? | 14.3% |
| A: so the investigation could continue | ||
| R: while the investigation continued | ||
| Counting | Q: how many languages is it offered in? | 5.1% |
| A: Two | ||
| R: The service provides curated consumer health information in English and Spanish | ||
| Multiple choice | Q: Is Jenny older or younger? | 1.8% |
| A: Older | ||
| R: her baby sister is crying so loud that Jenny can’t hear herself | ||
| Fine grained breakdown of Fluency | ||
| Multiple edits | Q: What did she try just before that? | 41.4% |
| A: She gave her a toy horse. | ||
| R: She would give her baby sister one of her toy horses. | ||
| (morphology: give → gave, horses → horse; delete: would, baby sister one of her; insert: a) | ||
| Coreference insertion | Q: what is the cost to end users? | 16.0% |
| A: It is free | ||
| R: The service is funded by the NLM and is free to users | ||
| Morphology | Q: Who was messing up the neighborhoods? | 13.9% |
| A: vandals | ||
| R: vandalism in the neighborhoods | ||
| Article insertion | Q: What would they cut with? | 7.2% |
| A: an ax | ||
| R: the heavy ax | ||
| Adverb insertion | Q: How old was the diary? | 4.2% |
| A: 190 years old | ||
| R: kept 190 years ago | ||
| Adjective deletion | Q: What type of book? | 4.2% |
| A: A diary. | ||
| R: a 120-page diary | ||
| Preposition insertion | how long did it take to get to the fire? | 3.4% |
| A: Until supper time! | ||
| R: By the time they arrived, it was almost supper time. | ||
| Adverb deletion | Q: What had happened to the ice? | 3.0% |
| A: It had changed | ||
| R: It had somewhat changed its formation when they approached it | ||
| Conjunction insertion | Q: what else do they get for their work? | 1.3% |
| A: potatoes and carrots | ||
| R: paid well, both in potatoes, carrots | ||
| Noun insertion | Q: Who did | 1.3% |
| A: Comedy Central employee | ||
| R: But it was a Comedy Central account | ||
| Coreference deletion | Q: What is the story about? | 1.2% |
| A: A girl and a dog | ||
| R: This is the story of a young girl and her dog | ||
| Noun deletion | Q: What is the ranking in the country in terms of people studying? | 0.8% |
| A: the fourth largest population | ||
| R: and has the fourth largest student population | ||
| Possesive insertion | Q: Whose diary was it? | 0.8% |
| A: Deborah Logan’s | ||
| R: a 120-page diary kept 190 years ago by Deborah Logan | ||
| Article deletion | Q: why? | 0.8% |
| A: They were going to the circus | ||
| R: They all were going to the circus to see the clowns | ||