User study results. Dec. refers to decontextualized sentence answer, Ori. means original sentence answer, Par. means paragraph answer. We present raw counts of preferences and the log odds of preferring option A and its 95% confidence interval.
Opt.A vs. Opt.B . | Prefer . | log odds . | ||
---|---|---|---|---|
A . | B . | either . | intercept [CI] . | |
Dec. vs. Ori. | 730 | 426 | 364 | 0.85 [0.4,1.3] |
Dec. vs. Par. | 850 | 456 | 234 | 0.55 [0.1,1.0] |
Ori. vs. Par. | 741 | 505 | 274 | 0.31 [−0.2,0.8] |
Opt.A vs. Opt.B . | Prefer . | log odds . | ||
---|---|---|---|---|
A . | B . | either . | intercept [CI] . | |
Dec. vs. Ori. | 730 | 426 | 364 | 0.85 [0.4,1.3] |
Dec. vs. Par. | 850 | 456 | 234 | 0.55 [0.1,1.0] |
Ori. vs. Par. | 741 | 505 | 274 | 0.31 [−0.2,0.8] |