Skip to Main Content
Table 4: 
The overall statistics of C3. C3 = CM3∪ CD3.
MetricCM3CD3C3
Min./Avg./Max. # of options per question 2 / 3.7 / 4 3 / 3.8 / 4 2 / 3.8 / 4 
# of correct options per question 
Min./Avg./Max. # of questions per document 1 / 1.9 / 6 1 / 1.2 / 6 1 / 1.5 / 6 
Avg./Max. option length (in characters) 6.5 / 45 4.4 / 31 5.5 / 45 
Avg./Max. question length (in characters) 13.5 / 57 10.9 / 34 12.2 / 57 
Avg./Max. document length (in characters) 180.2 / 1,274 76.3 / 1,540 116.9 / 1,540 
character vocabulary size 4,120 2,922 4,193 
non-extractive correct option (%) 81.9 78.9 80.4 
 
# of documents / # of questions 
 Training 3,138 / 6,013 4,885 / 5,856 8,023 / 11,869 
 Development 1,046 / 1,991 1,628 / 1,825 2,674 / 3,816 
 Test 1,045 / 2,002 1,627 / 1,890 2,672 / 3,892 
 All 5,229 / 10,006 8,140 / 9,571 13,369 / 19,577 
MetricCM3CD3C3
Min./Avg./Max. # of options per question 2 / 3.7 / 4 3 / 3.8 / 4 2 / 3.8 / 4 
# of correct options per question 
Min./Avg./Max. # of questions per document 1 / 1.9 / 6 1 / 1.2 / 6 1 / 1.5 / 6 
Avg./Max. option length (in characters) 6.5 / 45 4.4 / 31 5.5 / 45 
Avg./Max. question length (in characters) 13.5 / 57 10.9 / 34 12.2 / 57 
Avg./Max. document length (in characters) 180.2 / 1,274 76.3 / 1,540 116.9 / 1,540 
character vocabulary size 4,120 2,922 4,193 
non-extractive correct option (%) 81.9 78.9 80.4 
 
# of documents / # of questions 
 Training 3,138 / 6,013 4,885 / 5,856 8,023 / 11,869 
 Development 1,046 / 1,991 1,628 / 1,825 2,674 / 3,816 
 Test 1,045 / 2,002 1,627 / 1,890 2,672 / 3,892 
 All 5,229 / 10,006 8,140 / 9,571 13,369 / 19,577 
Close Modal

or Create an Account

Close Modal
Close Modal