Skip to Main Content
Table 4: 
CPRAG-102 word prediction accuracies (with and without sentence perturbations). Shuf = first sentence shuffled; Trunc = second sentence truncated to two words before target.
OrigShufTruncShuf + Trunc
BERTBASE k = 1 23.5 14.1 ± 3.1 14.7 8.1 ± 3.4 
BERTLARGE k = 1 35.3 17.4 ± 3.5 17.6 10.0 ± 3.0 
BERTBASE k = 5 52.9 36.1 ± 2.8 35.3 22.1 ± 3.2 
BERTLARGE k = 5 52.9 39.2 ± 3.9 32.4 21.3 ± 3.7 
OrigShufTruncShuf + Trunc
BERTBASE k = 1 23.5 14.1 ± 3.1 14.7 8.1 ± 3.4 
BERTLARGE k = 1 35.3 17.4 ± 3.5 17.6 10.0 ± 3.0 
BERTBASE k = 5 52.9 36.1 ± 2.8 35.3 22.1 ± 3.2 
BERTLARGE k = 5 52.9 39.2 ± 3.9 32.4 21.3 ± 3.7 
Close Modal

or Create an Account

Close Modal
Close Modal