Table 4: 
CPRAG-102 word prediction accuracies (with and without sentence perturbations). Shuf = first sentence shuffled; Trunc = second sentence truncated to two words before target.
OrigShufTruncShuf + Trunc
BERTBASE k = 1 23.5 14.1 ± 3.1 14.7 8.1 ± 3.4 
BERTLARGE k = 1 35.3 17.4 ± 3.5 17.6 10.0 ± 3.0 
BERTBASE k = 5 52.9 36.1 ± 2.8 35.3 22.1 ± 3.2 
BERTLARGE k = 5 52.9 39.2 ± 3.9 32.4 21.3 ± 3.7 
OrigShufTruncShuf + Trunc
BERTBASE k = 1 23.5 14.1 ± 3.1 14.7 8.1 ± 3.4 
BERTLARGE k = 1 35.3 17.4 ± 3.5 17.6 10.0 ± 3.0 
BERTBASE k = 5 52.9 36.1 ± 2.8 35.3 22.1 ± 3.2 
BERTLARGE k = 5 52.9 39.2 ± 3.9 32.4 21.3 ± 3.7 
View Large
Close Modal
This Feature Is Available To Subscribers Only

or Create an Account

Close Modal
Close Modal
This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy.
Accept