Skip to Main Content
Table 7: 
ROLE-88 word prediction accuracies (with and without sentence perturbations). -Obj = generic object; -Subj = generic subject; -Both = generic object and subject.
Orig-Obj-Sub-Both
BERTBASE k=1 14.8 12.5 12.5 9.1 
BERTLARGE k=1 13.6 5.7 6.8 4.5 
BERTBASE k=5 27.3 26.1 22.7 18.2 
BERTLARGE k=5 37.5 18.2 21.6 14.8 
Orig-Obj-Sub-Both
BERTBASE k=1 14.8 12.5 12.5 9.1 
BERTLARGE k=1 13.6 5.7 6.8 4.5 
BERTBASE k=5 27.3 26.1 22.7 18.2 
BERTLARGE k=5 37.5 18.2 21.6 14.8 
Close Modal

or Create an Account

Close Modal
Close Modal