Table 5: 

Percent of times that the generation from each of the models and human-written references was chosen as plausible (absolute) or preferred (comparative) by the majority of workers.

ModelAbsoluteComparative
IdiomSimileIdiomSimile
GPT2-XL 56 60 15 18.6 
+Context 68 68 45 16 
+Literal 48 76 13 46.7 
Human 80 88 − − 
All − − 8 12 
Neither − − 17 6.7 
ModelAbsoluteComparative
IdiomSimileIdiomSimile
GPT2-XL 56 60 15 18.6 
+Context 68 68 45 16 
+Literal 48 76 13 46.7 
Human 80 88 − − 
All − − 8 12 
Neither − − 17 6.7 
View Large
Close Modal
This Feature Is Available To Subscribers Only

or Create an Account

Close Modal
Close Modal
This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy. No content on this site may be used to train artificial intelligence systems without permission in writing from the MIT Press.
Accept