Table 6: 

Preference between T5 output and human annotation. Columns represents the judgement of the expert A, rows that of the expert B. We see high agreement between two expert annotators, despite one expert annotator (column annotator) is ambivalent more frequently.

T5eitherAnnotatorSum
T5 13 12 27 
either 22 33 
Annotator 15 24 40 
 
Sum 21 49 30 100 
T5eitherAnnotatorSum
T5 13 12 27 
either 22 33 
Annotator 15 24 40 
 
Sum 21 49 30 100 
Close Modal

or Create an Account

Close Modal
Close Modal