Skip to Main Content
Table 4: 

Examples from the GHC, for which the baseline differ from multi-task predictions’ majority vote. (We acknowledge that individual readers may disagree with the annotation labels presented above.)

TextAnnotationMulti-taskBaseline Label
Label%HateLabel%Hate
Agreed. Traitors deserve to be shot. PERIOD. Not-Hate 0.33 Not-Hate 0.39 Hate 
Are the democrats guilty of treason? Not-Hate 0.25 Not-Hate 0.39 Hate 
I don’t know, you tell me ya prick. Not-Hate 0.33 Not-Hate 0.39 Hate 
They should force the ‘refugees’ to wear this crap. Hate 0.67 Not-Hate 0.33 Hate 
At this point, nobody gives a shit! Hate 0.67 Not-Hate 0.44 Hate 
It’s OK to be a Nazi!! Hate 1.00 Not-Hate 0.44 Hate 
Arise WHITE PEOPLE! We’re back. Not-Hate 0.33 Hate 0.56 Not-Hate 
Shocking! A jew defending another jew! Who’d have thought? Not-Hate 0.33 Hate 0.56 Not-Hate 
I am beginning to think being straight is misconduct. Not-Hate 0.0 Hate 0.56 Not-Hate 
Armenia is a nation of mongrel bastards. Hate 1.0 Hate 0.78 Not-Hate 
Hope they both get AIDS. Hate 1.0 Hate 0.72 Not-Hate 
I am so NOT afraid of you gay boy. Hate 0.67 Hate 0.83 Not-Hate 
TextAnnotationMulti-taskBaseline Label
Label%HateLabel%Hate
Agreed. Traitors deserve to be shot. PERIOD. Not-Hate 0.33 Not-Hate 0.39 Hate 
Are the democrats guilty of treason? Not-Hate 0.25 Not-Hate 0.39 Hate 
I don’t know, you tell me ya prick. Not-Hate 0.33 Not-Hate 0.39 Hate 
They should force the ‘refugees’ to wear this crap. Hate 0.67 Not-Hate 0.33 Hate 
At this point, nobody gives a shit! Hate 0.67 Not-Hate 0.44 Hate 
It’s OK to be a Nazi!! Hate 1.00 Not-Hate 0.44 Hate 
Arise WHITE PEOPLE! We’re back. Not-Hate 0.33 Hate 0.56 Not-Hate 
Shocking! A jew defending another jew! Who’d have thought? Not-Hate 0.33 Hate 0.56 Not-Hate 
I am beginning to think being straight is misconduct. Not-Hate 0.0 Hate 0.56 Not-Hate 
Armenia is a nation of mongrel bastards. Hate 1.0 Hate 0.78 Not-Hate 
Hope they both get AIDS. Hate 1.0 Hate 0.72 Not-Hate 
I am so NOT afraid of you gay boy. Hate 0.67 Hate 0.83 Not-Hate 
Close Modal

or Create an Account

Close Modal
Close Modal