Skip to Main Content
Table 6 

Probabilistic confusion matrix between all annotators.

ClaimPremiseBackingRebuttalRefutationNone
Claim 0.59 0.17 0.07 0.04 0.02 0.11 
Premise 0.01 0.54 0.16 0.06 0.00 0.23 
Backing 0.03 0.17 0.52 0.02 0.00 0.25 
Rebuttal 0.16 0.12 0.10 0.32 0.03 0.27 
Refutation 0.05 0.19 0.00 0.23 0.13 0.40 
None 0.01 0.12 0.16 0.02 0.00 0.69 
ClaimPremiseBackingRebuttalRefutationNone
Claim 0.59 0.17 0.07 0.04 0.02 0.11 
Premise 0.01 0.54 0.16 0.06 0.00 0.23 
Backing 0.03 0.17 0.52 0.02 0.00 0.25 
Rebuttal 0.16 0.12 0.10 0.32 0.03 0.27 
Refutation 0.05 0.19 0.00 0.23 0.13 0.40 
None 0.01 0.12 0.16 0.02 0.00 0.69 
Close Modal

or Create an Account

Close Modal
Close Modal