Probabilistic confusion matrix between all annotators.
. | Claim . | Premise . | Backing . | Rebuttal . | Refutation . | None . |
---|---|---|---|---|---|---|
Claim | 0.59 | 0.17 | 0.07 | 0.04 | 0.02 | 0.11 |
Premise | 0.01 | 0.54 | 0.16 | 0.06 | 0.00 | 0.23 |
Backing | 0.03 | 0.17 | 0.52 | 0.02 | 0.00 | 0.25 |
Rebuttal | 0.16 | 0.12 | 0.10 | 0.32 | 0.03 | 0.27 |
Refutation | 0.05 | 0.19 | 0.00 | 0.23 | 0.13 | 0.40 |
None | 0.01 | 0.12 | 0.16 | 0.02 | 0.00 | 0.69 |
. | Claim . | Premise . | Backing . | Rebuttal . | Refutation . | None . |
---|---|---|---|---|---|---|
Claim | 0.59 | 0.17 | 0.07 | 0.04 | 0.02 | 0.11 |
Premise | 0.01 | 0.54 | 0.16 | 0.06 | 0.00 | 0.23 |
Backing | 0.03 | 0.17 | 0.52 | 0.02 | 0.00 | 0.25 |
Rebuttal | 0.16 | 0.12 | 0.10 | 0.32 | 0.03 | 0.27 |
Refutation | 0.05 | 0.19 | 0.00 | 0.23 | 0.13 | 0.40 |
None | 0.01 | 0.12 | 0.16 | 0.02 | 0.00 | 0.69 |