Inter-annotator agreement based on second-pass judgments. Numbers represent percentage of sentences judged correct in second-pass proofreading. Five annotators annotated the first pass, and three annotators judged the sentence correctness in the second pass.
| First → Second ↓ . | A1 . | A2 . | A3 . | A4 . | A5 . |
|---|---|---|---|---|---|
| A1 | — | 93.39 | 97.96 | 89.63 | 72.50 |
| A2 | 84.43 | — | 95.91 | 90.18 | 78.15 |
| A3 | 68.80 | 87.68 | — | 79.39 | 57.50 |
| First → Second ↓ . | A1 . | A2 . | A3 . | A4 . | A5 . |
|---|---|---|---|---|---|
| A1 | — | 93.39 | 97.96 | 89.63 | 72.50 |
| A2 | 84.43 | — | 95.91 | 90.18 | 78.15 |
| A3 | 68.80 | 87.68 | — | 79.39 | 57.50 |