Inter-annotator agreement for entities.
Type of annotation . | Unit of agreement . | AOA . | Fleiss’ κ . | Krippendorff’s α . | |||
---|---|---|---|---|---|---|---|
Exact . | Partial . | Exact . | Partial . | Exact . | Partial . | ||
Entity type | Span | 0.75 | 0.80 | 0.67 | 0.74 | 0.96 | 0.95 |
Character | 0.96 | – | 0.86 | – | 0.94 | – | |
Identifier type | Span | 0.67 | 0.71 | 0.46 | 0.51 | 0.68 | 0.67 |
Character | 0.94 | – | 0.79 | – | 0.69 | – | |
Confidential | Span | 0.97 | 0.97 | 0.30 | 0.33 | 0.30 | 0.32 |
attribute | Character | 0.96 | – | 0.86 | – | 0.44 | – |
Type of annotation . | Unit of agreement . | AOA . | Fleiss’ κ . | Krippendorff’s α . | |||
---|---|---|---|---|---|---|---|
Exact . | Partial . | Exact . | Partial . | Exact . | Partial . | ||
Entity type | Span | 0.75 | 0.80 | 0.67 | 0.74 | 0.96 | 0.95 |
Character | 0.96 | – | 0.86 | – | 0.94 | – | |
Identifier type | Span | 0.67 | 0.71 | 0.46 | 0.51 | 0.68 | 0.67 |
Character | 0.94 | – | 0.79 | – | 0.69 | – | |
Confidential | Span | 0.97 | 0.97 | 0.30 | 0.33 | 0.30 | 0.32 |
attribute | Character | 0.96 | – | 0.86 | – | 0.44 | – |