Method . | Pan16 . | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Mention (y) . | Gender (g) . | Fairness . | Mention (y) . | Age (g) . | Fairness . | |||||||
F1↑ . | MDL↓ . | ΔF1↓ . | MDL↑ . | DP↓ . | GapgRMS ↓ . | F1↑ . | MDL↓ . | ΔF1↓ . | MDL↑ . | DP↓ . | GapgRMS ↓ . | |
BERTbase (pre-trained) | 72.3 | 259.7 | 7.4 | 300.5 | 0.11 | 0.056 | 72.8 | 262.6 | 6.1 | 302.0 | 0.14 | 0.078 |
BERTbase (fine-tuned) | 89.7 | 4.0 | 15.1 | 267.6 | 0.04 | 0.007 | 89.3 | 4.8 | 7.4 | 295.4 | 0.04 | 0.006 |
AdS | 89.7 | 7.6 | 4.9 | 313.9 | 0.04 | 0.007 | 89.2 | 6.0 | 1.1 | 315.1 | 0.04 | 0.004 |
FaRM | 88.7 | 1.7 | 0.0 | 312.4 | 0.04 | 0.007 | 88.6 | 0.8 | 0.0 | 312.6 | 0.03 | 0.008 |
Method . | Pan16 . | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Mention (y) . | Gender (g) . | Fairness . | Mention (y) . | Age (g) . | Fairness . | |||||||
F1↑ . | MDL↓ . | ΔF1↓ . | MDL↑ . | DP↓ . | GapgRMS ↓ . | F1↑ . | MDL↓ . | ΔF1↓ . | MDL↑ . | DP↓ . | GapgRMS ↓ . | |
BERTbase (pre-trained) | 72.3 | 259.7 | 7.4 | 300.5 | 0.11 | 0.056 | 72.8 | 262.6 | 6.1 | 302.0 | 0.14 | 0.078 |
BERTbase (fine-tuned) | 89.7 | 4.0 | 15.1 | 267.6 | 0.04 | 0.007 | 89.3 | 4.8 | 7.4 | 295.4 | 0.04 | 0.006 |
AdS | 89.7 | 7.6 | 4.9 | 313.9 | 0.04 | 0.007 | 89.2 | 6.0 | 1.1 | 315.1 | 0.04 | 0.004 |
FaRM | 88.7 | 1.7 | 0.0 | 312.4 | 0.04 | 0.007 | 88.6 | 0.8 | 0.0 | 312.6 | 0.03 | 0.008 |