Word prediction accuracy after fine-grained tag distinction removal, masked version. Rand control performance are all between 56.05 and 56.49 accuracy (with a maximum difference from vanilla of 0.92 points).
| c-pos . | Vanilla . | Amnesic . | Δ . |
|---|---|---|---|
| verb | 56.98 | 55.60 | 1.38 |
| noun | 56.98 | 55.79 | 1.19 |
| adposition | 56.98 | 53.40 | 3.58 |
| determiner | 56.98 | 51.04 | 5.94 |
| numeral | 56.98 | 55.88 | 1.10 |
| punctuation | 56.98 | 53.12 | 3.86 |
| particle | 56.98 | 55.26 | 1.72 |
| conjunction | 56.98 | 54.29 | 2.69 |
| adverb | 56.98 | 55.64 | 1.34 |
| pronoun | 56.98 | 54.97 | 2.02 |
| adjective | 56.98 | 55.95 | 1.03 |
| c-pos . | Vanilla . | Amnesic . | Δ . |
|---|---|---|---|
| verb | 56.98 | 55.60 | 1.38 |
| noun | 56.98 | 55.79 | 1.19 |
| adposition | 56.98 | 53.40 | 3.58 |
| determiner | 56.98 | 51.04 | 5.94 |
| numeral | 56.98 | 55.88 | 1.10 |
| punctuation | 56.98 | 53.12 | 3.86 |
| particle | 56.98 | 55.26 | 1.72 |
| conjunction | 56.98 | 54.29 | 2.69 |
| adverb | 56.98 | 55.64 | 1.34 |
| pronoun | 56.98 | 54.97 | 2.02 |
| adjective | 56.98 | 55.95 | 1.03 |