Masked, c-pos removal, fine-grained LM analysis. Removing c-pos information and testing the accuracy performance of words, accumulating by their label. Δ is the difference in performance between the vanilla and Amnesic scores.
| c-pos . | Vanilla . | Rand . | Amnesic . | Δ . |
|---|---|---|---|---|
| verb | 46.72 | 44.85 | 34.99 | 11.73 |
| noun | 42.91 | 38.94 | 34.26 | 8.65 |
| adposition | 73.80 | 72.21 | 37.86 | 35.93 |
| determiner | 82.29 | 83.53 | 16.64 | 65.66 |
| numeral | 40.32 | 40.19 | 33.41 | 6.91 |
| punctuation | 80.71 | 81.02 | 47.03 | 33.68 |
| particle | 96.40 | 95.71 | 18.74 | 77.66 |
| conjunction | 78.01 | 72.94 | 4.28 | 73.73 |
| adverb | 39.84 | 34.11 | 23.71 | 16.14 |
| pronoun | 70.29 | 61.93 | 33.23 | 37.06 |
| adjective | 46.41 | 42.63 | 34.56 | 11.85 |
| other | 70.59 | 76.47 | 52.94 | 17.65 |
| c-pos . | Vanilla . | Rand . | Amnesic . | Δ . |
|---|---|---|---|---|
| verb | 46.72 | 44.85 | 34.99 | 11.73 |
| noun | 42.91 | 38.94 | 34.26 | 8.65 |
| adposition | 73.80 | 72.21 | 37.86 | 35.93 |
| determiner | 82.29 | 83.53 | 16.64 | 65.66 |
| numeral | 40.32 | 40.19 | 33.41 | 6.91 |
| punctuation | 80.71 | 81.02 | 47.03 | 33.68 |
| particle | 96.40 | 95.71 | 18.74 | 77.66 |
| conjunction | 78.01 | 72.94 | 4.28 | 73.73 |
| adverb | 39.84 | 34.11 | 23.71 | 16.14 |
| pronoun | 70.29 | 61.93 | 33.23 | 37.06 |
| adjective | 46.41 | 42.63 | 34.56 | 11.85 |
| other | 70.59 | 76.47 | 52.94 | 17.65 |