Average per polysemy performance of IMS and UKB in all the four configurations (averaged over all the 10 size steps which is also very close to the results with 400 sentences).
| . | Nat-Nat . | Uni-Uni . | Uni-Nat . | Nat-Uni . | MFS baseline . | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| polysemy . | IMS . | UKB . | IMS . | UKB . | IMS . | UKB . | IMS . | UKB . | Nat-Nat . | * – Uni . |
| 2 | 94.7 | 81.7 | 87.5 | 76.5 | 87.5 | 78.8 | 64.4 | 74.0 | 87.7 | 50.0 |
| 3 | 91.0 | 70.8 | 80.0 | 66.6 | 79.5 | 66.1 | 51.8 | 64.5 | 78.2 | 33.3 |
| 4 | 88.9 | 63.5 | 75.6 | 59.5 | 75.9 | 59.0 | 44.7 | 57.6 | 72.0 | 25.0 |
| 5 | 87.6 | 60.7 | 71.8 | 55.4 | 71.7 | 56.1 | 38.5 | 53.6 | 71.3 | 20.0 |
| 6 | 85.9 | 55.3 | 68.1 | 52.6 | 68.7 | 51.3 | 35.6 | 51.7 | 64.2 | 16.7 |
| 7 | 83.4 | 52.5 | 65.0 | 49.1 | 65.2 | 48.0 | 33.9 | 47.7 | 58.8 | 14.3 |
| 8 | 82.2 | 49.3 | 62.2 | 46.2 | 60.7 | 46.0 | 30.6 | 45.2 | 59.0 | 12.5 |
| 9 | 81.2 | 47.1 | 60.3 | 44.9 | 58.9 | 42.9 | 28.8 | 44.1 | 58.7 | 11.1 |
| 10 | 78.5 | 42.6 | 58.1 | 42.0 | 55.1 | 39.2 | 27.9 | 41.4 | 52.4 | 10.0 |
| 11 | 76.1 | 46.3 | 53.5 | 43.8 | 53.7 | 43.2 | 27.0 | 42.2 | 49.6 | 9.1 |
| 12 | 75.2 | 44.6 | 52.5 | 39.7 | 51.9 | 42.4 | 26.2 | 38.8 | 54.9 | 8.3 |
| . | Nat-Nat . | Uni-Uni . | Uni-Nat . | Nat-Uni . | MFS baseline . | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| polysemy . | IMS . | UKB . | IMS . | UKB . | IMS . | UKB . | IMS . | UKB . | Nat-Nat . | * – Uni . |
| 2 | 94.7 | 81.7 | 87.5 | 76.5 | 87.5 | 78.8 | 64.4 | 74.0 | 87.7 | 50.0 |
| 3 | 91.0 | 70.8 | 80.0 | 66.6 | 79.5 | 66.1 | 51.8 | 64.5 | 78.2 | 33.3 |
| 4 | 88.9 | 63.5 | 75.6 | 59.5 | 75.9 | 59.0 | 44.7 | 57.6 | 72.0 | 25.0 |
| 5 | 87.6 | 60.7 | 71.8 | 55.4 | 71.7 | 56.1 | 38.5 | 53.6 | 71.3 | 20.0 |
| 6 | 85.9 | 55.3 | 68.1 | 52.6 | 68.7 | 51.3 | 35.6 | 51.7 | 64.2 | 16.7 |
| 7 | 83.4 | 52.5 | 65.0 | 49.1 | 65.2 | 48.0 | 33.9 | 47.7 | 58.8 | 14.3 |
| 8 | 82.2 | 49.3 | 62.2 | 46.2 | 60.7 | 46.0 | 30.6 | 45.2 | 59.0 | 12.5 |
| 9 | 81.2 | 47.1 | 60.3 | 44.9 | 58.9 | 42.9 | 28.8 | 44.1 | 58.7 | 11.1 |
| 10 | 78.5 | 42.6 | 58.1 | 42.0 | 55.1 | 39.2 | 27.9 | 41.4 | 52.4 | 10.0 |
| 11 | 76.1 | 46.3 | 53.5 | 43.8 | 53.7 | 43.2 | 27.0 | 42.2 | 49.6 | 9.1 |
| 12 | 75.2 | 44.6 | 52.5 | 39.7 | 51.9 | 42.4 | 26.2 | 38.8 | 54.9 | 8.3 |