Comparison between weight-based and instance-based systems. Cells show unlabeled attachment scores (UAS) before the slash and labeled attachment scores (LAS) after the slash on each test set. System IDs stand for the first letters of the options: e.g., WId stands for “W”eight-based learning and “I”nstance-based inference using the “d”ot product. The system ID, Kulmizev+’19, is the graph-based parser with BERT in Kulmizev et al. (2019).
| Learning . | Weight-based . | Weight-based . | Instance-based . | ||||
|---|---|---|---|---|---|---|---|
| Inference . | Weight-based . | Weight-based . | Instance-based . | Instance-based . | |||
| Similarity . | dot . | dot . | . | dot . | . | dot . | . |
| System ID | Kulmizev+’19 | WWd | WWc | WId | WIc | IId | IIc |
| PTB-English | – | 96.4/95.3 | 96.4/95.3 | 96.4/94.4 | 93.0/91.8 | 96.4/95.3 | 96.4/95.3 |
| UD-Average | – /84.9 | 89.0/85.6 | 89.0/85.6 | 89.0/85.2 | 83.0/79.5 | 89.3/85.7 | 89.0/85.5 |
| UD-Arabic | – /81.8 | 87.8/82.1 | 87.8/82.1 | 87.8/81.6 | 84.9/79.0 | 88.0/82.1 | 87.6/81.9 |
| UD-Basque | – /79.8 | 84.9/81.1 | 84.9/80.9 | 84.9/80.6 | 82.0/77.9 | 85.1/80.9 | 85.0/80.8 |
| UD-Chinese | – /83.4 | 85.6/82.3 | 85.8/82.4 | 85.7/81.6 | 80.9/77.3 | 86.3/82.8 | 85.9/82.5 |
| UD-English | – /87.6 | 90.9/88.1 | 90.7/88.0 | 90.9/87.8 | 88.1/85.3 | 91.1/88.3 | 91.0/88.2 |
| UD-Finnish | – /83.9 | 89.4/86.6 | 89.1/86.3 | 89.3/86.1 | 84.1/81.2 | 89.6/86.6 | 89.4/86.4 |
| UD-Hebrew | – /85.9 | 89.4/86.4 | 89.5/86.5 | 89.4/85.9 | 82.7/79.7 | 89.8/86.7 | 89.6/86.6 |
| UD-Hindi | – /90.8 | 94.8/91.7 | 94.8/91.7 | 94.8/91.4 | 91.4/88.0 | 94.9/91.8 | 94.9/91.6 |
| UD-Italian | – /91.7 | 94.1/92.0 | 94.2/92.1 | 94.1/91.9 | 91.5/89.4 | 94.3/92.2 | 94.1/92.0 |
| UD-Japanese | – /92.1 | 94.3/92.8 | 94.5/93.0 | 94.3/92.7 | 92.5/90.9 | 94.6/93.1 | 94.4/92.8 |
| UD-Korean | – /84.2 | 88.0/84.4 | 87.9/84.3 | 88.0/84.2 | 84.3/80.4 | 88.1/84.4 | 88.2/84.5 |
| UD-Russian | – /91.0 | 94.2/92.7 | 94.1/92.7 | 94.2/92.4 | 57.7/56.5 | 94.3/92.8 | 94.1/92.6 |
| UD-Swedish | – /86.9 | 90.3/87.6 | 90.3/87.5 | 90.4/87.1 | 88.6/85.8 | 90.5/87.5 | 90.4/87.5 |
| UD-Turkish | – /64.9 | 73.0/65.3 | 73.2/65.4 | 73.1/64.5 | 69.9/61.9 | 73.7/65.5 | 72.9/64.7 |
| Learning . | Weight-based . | Weight-based . | Instance-based . | ||||
|---|---|---|---|---|---|---|---|
| Inference . | Weight-based . | Weight-based . | Instance-based . | Instance-based . | |||
| Similarity . | dot . | dot . | . | dot . | . | dot . | . |
| System ID | Kulmizev+’19 | WWd | WWc | WId | WIc | IId | IIc |
| PTB-English | – | 96.4/95.3 | 96.4/95.3 | 96.4/94.4 | 93.0/91.8 | 96.4/95.3 | 96.4/95.3 |
| UD-Average | – /84.9 | 89.0/85.6 | 89.0/85.6 | 89.0/85.2 | 83.0/79.5 | 89.3/85.7 | 89.0/85.5 |
| UD-Arabic | – /81.8 | 87.8/82.1 | 87.8/82.1 | 87.8/81.6 | 84.9/79.0 | 88.0/82.1 | 87.6/81.9 |
| UD-Basque | – /79.8 | 84.9/81.1 | 84.9/80.9 | 84.9/80.6 | 82.0/77.9 | 85.1/80.9 | 85.0/80.8 |
| UD-Chinese | – /83.4 | 85.6/82.3 | 85.8/82.4 | 85.7/81.6 | 80.9/77.3 | 86.3/82.8 | 85.9/82.5 |
| UD-English | – /87.6 | 90.9/88.1 | 90.7/88.0 | 90.9/87.8 | 88.1/85.3 | 91.1/88.3 | 91.0/88.2 |
| UD-Finnish | – /83.9 | 89.4/86.6 | 89.1/86.3 | 89.3/86.1 | 84.1/81.2 | 89.6/86.6 | 89.4/86.4 |
| UD-Hebrew | – /85.9 | 89.4/86.4 | 89.5/86.5 | 89.4/85.9 | 82.7/79.7 | 89.8/86.7 | 89.6/86.6 |
| UD-Hindi | – /90.8 | 94.8/91.7 | 94.8/91.7 | 94.8/91.4 | 91.4/88.0 | 94.9/91.8 | 94.9/91.6 |
| UD-Italian | – /91.7 | 94.1/92.0 | 94.2/92.1 | 94.1/91.9 | 91.5/89.4 | 94.3/92.2 | 94.1/92.0 |
| UD-Japanese | – /92.1 | 94.3/92.8 | 94.5/93.0 | 94.3/92.7 | 92.5/90.9 | 94.6/93.1 | 94.4/92.8 |
| UD-Korean | – /84.2 | 88.0/84.4 | 87.9/84.3 | 88.0/84.2 | 84.3/80.4 | 88.1/84.4 | 88.2/84.5 |
| UD-Russian | – /91.0 | 94.2/92.7 | 94.1/92.7 | 94.2/92.4 | 57.7/56.5 | 94.3/92.8 | 94.1/92.6 |
| UD-Swedish | – /86.9 | 90.3/87.6 | 90.3/87.5 | 90.4/87.1 | 88.6/85.8 | 90.5/87.5 | 90.4/87.5 |
| UD-Turkish | – /64.9 | 73.0/65.3 | 73.2/65.4 | 73.1/64.5 | 69.9/61.9 | 73.7/65.5 | 72.9/64.7 |