Unlabeled attachment scores (top) and labeled attachment scores (bottom) on the test sets. In each table, the first two columns show the results of the parser with word lookup (Words) vs. character-based (Chars) representations. Boldface shows the better result comparing Words vs. Chars, comparing Words + POS vs. Chars + POS, and comparing Words + POS + Morph vs. Chars + POS + Morph.
UAS: . | ||||||
---|---|---|---|---|---|---|
Language . | Words . | Chars . | Words + POS . | Chars + POS . | Words + POS + Morph . | Chars + POS + Morph . |
Arabic | 85.21 | 86.08 | 86.05 | 86.07 | 86.35 | 85.79 |
Basque | 77.06 | 85.19 | 82.92 | 85.22 | 86.87 | 86.02 |
French | 83.74 | 85.34 | 86.15 | 85.78 | 86.81 | 86.21 |
German | 82.75 | 86.80 | 87.33 | 87.26 | 87.40 | 87.48 |
Hebrew | 77.62 | 79.93 | 80.68 | 80.17 | 81.36 | 79.83 |
Hungarian | 72.78 | 80.35 | 78.64 | 80.92 | 81.07 | 81.06 |
Korean | 78.70 | 88.39 | 86.85 | 88.30 | 86.84 | 88.24 |
Polish | 72.01 | 83.44 | 87.06 | 85.97 | 88.93 | 88.44 |
Swedish | 76.39 | 79.18 | 83.43 | 83.24 | 83.18 | 82.04 |
Turkish | 71.70 | 76.32 | 75.32 | 76.34 | 79.52 | 78.28 |
Chinese | 79.01 | 79.94 | 85.96 | 85.30 | – | – |
English | 91.16 | 91.47 | 92.57 | 91.63 | – | – |
Average | 79.01 | 85.36 | 84.41 | 84.68 | – | – |
LAS: . | ||||||
Language . | Words . | Chars . | Words + POS . | Chars + POS . | Words + POS + Morph . | Chars + POS + Morph . |
Arabic | 82.05 | 83.41 | 83.46 | 83.40 | 83.83 | 83.11 |
Basque | 66.61 | 79.09 | 73.56 | 78.61 | 80.83 | 79.92 |
French | 79.22 | 80.92 | 82.03 | 81.08 | 82.65 | 81.97 |
German | 79.15 | 84.04 | 84.62 | 84.49 | 84.79 | 84.86 |
Hebrew | 68.71 | 71.26 | 72.70 | 72.26 | 73.67 | 72.06 |
Hungarian | 61.93 | 75.19 | 69.31 | 76.34 | 76.66 | 76.45 |
Korean | 67.50 | 86.27 | 83.37 | 86.21 | 83.41 | 86.25 |
Polish | 63.96 | 76.84 | 79.83 | 78.24 | 82.67 | 82.21 |
Swedish | 67.69 | 71.19 | 76.40 | 74.47 | 76.42 | 74.41 |
Turkish | 54.55 | 64.34 | 61.22 | 62.28 | 70.93 | 68.28 |
Chinese | 74.79 | 76.29 | 84.40 | 83.72 | – | – |
English | 88.42 | 88.94 | 90.31 | 89.44 | – | – |
Average | 71.22 | 78.15 | 78.43 | 79.21 | – | – |
UAS: . | ||||||
---|---|---|---|---|---|---|
Language . | Words . | Chars . | Words + POS . | Chars + POS . | Words + POS + Morph . | Chars + POS + Morph . |
Arabic | 85.21 | 86.08 | 86.05 | 86.07 | 86.35 | 85.79 |
Basque | 77.06 | 85.19 | 82.92 | 85.22 | 86.87 | 86.02 |
French | 83.74 | 85.34 | 86.15 | 85.78 | 86.81 | 86.21 |
German | 82.75 | 86.80 | 87.33 | 87.26 | 87.40 | 87.48 |
Hebrew | 77.62 | 79.93 | 80.68 | 80.17 | 81.36 | 79.83 |
Hungarian | 72.78 | 80.35 | 78.64 | 80.92 | 81.07 | 81.06 |
Korean | 78.70 | 88.39 | 86.85 | 88.30 | 86.84 | 88.24 |
Polish | 72.01 | 83.44 | 87.06 | 85.97 | 88.93 | 88.44 |
Swedish | 76.39 | 79.18 | 83.43 | 83.24 | 83.18 | 82.04 |
Turkish | 71.70 | 76.32 | 75.32 | 76.34 | 79.52 | 78.28 |
Chinese | 79.01 | 79.94 | 85.96 | 85.30 | – | – |
English | 91.16 | 91.47 | 92.57 | 91.63 | – | – |
Average | 79.01 | 85.36 | 84.41 | 84.68 | – | – |
LAS: . | ||||||
Language . | Words . | Chars . | Words + POS . | Chars + POS . | Words + POS + Morph . | Chars + POS + Morph . |
Arabic | 82.05 | 83.41 | 83.46 | 83.40 | 83.83 | 83.11 |
Basque | 66.61 | 79.09 | 73.56 | 78.61 | 80.83 | 79.92 |
French | 79.22 | 80.92 | 82.03 | 81.08 | 82.65 | 81.97 |
German | 79.15 | 84.04 | 84.62 | 84.49 | 84.79 | 84.86 |
Hebrew | 68.71 | 71.26 | 72.70 | 72.26 | 73.67 | 72.06 |
Hungarian | 61.93 | 75.19 | 69.31 | 76.34 | 76.66 | 76.45 |
Korean | 67.50 | 86.27 | 83.37 | 86.21 | 83.41 | 86.25 |
Polish | 63.96 | 76.84 | 79.83 | 78.24 | 82.67 | 82.21 |
Swedish | 67.69 | 71.19 | 76.40 | 74.47 | 76.42 | 74.41 |
Turkish | 54.55 | 64.34 | 61.22 | 62.28 | 70.93 | 68.28 |
Chinese | 74.79 | 76.29 | 84.40 | 83.72 | – | – |
English | 88.42 | 88.94 | 90.31 | 89.44 | – | – |
Average | 71.22 | 78.15 | 78.43 | 79.21 | – | – |