Skip to Main Content
Table 10: 
Unlabeled attachment scores on UD Treebanks for monolingual (SynTr) and multilingual (UDPipe (Straka, 2018) and UDify (Kondratyuk and Straka, 2019)) baselines, and the refined models (+RNGTr), pre-trained with BERT (Devlin et al., 2019). Bold scores are not significantly different from the best score in that row (with α = 0.01).
LanguageMultiMultiMulti+MonoMonoMonoMono
UDPipeUDifyUDify+RNGTrSynTrSynTr+RNGTrEmpty+RNGTr
Arabic 87.54 87.72 89.73(+16.37%) 89.89 89.94(+0.49%) 89.68 
Basque 86.11 84.94 90.49(+36.85%) 90.46 90.90(+4.61%) 90.69 
Chinese 84.64 87.93 91.04(+25.76%) 91.38 92.47(+12.64%) 91.81 
English 89.63 90.96 92.81(+20.46%) 92.92 93.08(+2.26%) 92.77 
Finnish 89.88 86.42 93.49(+52.06%) 93.52 93.55(+0.47%) 93.36 
Hebrew 89.70 91.63 93.03(+16.73%) 93.36 93.36(0.0%) 92.80 
Hindi 94.85 95.13 96.44(+26.9%) 96.33 96.56(+6.27%) 96.37 
Italian 93.49 95.54 95.72(+4.04%) 96.03 96.10(+1.76%) 95.98 
Japanese 95.06 94.37 96.25(+33.40%) 96.43 96.54(+3.08%) 96.37 
Korean 87.70 82.74 91.32(+49.71%) 91.35 91.49(+1.62%) 91.28 
Russian 93.80 94.83 95.54(+13.73%) 95.53 95.47(−1.34%) 95.38 
Swedish 89.63 91.91 93.72(+22.37%) 93.79 94.14(+5,64%) 94.14 
Turkish 74.19 74.56 77.74(+12.5%) 77.98 78.50(+2.37%) 77.49 
 
Average 88.94 89.13 92.10 92.23 92.46 92.16 
LanguageMultiMultiMulti+MonoMonoMonoMono
UDPipeUDifyUDify+RNGTrSynTrSynTr+RNGTrEmpty+RNGTr
Arabic 87.54 87.72 89.73(+16.37%) 89.89 89.94(+0.49%) 89.68 
Basque 86.11 84.94 90.49(+36.85%) 90.46 90.90(+4.61%) 90.69 
Chinese 84.64 87.93 91.04(+25.76%) 91.38 92.47(+12.64%) 91.81 
English 89.63 90.96 92.81(+20.46%) 92.92 93.08(+2.26%) 92.77 
Finnish 89.88 86.42 93.49(+52.06%) 93.52 93.55(+0.47%) 93.36 
Hebrew 89.70 91.63 93.03(+16.73%) 93.36 93.36(0.0%) 92.80 
Hindi 94.85 95.13 96.44(+26.9%) 96.33 96.56(+6.27%) 96.37 
Italian 93.49 95.54 95.72(+4.04%) 96.03 96.10(+1.76%) 95.98 
Japanese 95.06 94.37 96.25(+33.40%) 96.43 96.54(+3.08%) 96.37 
Korean 87.70 82.74 91.32(+49.71%) 91.35 91.49(+1.62%) 91.28 
Russian 93.80 94.83 95.54(+13.73%) 95.53 95.47(−1.34%) 95.38 
Swedish 89.63 91.91 93.72(+22.37%) 93.79 94.14(+5,64%) 94.14 
Turkish 74.19 74.56 77.74(+12.5%) 77.98 78.50(+2.37%) 77.49 
 
Average 88.94 89.13 92.10 92.23 92.46 92.16 
Close Modal

or Create an Account

Close Modal
Close Modal