Skip to Main Content
Table 5: 
Accuracy comparisons for UDv2.1 data sets. Table 6 gives F1 comparisons which are similar. LR is the low-resource language, HR is the high-resource language, XFER represents HR to LR transfer learning. 100/1000 indicate the number of sentences in the training set for low-resource experiments. Morse and MorseTag rows give the average of 5 experiments with standard deviation in parentheses. Statistically significant leaders (p < 0.05) are marked in bold. Some experiments have multiple leaders marked when their difference is not statistically significant.
HR/LRModelLR100XFER100LR1000XFER1000HR
DA/SV Cotterell 15.11 66.06 68.64 82.26 91.79 
Malaviya 29.47 63.22 71.32 77.43  
Morse 62.45(0.69) 72.70(0.59) 86.44(0.17) 87.55(0.22) 92.68(0.19) 
MorseTag 66.19(1.23) 76.70(0.72) 88.31(0.17) 88.97(0.54) 93.35(0.23) 
 
RU/BG Cotterell 29.05 52.76 59.20 71.90 82.02 
Malaviya 27.81 46.89 39.25 67.56  
Morse 59.82(1.65) 69.27(0.54) 87.71(0.26) 88.70(0.16) 85.43(0.12) 
MorseTag 66.97(1.34) 75.78(0.26) 88.96(0.41) 90.52(0.21) 86.51(0.36) 
 
FI/HU Cotterell 21.97 51.74 50.75 61.80 85.25 
Malaviya 33.32 45.41 45.90 63.93  
Morse 49.58(1.27) 54.84(0.71) 72.28(0.74) 71.33(1.83) 91.24(0.28) 
MorseTag 54.87(0.72) 57.12(0.36) 73.55(0.72) 73.86(1.28) 91.42(0.84) 
 
ES/PT Cotterell 18.91 79.40 74.22 85.85 93.09 
Malaviya 58.82 77.75 76.26 85.02  
Morse 70.57(0.54) 80.01(0.38) 86.29(0.31) 87.51(0.27) 92.95(0.21) 
MorseTag 70.80(1.14) 81.60(0.16) 86.24(0.28) 88.01(0.13) 92.89(0.18) 
HR/LRModelLR100XFER100LR1000XFER1000HR
DA/SV Cotterell 15.11 66.06 68.64 82.26 91.79 
Malaviya 29.47 63.22 71.32 77.43  
Morse 62.45(0.69) 72.70(0.59) 86.44(0.17) 87.55(0.22) 92.68(0.19) 
MorseTag 66.19(1.23) 76.70(0.72) 88.31(0.17) 88.97(0.54) 93.35(0.23) 
 
RU/BG Cotterell 29.05 52.76 59.20 71.90 82.02 
Malaviya 27.81 46.89 39.25 67.56  
Morse 59.82(1.65) 69.27(0.54) 87.71(0.26) 88.70(0.16) 85.43(0.12) 
MorseTag 66.97(1.34) 75.78(0.26) 88.96(0.41) 90.52(0.21) 86.51(0.36) 
 
FI/HU Cotterell 21.97 51.74 50.75 61.80 85.25 
Malaviya 33.32 45.41 45.90 63.93  
Morse 49.58(1.27) 54.84(0.71) 72.28(0.74) 71.33(1.83) 91.24(0.28) 
MorseTag 54.87(0.72) 57.12(0.36) 73.55(0.72) 73.86(1.28) 91.42(0.84) 
 
ES/PT Cotterell 18.91 79.40 74.22 85.85 93.09 
Malaviya 58.82 77.75 76.26 85.02  
Morse 70.57(0.54) 80.01(0.38) 86.29(0.31) 87.51(0.27) 92.95(0.21) 
MorseTag 70.80(1.14) 81.60(0.16) 86.24(0.28) 88.01(0.13) 92.89(0.18) 
Close Modal

or Create an Account

Close Modal
Close Modal