Skip to Main Content
Table C.1 
Probing Task Results for Additional Languages from the Same Language Family. Bold represents the best score, and italics represents the second best.
Hungarian (Uralic)
TaskbaselineMUSEword2vecGloVe-BPEfastTextD-ELMo
Case 30.06 55.7 43.2 86.8 95 98.2 
Mood 52.37 64.3 68.7 83.9 94.3 97.6 
Number 47.14 63.3 61 85.9 94.8 97.3 
POS 84.01 89 85 92.2 97.8 99.6 
Person 41.16 58.6 58.1 82.9 93.8 97 
Tense 47.97 67.1 65.9 81.3 93.2 95.1 
  
CharacterBin 49.1 53.9 47.6 52 55.4 65 
TagCount 74.21 83.7 77.1 90.3 96.4 98.2 
  
OddFeat 30.99 37.5 32.5 45.8 49.2 52.2 
Czech (Slavic)
TaskbaselineMUSEword2vecGloVe-BPEfastTextD-ELMo
Case 29.94 69.6 64.4 85.8 94.6 97.1 
POS 69.74 80.3 72.2 87.6 96.1 98.5 
  
CharacterBin 53.34 57.5 54.2 61.0 65.8 71.5 
TagCount 60.97 78.2 68.3 78.2 92.2 95.8 
  
OddFeat 32.23 46 42.4 41.7 49.7 52.2 
SameFeat 32.1 65.9 69.6 75.7 84 89.7 
French (Romance)
TaskbaselineMUSEword2vecGloVe-BPEfastTextD-ELMo
Mood 55.64 70.6 72.2 79.2 93.4 93.4 
Number 43.93 62.9 72.1 88 98.3 99 
POS 75.7 88.7 84.6 91.4 98.8 99.3 
Person 43.51 58 66.4 85.7 97.7 98 
Pseudo 51.67 96.9 75 90.8 85.5 97.6 
Tense 41.59 62.7 67.6 73.5 95.3 94 
  
CharacterBin 45.16 57.6 54.6 59.5 62.1 73.9 
TagCount 43.54 66.9 67 67.9 91.1 90.2 
  
SameFeat 28.01 43.2 67.3 55.3 72.2 72.6 
Hungarian (Uralic)
TaskbaselineMUSEword2vecGloVe-BPEfastTextD-ELMo
Case 30.06 55.7 43.2 86.8 95 98.2 
Mood 52.37 64.3 68.7 83.9 94.3 97.6 
Number 47.14 63.3 61 85.9 94.8 97.3 
POS 84.01 89 85 92.2 97.8 99.6 
Person 41.16 58.6 58.1 82.9 93.8 97 
Tense 47.97 67.1 65.9 81.3 93.2 95.1 
  
CharacterBin 49.1 53.9 47.6 52 55.4 65 
TagCount 74.21 83.7 77.1 90.3 96.4 98.2 
  
OddFeat 30.99 37.5 32.5 45.8 49.2 52.2 
Czech (Slavic)
TaskbaselineMUSEword2vecGloVe-BPEfastTextD-ELMo
Case 29.94 69.6 64.4 85.8 94.6 97.1 
POS 69.74 80.3 72.2 87.6 96.1 98.5 
  
CharacterBin 53.34 57.5 54.2 61.0 65.8 71.5 
TagCount 60.97 78.2 68.3 78.2 92.2 95.8 
  
OddFeat 32.23 46 42.4 41.7 49.7 52.2 
SameFeat 32.1 65.9 69.6 75.7 84 89.7 
French (Romance)
TaskbaselineMUSEword2vecGloVe-BPEfastTextD-ELMo
Mood 55.64 70.6 72.2 79.2 93.4 93.4 
Number 43.93 62.9 72.1 88 98.3 99 
POS 75.7 88.7 84.6 91.4 98.8 99.3 
Person 43.51 58 66.4 85.7 97.7 98 
Pseudo 51.67 96.9 75 90.8 85.5 97.6 
Tense 41.59 62.7 67.6 73.5 95.3 94 
  
CharacterBin 45.16 57.6 54.6 59.5 62.1 73.9 
TagCount 43.54 66.9 67 67.9 91.1 90.2 
  
SameFeat 28.01 43.2 67.3 55.3 72.2 72.6 
Close Modal

or Create an Account

Close Modal
Close Modal