Skip to Main Content
Table 9

Evaluation of representation models on subsets of SpA-Verb verb pairs focused on particular semantic domains. All scores are Spearman’s ρ.

ModelMotionHeatSoundEmotionPain
SGNS-BOW2 0.247 0.078 0.186 0.160 0.023 
  
CBOW-CC 0.275 0.534 0.416 0.265 0.277 
ELMo-Static 0.300 0.232 0.301 0.317 0.003 
  
Non-distributional 0.341 0.631 0.549 0.232 0.224 
SGNS + Attract-Repel 0.410 0.374 0.588 0.359 0.445 
BOW2-VN 0.327 0.787 0.201 0.294 0.075 
BOW2-FN 0.368 0.393 0.419 0.264 0.465 
  
BERT-BASE (iso0.262 0.138 0.230 0.201 0.185 
context-10 0.239 −.125 0.283 0.336 0.243 
context-100 0.239 −.081 0.290 0.330 0.253 
context-500 0.238 −.081 0.289 0.331 0.255 
  
BERT-LARGE (iso0.254 0.011 0.176 0.248 0.280 
context-10 0.258 0.179 0.272 0.333 0.337 
context-100 0.256 0.188 0.279 0.329 0.347 
context-500 0.256 0.188 0.280 0.332 0.348 
  
BERT-LARGE-WWM (iso0.283 0.339 0.197 0.242 0.260 
ModelMotionHeatSoundEmotionPain
SGNS-BOW2 0.247 0.078 0.186 0.160 0.023 
  
CBOW-CC 0.275 0.534 0.416 0.265 0.277 
ELMo-Static 0.300 0.232 0.301 0.317 0.003 
  
Non-distributional 0.341 0.631 0.549 0.232 0.224 
SGNS + Attract-Repel 0.410 0.374 0.588 0.359 0.445 
BOW2-VN 0.327 0.787 0.201 0.294 0.075 
BOW2-FN 0.368 0.393 0.419 0.264 0.465 
  
BERT-BASE (iso0.262 0.138 0.230 0.201 0.185 
context-10 0.239 −.125 0.283 0.336 0.243 
context-100 0.239 −.081 0.290 0.330 0.253 
context-500 0.238 −.081 0.289 0.331 0.255 
  
BERT-LARGE (iso0.254 0.011 0.176 0.248 0.280 
context-10 0.258 0.179 0.272 0.333 0.337 
context-100 0.256 0.188 0.279 0.329 0.347 
context-500 0.256 0.188 0.280 0.332 0.348 
  
BERT-LARGE-WWM (iso0.283 0.339 0.197 0.242 0.260 
Close Modal

or Create an Account

Close Modal
Close Modal