Skip to Main Content
Table 12: 
The oLMpic games medals, summarizing per-task success. ✓ indicate the LM has achieved high accuracy considering controls and baselines, indicates partial success.
RoBERTa LargeBERT WWMBERT LargeRoBERTa BaseBERT Base
Always-Never      
 
Age Comparison ✓ ✓    
Objects Compar. ✓     
 
Antonym Neg. ✓     
 
Property Conj.      
Taxonomy Conj.      
 
Encyc. Comp.      
Multi-hop Comp.      
RoBERTa LargeBERT WWMBERT LargeRoBERTa BaseBERT Base
Always-Never      
 
Age Comparison ✓ ✓    
Objects Compar. ✓     
 
Antonym Neg. ✓     
 
Property Conj.      
Taxonomy Conj.      
 
Encyc. Comp.      
Multi-hop Comp.      
Close Modal

or Create an Account

Close Modal
Close Modal