Skip to Main Content
Table 4: 
Details of our dataset probes, including both the number of unique (q,a) pairs (for WordNetQA) and the number of all questions including distractor choice perturbations (w Perturb.).
Probe# Questions(Unique / w Perturb.)Cluster Size(Avg.)# Synsets(or concepts)
Hypernymy 19,705 / 35,094 7,849 
Hyponymy 6,697 / 35,243 11 3,452 
Synonymy 28,254 / 91,069 15,632 
Definitions 31,380 / 148,662 10 15,159 
 
WordSense ∼7,000 / – ∼7,000 
Probe# Questions(Unique / w Perturb.)Cluster Size(Avg.)# Synsets(or concepts)
Hypernymy 19,705 / 35,094 7,849 
Hyponymy 6,697 / 35,243 11 3,452 
Synonymy 28,254 / 91,069 15,632 
Definitions 31,380 / 148,662 10 15,159 
 
WordSense ∼7,000 / – ∼7,000 
Close Modal

or Create an Account

Close Modal
Close Modal