Top 5 features ordered from left to right for a selection of the non-contextualized probing tasks with the Binder vectors mapped from the FastText embeddings, and for the contextualized probing tasks with the Binder vectors mapped from the BERT token embeddings.
| Task . | Top Features . | |
|---|---|---|
| Positive/Negative | Pleasant, Happy, Benefit, Needs, Self | |
| Concrete/Abstract | Shape, Vision, Weight, Texture, Touch | |
| Animate/Inanimate | Face, Body, Human, Speech, Biomotion | |
| fill-9.8 | Color, Vision, Bright, Weight, Pattern | |
| cut-21.1+carve-21.2 | Practice, Touch, Upper Limb, Vision, Shape | |
| admire-31.2 | Cognition, Social, Arousal, Happy, Pleasant | |
| judgement-33.1 | Communication, Social, Head, Cognition, Arousal | |
| say-37.7 | Communication, Cognition, Benefit, Social, Self | |
| sound_emission-43.2 | Audition, Loud, Sound, High, Music | |
| cooking-45.3 | Taste, Temperature, Smell, Head, Practice | |
| contiguous_location-47.8 | Landmark, Vision, Color, Large, Scene | |
| run-51.3.2 | Lower Limb, Motion, Path, Fast, Biomotion | |
| Direct object animacy | Face, UpperLimb, Scene, Complexity, Biomotion | |
| Causative/Inchoative alternation | Slow, Complexity, Temperature, UpperLimb, Short | |
| Task . | Top Features . | |
|---|---|---|
| Positive/Negative | Pleasant, Happy, Benefit, Needs, Self | |
| Concrete/Abstract | Shape, Vision, Weight, Texture, Touch | |
| Animate/Inanimate | Face, Body, Human, Speech, Biomotion | |
| fill-9.8 | Color, Vision, Bright, Weight, Pattern | |
| cut-21.1+carve-21.2 | Practice, Touch, Upper Limb, Vision, Shape | |
| admire-31.2 | Cognition, Social, Arousal, Happy, Pleasant | |
| judgement-33.1 | Communication, Social, Head, Cognition, Arousal | |
| say-37.7 | Communication, Cognition, Benefit, Social, Self | |
| sound_emission-43.2 | Audition, Loud, Sound, High, Music | |
| cooking-45.3 | Taste, Temperature, Smell, Head, Practice | |
| contiguous_location-47.8 | Landmark, Vision, Color, Large, Scene | |
| run-51.3.2 | Lower Limb, Motion, Path, Fast, Biomotion | |
| Direct object animacy | Face, UpperLimb, Scene, Complexity, Biomotion | |
| Causative/Inchoative alternation | Slow, Complexity, Temperature, UpperLimb, Short | |