MIT Press

Table 6:

Ablation studies on DEB.

Model	Pos vs Rand Neg	Pos vs Adv Neg
BERT original	72.65	58.10
DEB pretrained on Reddit	84.16	59.82
Pretrained DEB finetuned on rand neg	88.29	66.75

Model	Pos vs Rand Neg	Pos vs Adv Neg
BERT original	72.65	58.10
DEB pretrained on Reddit	84.16	59.82
Pretrained DEB finetuned on rand neg	88.29	66.75