Spearman correlation ρ for the STSb dataset under the supervised setting. We use *-NLI to denote the model additionally trained on NLI datasets. ♯ indicates that results are reproduced by ourselves; § indicates results are taken from Reimers and Gurevych (2019); Surrogate are results for our proposed method.
Model . | Spearman ρ . |
---|---|
BERT [CLS]sharp | 73.01 |
BERTbase§ | 84.30 |
SBERTbase§ | 84.67 |
SRoBERTabase§ | 84.92 |
Surrogatebase | 87.91 |
BERT-NLIbase§ | 88.33 |
SBERT-NLIbase§ | 85.35 |
SRoBERTa-NLIbase§ | 84.79 |
Surrogate-NLIbase | 89.95 |
BERTlarge§ | 85.64 |
SBERTlarge§ | 84.45 |
SRoBERTalarge§ | 85.02 |
Surrogatelarge | 88.52 |
BERT-NLIlarge§ | 88.77 |
SBERT-NLIlarge§ | 86.10 |
SRoBERTa-NLIlarge§ | 86.15 |
Surrogate-NLIlarge | 90.69 |
Model . | Spearman ρ . |
---|---|
BERT [CLS]sharp | 73.01 |
BERTbase§ | 84.30 |
SBERTbase§ | 84.67 |
SRoBERTabase§ | 84.92 |
Surrogatebase | 87.91 |
BERT-NLIbase§ | 88.33 |
SBERT-NLIbase§ | 85.35 |
SRoBERTa-NLIbase§ | 84.79 |
Surrogate-NLIbase | 89.95 |
BERTlarge§ | 85.64 |
SBERTlarge§ | 84.45 |
SRoBERTalarge§ | 85.02 |
Surrogatelarge | 88.52 |
BERT-NLIlarge§ | 88.77 |
SBERT-NLIlarge§ | 86.10 |
SRoBERTa-NLIlarge§ | 86.15 |
Surrogate-NLIlarge | 90.69 |