Skip to Main Content
Table 6: 

Results on three low-resource regression datasets: clinical STS: MedSTS, N2C2-STS, and PeerRead. r1 are the results without MC-dropout, while r2, Cal, and NLPD are based on applying 30 iterations of MC-dropout. There are two setups: (1) semi-supervised (upper half) = domain gold-labeled data is available; and (2) zero-shot (bottom half). In each case, Du = unlabeled data pool selected based on the model probability; Du = unlabeled data pool selected based on hyperparameter τ over the predicted std; and row 1,4,7,10 = baseline for each setting.

N2C2-STS testMedSTS testPeerRead test
r1 / r2CalNLPDr1 / r2CalNLPDr1 / r2CalNLPD
Semi-supervised: 
BERT LR 0.853 / 0.857 0.384 6.571 0.858 / 0.859 0.158 3.903 0.686 / 0.686 0.370 15.95 
+Du 0.861 / 0.862 0.511 9.232 0.860 / 0.861 0.224 5.267 0.655 / 0.656 0.394 19.26 
+Du 0.860 / 0.864 0.493 8.476 0.863 / 0.866 0.181 4.758 0.720 / 0.720 0.340 19.89 
BERT ConvLR 0.874 / 0.875 0.509 11.51 0.846 / 0.853 0.201 5.968 0.691 / 0.692 0.346 16.98 
+Du 0.875 / 0.876 0.522 13.50 0.846 / 0.855 0.215 6.403 0.671 / 0.683 0.453 25.50 
+Du 0.875 / 0.879 0.535 11.44 0.857 / 0.864 0.222 6.129 0.699 / 0.697 0.374 21.78 
 
Zero-shot: 
BERT LR 0.682 / 0.663 0.568 17.08 0.786 / 0.795 0.199 5.060 0.669 / 0.676 0.400 21.75 
+ Du 0.687 / 0.673 0.624 40.10 0.796 / 0.797 0.266 11.94 0.023 / 0.006 1.728 387.3 
+ Du 0.743 / 0.729 0.630 23.67 0.793 / 0.792 0.296 8.907 0.678 / 0.675 0.495 52.72 
BERT ConvLR 0.728 / 0.722 0.612 21.06 0.776 / 0.788 0.240 8.447 0.627 / 0.635 0.456 36.37 
+ Du 0.746 / 0.737 0.653 47.68 0.790 / 0.794 0.332 16.45 0.138 / 0.119 1.748 546.1 
+ Du 0.763 / 0.748 0.628 40.32 0.809 / 0.810 0.303 15.26 0.656 / 0.659 0.483 57.77 
N2C2-STS testMedSTS testPeerRead test
r1 / r2CalNLPDr1 / r2CalNLPDr1 / r2CalNLPD
Semi-supervised: 
BERT LR 0.853 / 0.857 0.384 6.571 0.858 / 0.859 0.158 3.903 0.686 / 0.686 0.370 15.95 
+Du 0.861 / 0.862 0.511 9.232 0.860 / 0.861 0.224 5.267 0.655 / 0.656 0.394 19.26 
+Du 0.860 / 0.864 0.493 8.476 0.863 / 0.866 0.181 4.758 0.720 / 0.720 0.340 19.89 
BERT ConvLR 0.874 / 0.875 0.509 11.51 0.846 / 0.853 0.201 5.968 0.691 / 0.692 0.346 16.98 
+Du 0.875 / 0.876 0.522 13.50 0.846 / 0.855 0.215 6.403 0.671 / 0.683 0.453 25.50 
+Du 0.875 / 0.879 0.535 11.44 0.857 / 0.864 0.222 6.129 0.699 / 0.697 0.374 21.78 
 
Zero-shot: 
BERT LR 0.682 / 0.663 0.568 17.08 0.786 / 0.795 0.199 5.060 0.669 / 0.676 0.400 21.75 
+ Du 0.687 / 0.673 0.624 40.10 0.796 / 0.797 0.266 11.94 0.023 / 0.006 1.728 387.3 
+ Du 0.743 / 0.729 0.630 23.67 0.793 / 0.792 0.296 8.907 0.678 / 0.675 0.495 52.72 
BERT ConvLR 0.728 / 0.722 0.612 21.06 0.776 / 0.788 0.240 8.447 0.627 / 0.635 0.456 36.37 
+ Du 0.746 / 0.737 0.653 47.68 0.790 / 0.794 0.332 16.45 0.138 / 0.119 1.748 546.1 
+ Du 0.763 / 0.748 0.628 40.32 0.809 / 0.810 0.303 15.26 0.656 / 0.659 0.483 57.77 
Close Modal

or Create an Account

Close Modal
Close Modal