Skip to Main Content
Table 5: 
Results for 5 different splits of CoLA and the original split into in-domain and out-of-domain. All results are averages over 20 restarts. Out N is the number of out-of-domain sentences. Sources are abbreviated by authors’ last initial and year; full citations for each source are shown in Table 2.
SplitIn-DomainOut-of-DomainOverallOut SourcesOut N
Acc.MCCAcc.MCCAcc.MCC
orig. 0.701 0.348 0.620 0.223 0.660 0.285 C05, J71, S97, CLC95, W80, SWB04 1049 
0.729 0.357 0.632 0.195 0.680 0.275 BC01, B73 1139 
0.700 0.319 0.666 0.188 0.683 0.255 KL93, SGWW85, W80, D98, B73, G81 853 
0.708 0.333 0.659 0.284 0.684 0.307 AD03, D98, G81 1237 
0.663 0.243 0.673 0.267 0.668 0.252 B82, SWB04, CJ99 789 
0.720 0.349 0.671 0.285 0.696 0.315 M02, BC01, CJ99 1539 
SplitIn-DomainOut-of-DomainOverallOut SourcesOut N
Acc.MCCAcc.MCCAcc.MCC
orig. 0.701 0.348 0.620 0.223 0.660 0.285 C05, J71, S97, CLC95, W80, SWB04 1049 
0.729 0.357 0.632 0.195 0.680 0.275 BC01, B73 1139 
0.700 0.319 0.666 0.188 0.683 0.255 KL93, SGWW85, W80, D98, B73, G81 853 
0.708 0.333 0.659 0.284 0.684 0.307 AD03, D98, G81 1237 
0.663 0.243 0.673 0.267 0.668 0.252 B82, SWB04, CJ99 789 
0.720 0.349 0.671 0.285 0.696 0.315 M02, BC01, CJ99 1539 
Close Modal

or Create an Account

Close Modal
Close Modal