Skip to Main Content
Table 1 

Correlation of BLEU with ranking-based human evaluation reported in WMT events, for German–English and English–German MT in a news domain.

Eventcorrelation typecorrelation for German–English MTcorrelation for English–German MT
WMT07 Spearman 0.40 0.26 
WMT08 Spearman 0.12 0.58 
WMT09 Spearman 0.41 −0.43 
WMT10 Spearman 0.52 0.39 
WMT11 Spearman 0.48 0.44 
WMT12 Spearman 0.67 0.22 
WMT13 Spearman 0.90 0.83 
WMT14 Pearson 0.83 0.22 
WMT15 Pearson 0.86 0.57 
WMT16 Pearson 0.88 0.78 
Eventcorrelation typecorrelation for German–English MTcorrelation for English–German MT
WMT07 Spearman 0.40 0.26 
WMT08 Spearman 0.12 0.58 
WMT09 Spearman 0.41 −0.43 
WMT10 Spearman 0.52 0.39 
WMT11 Spearman 0.48 0.44 
WMT12 Spearman 0.67 0.22 
WMT13 Spearman 0.90 0.83 
WMT14 Pearson 0.83 0.22 
WMT15 Pearson 0.86 0.57 
WMT16 Pearson 0.88 0.78 
View Large
Close Modal
This Feature Is Available To Subscribers Only

or Create an Account

Close Modal
Close Modal
This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy.
Accept