Skip to Main Content
Table 3
bleu, search error, and average number of calls to score for different stopping criterion. “shrinking” refers to the shrinking beam method of Bahdanau et al. (2015) and “early” refers to the stopping criterion of Huang et al. (2017). Note that neither method is guaranteed to return the same result as standard beam search. Search error and performance increases are with respect to standard beam search.
IWSLT’14 De-En
kmethodsearch errorbleu# calls
10 shrinking 0% 35.4 229(0%) 
early 0% 35.4 225(2%) 
BF BS − 35.4 169(36%) 
 
100 shrinking 31.7% 13.2 2278(0%) 
early 31.7% 13.2 1738(31%) 
BF BS − 34.7 1275(79%) 
 
WMT’17 De-En 
10 shrinking 0% 28.6 260(0%) 
early 0% 28.6 252(3%) 
BF BS − 28.6 230(12%) 
 
100 shrinking 1.7% 26.4 2587(0%) 
early 1.7% 26.4 2402(8%) 
BF BS − 26.9 2046(26%) 
IWSLT’14 De-En
kmethodsearch errorbleu# calls
10 shrinking 0% 35.4 229(0%) 
early 0% 35.4 225(2%) 
BF BS − 35.4 169(36%) 
 
100 shrinking 31.7% 13.2 2278(0%) 
early 31.7% 13.2 1738(31%) 
BF BS − 34.7 1275(79%) 
 
WMT’17 De-En 
10 shrinking 0% 28.6 260(0%) 
early 0% 28.6 252(3%) 
BF BS − 28.6 230(12%) 
 
100 shrinking 1.7% 26.4 2587(0%) 
early 1.7% 26.4 2402(8%) 
BF BS − 26.9 2046(26%) 
Close Modal

or Create an Account

Close Modal
Close Modal