Skip to Main Content
Table 6: 
bleu scores and the number of calls to score on the IWSLT’14 De-En validation set and WMT’17 De-En test set with queue size restricted to nmaxk. Note that γ = nmax is the standard best-first beam search algorithm. Performance increases are over standard beam search. Search error is with respect to beam search with same beam width.
IWSLT’14 De-En
kγsearch errorbleu# calls
5 22.7% 35.7+0.1 43.8(163%) 
4.4% 35.8+0.2 79.8(44%) 
nmax − 35.6 93.0(24%) 
 
10 22.6% 35.7+0.3 48.4(374%) 
4.5% 35.6+0.2 126.9(81%) 
nmax − 35.4 169.0(36%) 
 
WMT’17 De-En 
5 29.0% 29.7+0.2 77.5(75%) 
1.2% 29.5+0.0 115.8(12%) 
nmax − 29.5 118.8(10%) 
 
10 36.6% 29.5+0.2 97.3(165%) 
2.6% 29.3+0.0 230.0(12%) 
nmax − 29.3 230.2(12%) 
IWSLT’14 De-En
kγsearch errorbleu# calls
5 22.7% 35.7+0.1 43.8(163%) 
4.4% 35.8+0.2 79.8(44%) 
nmax − 35.6 93.0(24%) 
 
10 22.6% 35.7+0.3 48.4(374%) 
4.5% 35.6+0.2 126.9(81%) 
nmax − 35.4 169.0(36%) 
 
WMT’17 De-En 
5 29.0% 29.7+0.2 77.5(75%) 
1.2% 29.5+0.0 115.8(12%) 
nmax − 29.5 118.8(10%) 
 
10 36.6% 29.5+0.2 97.3(165%) 
2.6% 29.3+0.0 230.0(12%) 
nmax − 29.3 230.2(12%) 
Close Modal

or Create an Account

Close Modal
Close Modal