Skip to Main Content
Table 2: 
Average number of calls (rounded to nearest whole digit) to score, the sequence transduction model, per generated sequence when using different decoding algorithms. Green percentages are performance improvements over standard beam search. Beam search (ES) refers to the OpenNMT early-stopping method (Klein et al., 2017). All methods provably return the same solution and thus, evaluation metrics (in dark blue) for a given beam size are identical.
IWSLT’14 De-EnMTTT Fr-EnCNN-DailyMail
k = 5 (35.6)k = 10 (35.4)k = 100 (34.7)k = 500 (7.9)k = 10 (33.0)k = 100 (9.9)k = 500 (1.2)k = 5 (31.5)k = 10 (30.9)k = 100 (29.1)
BF beam search 93(24%) 169(36%) 1275(79%) 1168(736%) 184(16%) 867(138%) 885(836%) 200(33%) 305(43%) 2960(92%) 
Beam search (ES) 10(7%) 210(9%) 2047(12%) 7685(27%) 196(9%) 1310(58%) 4182(98%) 224(19%) 357(22%) 3942(59%) 
Beam search 115 229 2286 9770 214 2066 8281 266 435 5673 
IWSLT’14 De-EnMTTT Fr-EnCNN-DailyMail
k = 5 (35.6)k = 10 (35.4)k = 100 (34.7)k = 500 (7.9)k = 10 (33.0)k = 100 (9.9)k = 500 (1.2)k = 5 (31.5)k = 10 (30.9)k = 100 (29.1)
BF beam search 93(24%) 169(36%) 1275(79%) 1168(736%) 184(16%) 867(138%) 885(836%) 200(33%) 305(43%) 2960(92%) 
Beam search (ES) 10(7%) 210(9%) 2047(12%) 7685(27%) 196(9%) 1310(58%) 4182(98%) 224(19%) 357(22%) 3942(59%) 
Beam search 115 229 2286 9770 214 2066 8281 266 435 5673 
Close Modal

or Create an Account

Close Modal
Close Modal