Skip to Main Content
Table 5: 

Ablation results for model combination on development sets (combined score). Results for reranking are similar and are not shown. ‘All’, ‘Direct’, ‘Source’, and ‘Channel’ denote no ablation, direct model, source model and channel model, respectively. Rows with ‘+’ are combinations of two sub-modules, while the rows with ‘-’ are combinations of three sub-modules.

ModelCamRest676MultiWOZ
Direct decoding 115.17 96.73 
Noisy Channel Online Decoding 
Direct + Channel 115.63 98.54 
Direct + Source 115.91 99.12 
Direct + Length 115.56 97.57 
Channel + Source 115.82 99.18 
Channel + Length 115.60 98.71 
Source + Length 115.62 99.19 
All - Direct 115.96 100.89 
All - Channel 116.56 100.93 
All - Source 116.38 99.92 
All - Length 116.52 101.11 
All 116.91 102.62 
ModelCamRest676MultiWOZ
Direct decoding 115.17 96.73 
Noisy Channel Online Decoding 
Direct + Channel 115.63 98.54 
Direct + Source 115.91 99.12 
Direct + Length 115.56 97.57 
Channel + Source 115.82 99.18 
Channel + Length 115.60 98.71 
Source + Length 115.62 99.19 
All - Direct 115.96 100.89 
All - Channel 116.56 100.93 
All - Source 116.38 99.92 
All - Length 116.52 101.11 
All 116.91 102.62 
Close Modal

or Create an Account

Close Modal
Close Modal