Ablation results for model combination on development sets (combined score). Results for reranking are similar and are not shown. ‘All’, ‘Direct’, ‘Source’, and ‘Channel’ denote no ablation, direct model, source model and channel model, respectively. Rows with ‘+’ are combinations of two sub-modules, while the rows with ‘-’ are combinations of three sub-modules.
Model . | CamRest676 . | MultiWOZ . |
---|---|---|
Direct decoding | 115.17 | 96.73 |
Noisy Channel Online Decoding | ||
Direct + Channel | 115.63 | 98.54 |
Direct + Source | 115.91 | 99.12 |
Direct + Length | 115.56 | 97.57 |
Channel + Source | 115.82 | 99.18 |
Channel + Length | 115.60 | 98.71 |
Source + Length | 115.62 | 99.19 |
All - Direct | 115.96 | 100.89 |
All - Channel | 116.56 | 100.93 |
All - Source | 116.38 | 99.92 |
All - Length | 116.52 | 101.11 |
All | 116.91 | 102.62 |
Model . | CamRest676 . | MultiWOZ . |
---|---|---|
Direct decoding | 115.17 | 96.73 |
Noisy Channel Online Decoding | ||
Direct + Channel | 115.63 | 98.54 |
Direct + Source | 115.91 | 99.12 |
Direct + Length | 115.56 | 97.57 |
Channel + Source | 115.82 | 99.18 |
Channel + Length | 115.60 | 98.71 |
Source + Length | 115.62 | 99.19 |
All - Direct | 115.96 | 100.89 |
All - Channel | 116.56 | 100.93 |
All - Source | 116.38 | 99.92 |
All - Length | 116.52 | 101.11 |
All | 116.91 | 102.62 |