Skip to Main Content
Table 3: 

Accuracy of KB query prediction of m𝓑-MAPO and other algorithms on CamRest and DSTC2 on 10 runs. Partial intent query (PIQ) ratio is the fraction of partial intent queries predicted.

AccuracyPIQ RatioTotal Test Rewards
DSTC2CamRestDSTC2CamRestDSTC2CamRest
REINFORCE 0.00 0.00 0.00 0.00 0.00 0.00 
BS-REINFORCE 0.00 0.00 0.00 0.004±0.008 0.00 0.01±0.03 
RBS-REINFORCE 0.00 0.002±0.005 0.00 0.02±0.05 0.00 0.24±0.26 
MAPO 0.25±0.01 0.10±0.01 0.61±0.01 0.54±0.05 77.13±3.6 11.8±0.5 
 
m𝓑-MAPO 0.68±0.03 0.62±0.03 0.06±0.03 0.09±0.02 169.98±7.6 23.4±1.1 
SL 0.78±0.02 0.59±0.06 0.09±0.02 0.09±0.03 175.9±2.7 21.7±1.4 
SL+RL 0.78±0.02 0.66±0.04 0.09±0.02 0.09±0.03 175.9±2.7 23.7±1.3 
AccuracyPIQ RatioTotal Test Rewards
DSTC2CamRestDSTC2CamRestDSTC2CamRest
REINFORCE 0.00 0.00 0.00 0.00 0.00 0.00 
BS-REINFORCE 0.00 0.00 0.00 0.004±0.008 0.00 0.01±0.03 
RBS-REINFORCE 0.00 0.002±0.005 0.00 0.02±0.05 0.00 0.24±0.26 
MAPO 0.25±0.01 0.10±0.01 0.61±0.01 0.54±0.05 77.13±3.6 11.8±0.5 
 
m𝓑-MAPO 0.68±0.03 0.62±0.03 0.06±0.03 0.09±0.02 169.98±7.6 23.4±1.1 
SL 0.78±0.02 0.59±0.06 0.09±0.02 0.09±0.03 175.9±2.7 21.7±1.4 
SL+RL 0.78±0.02 0.66±0.04 0.09±0.02 0.09±0.03 175.9±2.7 23.7±1.3 
Close Modal

or Create an Account

Close Modal
Close Modal