MIT Press

Skip to Main Content

Table 11

Experimental results for the IAC_{v2_st} data set using prior and succeeding turns as context (bold are best scores).

Experiment	S			NS
Experiment	P	R	F1	P	R	F1
disc_bl^ct	76.97	78.67	77.81	78.83	77.14	77.97
disc_bl^ct+pt	76.69	75.0	75.83	76.22	77.85	77.03
disc_bl^ct+st	67.36	71.32	69.28	70.45	66.43	68.38
disc_bl^ct+pt+st	74.02	69.12	71.48	71.81	76.43	74.05
tf-idf_bl^ct	71.97	69.85	70.90	71.53	73.57	72.54
tf-idf_bl^ct+pt	72.66	74.26	73.45	74.45	72.86	73.65
tf-idf_bl^ct+st	72.73	70.59	71.64	72.22	74.29	73.24
tf-idf_bl^ct+pt+st	75.97	72.06	73.96	74.15	77.86	75.96
LSTM^ct	74.84	87.50	80.68	85.47	71.43	77.82
LSTM^ct+pt	69.03	78.67	73.53	76.03	65.71	70.49
LSTM^ct+st	78.38	85.29	81.60	84.37	77.14	80.59
LSTM^ct+pt+st	76.62	88.06	81.94	86.55	74.10	79.84
LSTM^ct + LSTM^pt	80.00	88.24	83.92	87.30	78.57	82.71
LSTM^ct + LSTM^st	79.73	86.76	83.10	85.94	78.57	82.09
LSTM^ct + LSTM^pt + LSTM^st	81.25	86.03	83.57	85.61	80.71	83.09
LSTM^{conditional(pt−>ct)}	79.26	78.68	78.97	79.43	80.00	79.71
LSTM^{conditional(ct−>st)}	70.89	69.85	70.37	71.13	72.14	71.63
LSTM^ct_{a_s}	77.18	84.56	80.70	83.46	75.71	79.40
LSTM^ct_{a_s} + LSTM^pt_{a_s}	80.14	83.09	81.59	82.96	80.00	81.45
LSTM^ct_{a_s} + LSTM^st_{a_s}	75.78	89.71	82.15	87.83	72.14	79.22
LSTM^ct_{a_s} + LSTM^pt_{a_s} + LSTM^st_{a_s}	76.58	88.97	82.31	87.29	73.57	79.84
LSTM^ct_{a_w+s} + LSTM^pt_{a_w+s}	79.00	80.14	79.56	80.43	79.29	79.86

Experiment	S			NS
Experiment	P	R	F1	P	R	F1
disc_bl^ct	76.97	78.67	77.81	78.83	77.14	77.97
disc_bl^ct+pt	76.69	75.0	75.83	76.22	77.85	77.03
disc_bl^ct+st	67.36	71.32	69.28	70.45	66.43	68.38
disc_bl^ct+pt+st	74.02	69.12	71.48	71.81	76.43	74.05
tf-idf_bl^ct	71.97	69.85	70.90	71.53	73.57	72.54
tf-idf_bl^ct+pt	72.66	74.26	73.45	74.45	72.86	73.65
tf-idf_bl^ct+st	72.73	70.59	71.64	72.22	74.29	73.24
tf-idf_bl^ct+pt+st	75.97	72.06	73.96	74.15	77.86	75.96
LSTM^ct	74.84	87.50	80.68	85.47	71.43	77.82
LSTM^ct+pt	69.03	78.67	73.53	76.03	65.71	70.49
LSTM^ct+st	78.38	85.29	81.60	84.37	77.14	80.59
LSTM^ct+pt+st	76.62	88.06	81.94	86.55	74.10	79.84
LSTM^ct + LSTM^pt	80.00	88.24	83.92	87.30	78.57	82.71
LSTM^ct + LSTM^st	79.73	86.76	83.10	85.94	78.57	82.09
LSTM^ct + LSTM^pt + LSTM^st	81.25	86.03	83.57	85.61	80.71	83.09
LSTM^{conditional(pt−>ct)}	79.26	78.68	78.97	79.43	80.00	79.71
LSTM^{conditional(ct−>st)}	70.89	69.85	70.37	71.13	72.14	71.63
LSTM^ct_{a_s}	77.18	84.56	80.70	83.46	75.71	79.40
LSTM^ct_{a_s} + LSTM^pt_{a_s}	80.14	83.09	81.59	82.96	80.00	81.45
LSTM^ct_{a_s} + LSTM^st_{a_s}	75.78	89.71	82.15	87.83	72.14	79.22
LSTM^ct_{a_s} + LSTM^pt_{a_s} + LSTM^st_{a_s}	76.58	88.97	82.31	87.29	73.57	79.84
LSTM^ct_{a_w+s} + LSTM^pt_{a_w+s}	79.00	80.14	79.56	80.43	79.29	79.86