MIT Press

Table 12

Results for negation cue detection, including the systems of Morante et al. (2009b) and Zhu et al. (2010). Whereas the scores for BSA are obtained by 10-fold cross validation, the scores on BSP and BSR represent held-out testing using a model trained on all the abstracts. The latter scores thereby serves as a test of generalization performance across different text types within the same domain.

		Sentence Level			Token Level			Cue Level
Data	Model	Prec	Rec	F₁	Prec	Rec	F₁	Prec	Rec	F₁
	Baseline	90.34	98.81	94.37	89.28	98.40	93.60	88.92	97.78	93.14
	Filtering	94.19	98.87	96.45	93.46	98.73	96.00	93.19	98.12	95.59
	Morante	n/a	n/a	n/a	84.72	98.75	91.20	94.15	90.67	92.38
	Zhu	n/a	n/a	n/a	94.35	94.99	94.67	n/a	n/a	n/a

	Baseline	79.48	99.41	88.34	75.96	99.00	85.96	74.55	98.41	84.84
	Filtering	86.75	98.53	92.27	85.22	98.25	91.27	84.06	97.62	90.33
	Morante	n/a	n/a	n/a	87.18	95.72	91.25	85.55	78.31	81.77
	Zhu	n/a	n/a	n/a	87.47	90.48	88.95	n/a	n/a	n/a

	Baseline	96.64	96.42	96.53	96.12	96.01	96.06	95.87	95.98	95.93
	Filtering	96.97	96.30	96.64	96.44	95.90	96.17	96.20	95.87	96.03
	Morante	n/a	n/a	n/a	97.33	98.09	97.71	96.38	91.62	93.94
	Zhu	n/a	n/a	n/a	88.54	86.81	87.67	n/a	n/a	n/a

		Sentence Level			Token Level			Cue Level
Data	Model	Prec	Rec	F₁	Prec	Rec	F₁	Prec	Rec	F₁
	Baseline	90.34	98.81	94.37	89.28	98.40	93.60	88.92	97.78	93.14
	Filtering	94.19	98.87	96.45	93.46	98.73	96.00	93.19	98.12	95.59
	Morante	n/a	n/a	n/a	84.72	98.75	91.20	94.15	90.67	92.38
	Zhu	n/a	n/a	n/a	94.35	94.99	94.67	n/a	n/a	n/a

	Baseline	79.48	99.41	88.34	75.96	99.00	85.96	74.55	98.41	84.84
	Filtering	86.75	98.53	92.27	85.22	98.25	91.27	84.06	97.62	90.33
	Morante	n/a	n/a	n/a	87.18	95.72	91.25	85.55	78.31	81.77
	Zhu	n/a	n/a	n/a	87.47	90.48	88.95	n/a	n/a	n/a

	Baseline	96.64	96.42	96.53	96.12	96.01	96.06	95.87	95.98	95.93
	Filtering	96.97	96.30	96.64	96.44	95.90	96.17	96.20	95.87	96.03
	Morante	n/a	n/a	n/a	97.33	98.09	97.71	96.38	91.62	93.94
	Zhu	n/a	n/a	n/a	88.54	86.81	87.67	n/a	n/a	n/a

View Large

This Feature Is Available To Subscribers Only