Skip to Main Content
Table 12

Results for negation cue detection, including the systems of Morante et al. (2009b) and Zhu et al. (2010). Whereas the scores for BSA are obtained by 10-fold cross validation, the scores on BSP and BSR represent held-out testing using a model trained on all the abstracts. The latter scores thereby serves as a test of generalization performance across different text types within the same domain.



Sentence Level
Token Level
Cue Level
Data
Model
Prec
Rec
F1
Prec
Rec
F1
Prec
Rec
F1
 Baseline 90.34 98.81 94.37 89.28 98.40 93.60 88.92 97.78 93.14 
Filtering 94.19 98.87 96.45 93.46 98.73 96.00 93.19 98.12 95.59 
Morante n/a n/a n/a 84.72 98.75 91.20 94.15 90.67 92.38 
Zhu n/a n/a n/a 94.35 94.99 94.67 n/a n/a n/a 
          
 Baseline 79.48 99.41 88.34 75.96 99.00 85.96 74.55 98.41 84.84 
Filtering 86.75 98.53 92.27 85.22 98.25 91.27 84.06 97.62 90.33 
Morante n/a n/a n/a 87.18 95.72 91.25 85.55 78.31 81.77 
Zhu n/a n/a n/a 87.47 90.48 88.95 n/a n/a n/a 
          
 Baseline 96.64 96.42 96.53 96.12 96.01 96.06 95.87 95.98 95.93 
Filtering 96.97 96.30 96.64 96.44 95.90 96.17 96.20 95.87 96.03 
Morante n/a n/a n/a 97.33 98.09 97.71 96.38 91.62 93.94 
Zhu n/a n/a n/a 88.54 86.81 87.67 n/a n/a n/a 


Sentence Level
Token Level
Cue Level
Data
Model
Prec
Rec
F1
Prec
Rec
F1
Prec
Rec
F1
 Baseline 90.34 98.81 94.37 89.28 98.40 93.60 88.92 97.78 93.14 
Filtering 94.19 98.87 96.45 93.46 98.73 96.00 93.19 98.12 95.59 
Morante n/a n/a n/a 84.72 98.75 91.20 94.15 90.67 92.38 
Zhu n/a n/a n/a 94.35 94.99 94.67 n/a n/a n/a 
          
 Baseline 79.48 99.41 88.34 75.96 99.00 85.96 74.55 98.41 84.84 
Filtering 86.75 98.53 92.27 85.22 98.25 91.27 84.06 97.62 90.33 
Morante n/a n/a n/a 87.18 95.72 91.25 85.55 78.31 81.77 
Zhu n/a n/a n/a 87.47 90.48 88.95 n/a n/a n/a 
          
 Baseline 96.64 96.42 96.53 96.12 96.01 96.06 95.87 95.98 95.93 
Filtering 96.97 96.30 96.64 96.44 95.90 96.17 96.20 95.87 96.03 
Morante n/a n/a n/a 97.33 98.09 97.71 96.38 91.62 93.94 
Zhu n/a n/a n/a 88.54 86.81 87.67 n/a n/a n/a 
Close Modal

or Create an Account

Close Modal
Close Modal