Skip to Main Content
Table 1

A chronicle of related work for span and dependency SRL. SA represents a syntax-aware system (no + indicates a syntax-agnostic system). F1 is the result of a single model on the official test set.

Span (CoNLL-2005)Dependency (CoNLL-2009)
Time System SA Method F1 Time System SA Method F1 
2008  Punyakanok, Roth, and Yih ILP 76.3 2009a  Zhao et al. ME 86.2 
2008  Toutanova, Haghighi, and Manning DP 79.7 2010  Björkelund et al. global 86.9 
2015  FitzGerald et al. structured 79.4  structured 87.3 
2015  Zhou and Xu  deep BiLSTM 82.8  
 2016  Roth and Lapata PathLSTM 87.7 
2017  He et al.  highway BiLSTM 83.1 2017  Marcheggiani, Frolov, and Titov  BiLSTM 87.7 
 2017  Marcheggiani and Titov GCNs 88.0 
2018  Tan et al.  self-attention 84.8 2018 He et al. (b) ELMo 89.5 
2018  Strubell et al. self-attention 83.9 2018  Cai et al.  biaffine 89.6 
2018a  He et al. (a)  ELMo 87.4 2018  Li et al. (a) ELMo 89.8 
2019b  Li et al. (b) AAAI  ELMo+biaffine 87.7  ELMo+biaffine 90.4 
Span (CoNLL-2005)Dependency (CoNLL-2009)
Time System SA Method F1 Time System SA Method F1 
2008  Punyakanok, Roth, and Yih ILP 76.3 2009a  Zhao et al. ME 86.2 
2008  Toutanova, Haghighi, and Manning DP 79.7 2010  Björkelund et al. global 86.9 
2015  FitzGerald et al. structured 79.4  structured 87.3 
2015  Zhou and Xu  deep BiLSTM 82.8  
 2016  Roth and Lapata PathLSTM 87.7 
2017  He et al.  highway BiLSTM 83.1 2017  Marcheggiani, Frolov, and Titov  BiLSTM 87.7 
 2017  Marcheggiani and Titov GCNs 88.0 
2018  Tan et al.  self-attention 84.8 2018 He et al. (b) ELMo 89.5 
2018  Strubell et al. self-attention 83.9 2018  Cai et al.  biaffine 89.6 
2018a  He et al. (a)  ELMo 87.4 2018  Li et al. (a) ELMo 89.8 
2019b  Li et al. (b) AAAI  ELMo+biaffine 87.7  ELMo+biaffine 90.4 
Close Modal

or Create an Account

Close Modal
Close Modal