MIT Press

Skip to Main Content

Table 1

A chronicle of related work for span and dependency SRL. SA represents a syntax-aware system (no + indicates a syntax-agnostic system). F₁ is the result of a single model on the official test set.

Span (CoNLL-2005)					Dependency (CoNLL-2009)
Time	System	SA	Method	F₁	Time	System	SA	Method	F₁
2008	Punyakanok, Roth, and Yih	+	ILP	76.3	2009a	Zhao et al.	+	ME	86.2
2008	Toutanova, Haghighi, and Manning	+	DP	79.7	2010	Björkelund et al.	+	global	86.9
2015	FitzGerald et al.	+	structured	79.4			+	structured	87.3
2015	Zhou and Xu		deep BiLSTM	82.8
					2016	Roth and Lapata	+	PathLSTM	87.7
2017	He et al.		highway BiLSTM	83.1	2017	Marcheggiani, Frolov, and Titov		BiLSTM	87.7
					2017	Marcheggiani and Titov	+	GCNs	88.0
2018	Tan et al.		self-attention	84.8	2018	He et al. (b)	+	ELMo	89.5
2018	Strubell et al.	+	self-attention	83.9	2018	Cai et al.		biaffine	89.6
2018a	He et al. (a)		ELMo	87.4	2018	Li et al. (a)	+	ELMo	89.8
2019b	Li et al. (b) AAAI		ELMo+biaffine	87.7			ELMo+biaffine	90.4

Span (CoNLL-2005)					Dependency (CoNLL-2009)
Time	System	SA	Method	F₁	Time	System	SA	Method	F₁
2008	Punyakanok, Roth, and Yih	+	ILP	76.3	2009a	Zhao et al.	+	ME	86.2
2008	Toutanova, Haghighi, and Manning	+	DP	79.7	2010	Björkelund et al.	+	global	86.9
2015	FitzGerald et al.	+	structured	79.4			+	structured	87.3
2015	Zhou and Xu		deep BiLSTM	82.8
					2016	Roth and Lapata	+	PathLSTM	87.7
2017	He et al.		highway BiLSTM	83.1	2017	Marcheggiani, Frolov, and Titov		BiLSTM	87.7
					2017	Marcheggiani and Titov	+	GCNs	88.0
2018	Tan et al.		self-attention	84.8	2018	He et al. (b)	+	ELMo	89.5
2018	Strubell et al.	+	self-attention	83.9	2018	Cai et al.		biaffine	89.6
2018a	He et al. (a)		ELMo	87.4	2018	Li et al. (a)	+	ELMo	89.8
2019b	Li et al. (b) AAAI		ELMo+biaffine	87.7			ELMo+biaffine	90.4