Table 1:
Composition functions from the literature. u and v are the word representations of the inputs. The results reported in Section 5 use the identity function g(x) = x instead of a nonlinearity because no improvements were observed for these models using $g=tanh$ or g = ReLU.
NameComposition function f
Addition (Mitchell and Lapata, 2010) u + v
SAddition (Mitchell and Lapata, 2010) αu + βv
BiLinear (Socher et al., 2013a,b) $g(u⊺Ev+W[u;v]+b)$
BiLinear (Socher et al., 2013a,b) $g(u⊺Ev+W[u;v]+b)$