MIT Press

Table 6

Fine-grained evaluation (F₁%) on German, Italian, and Dutch (test set); best result per synset shown in bold.

	DRS			𝕌DRS
	Tree	Tree-m2o	Tree-o2m	Tree	Tree-o2m
de
DRS operator	84.89	91.75	90.94	86.26	91.87
Role	72.47	84.37	82.62	73.93	83.83
Concept	69.08	81.69	78.21	—	—
Syns-Npun	79.67	88.71	86.19	—	—
Syns-Verb	41.38	63.69	58.82	—	—
Syns-Adjective	50.32	69.54	59.64	—	—
Syns-Adverb	14.29	0.00	25.00	—	—

it
DRS operator	87.28	91.20	89.54	87.82	91.20
Role	76.18	88.60	82.02	79.41	84.82
Concept	71.35	81.63	77.60	—	—
Syns-Noun	81.71	87.69	86.70	—	—
Syns-Verb	44.48	66.13	53.91	—	—
Syns-Adjective	52.35	70.16	62.11	—	—
Syns-Adverb	0.00	0.00	0.00	—	—

nl
DRS operator	79.90	92.98	89.05	82.69	93.58
Role	64.08	83.54	77.72	65.57	77.75
Concept	63.34	82.43	74.63	—	—
Syns-Noun	74.66	88.59	82.68	—	—
Syns-Verb	32.33	67.26	54.81	—	—
Syns-Adjective	41.38	64.86	50.00	—	—
Syns-Adverb	0.00	0.00	50.00	—	—

	DRS			𝕌DRS
	Tree	Tree-m2o	Tree-o2m	Tree	Tree-o2m
de
DRS operator	84.89	91.75	90.94	86.26	91.87
Role	72.47	84.37	82.62	73.93	83.83
Concept	69.08	81.69	78.21	—	—
Syns-Npun	79.67	88.71	86.19	—	—
Syns-Verb	41.38	63.69	58.82	—	—
Syns-Adjective	50.32	69.54	59.64	—	—
Syns-Adverb	14.29	0.00	25.00	—	—

it
DRS operator	87.28	91.20	89.54	87.82	91.20
Role	76.18	88.60	82.02	79.41	84.82
Concept	71.35	81.63	77.60	—	—
Syns-Noun	81.71	87.69	86.70	—	—
Syns-Verb	44.48	66.13	53.91	—	—
Syns-Adjective	52.35	70.16	62.11	—	—
Syns-Adverb	0.00	0.00	0.00	—	—

nl
DRS operator	79.90	92.98	89.05	82.69	93.58
Role	64.08	83.54	77.72	65.57	77.75
Concept	63.34	82.43	74.63	—	—
Syns-Noun	74.66	88.59	82.68	—	—
Syns-Verb	32.33	67.26	54.81	—	—
Syns-Adjective	41.38	64.86	50.00	—	—
Syns-Adverb	0.00	0.00	50.00	—	—