Factual accuracy for: (i) LG, NEG, NEG-LG, W-LG, W-NEG, and W-NEG-LG strategies, (ii) varying θf = {100,200,500,1,000}, θd = 5, and (iii) nouns.
Model . | Gigaword . | DUC factacc % . | CNN/DM . | Model . | Gigaword . | DUC factacc % . | CNN/DM . |
---|---|---|---|---|---|---|---|
LG-f100-d5-n | 47.21 | 41.31 | 69.48 | W-LG-f100-d5-n | 49.82 | 38.48 | 68.55 |
LG-f200-d5-n | 43.14 | 36.01 | 67.76 | W-LG-f200-d5-n | 45.35 | 39.61 | 64.94 |
LG-f500-d5-n | 45.28 | 39.40 | 67.98 | W-LG-f500-d5-n | 45.83 | 45.07 | 66.95 |
LG-f1000-d5-n | 42.20 | 40.30 | 62.24 | W-LG-f1000-d5-n | 44.87 | 42.68 | 62.87 |
NEG-f100-n | 45.74 | 41.42 | 65.34 | W-NEG-100-d5-n | 47.18 | 36.64 | 35.55 |
NEG-f200-n | 46.39 | 37.60 | 67.12 | W-NEG-f200-n | 43.24 | 38.31 | 37.28 |
NEG-f500-n | 43.84 | 39.16 | 66.85 | W-NEG-f500-n | 42.94 | 41.25 | 54.02 |
NEG-f1000-n | 44.96 | 40.56 | 70.70 | W-NEG-f1000-n | 43.02 | 37.05 | 54.42 |
NEG-LG-f100-d5-n | 45.56 | 37.13 | 61.74 | W-NEG-LG-f100-d5-n | 45.93 | 39.70 | 37.22 |
NEG-LG-f200-d5-n | 45.66 | 40.83 | 61.73 | W-NEG-LG-f200-d5-n | 45.15 | 37.03 | 27.84 |
NEG-LG-f500-d5-n | 45.83 | 37.20 | 63.80 | W-NEG-LG-f500-d5-n | 45.32 | 35.79 | 25.47 |
NEG-LG-f1000-d5-n | 46.42 | 41.83 | 59.36 | W-NEG-LG-f1000-d5-n | 46.95 | 43.61 | 34.17 |
Baseline | 41.98 | 39.55 | 54.47 | WSD-n (baseline) | 45.70 | 48.27 | 60.75 |
Reference | 32.71 | 17.36 | 32.56 | – | – | – | – |
Model . | Gigaword . | DUC factacc % . | CNN/DM . | Model . | Gigaword . | DUC factacc % . | CNN/DM . |
---|---|---|---|---|---|---|---|
LG-f100-d5-n | 47.21 | 41.31 | 69.48 | W-LG-f100-d5-n | 49.82 | 38.48 | 68.55 |
LG-f200-d5-n | 43.14 | 36.01 | 67.76 | W-LG-f200-d5-n | 45.35 | 39.61 | 64.94 |
LG-f500-d5-n | 45.28 | 39.40 | 67.98 | W-LG-f500-d5-n | 45.83 | 45.07 | 66.95 |
LG-f1000-d5-n | 42.20 | 40.30 | 62.24 | W-LG-f1000-d5-n | 44.87 | 42.68 | 62.87 |
NEG-f100-n | 45.74 | 41.42 | 65.34 | W-NEG-100-d5-n | 47.18 | 36.64 | 35.55 |
NEG-f200-n | 46.39 | 37.60 | 67.12 | W-NEG-f200-n | 43.24 | 38.31 | 37.28 |
NEG-f500-n | 43.84 | 39.16 | 66.85 | W-NEG-f500-n | 42.94 | 41.25 | 54.02 |
NEG-f1000-n | 44.96 | 40.56 | 70.70 | W-NEG-f1000-n | 43.02 | 37.05 | 54.42 |
NEG-LG-f100-d5-n | 45.56 | 37.13 | 61.74 | W-NEG-LG-f100-d5-n | 45.93 | 39.70 | 37.22 |
NEG-LG-f200-d5-n | 45.66 | 40.83 | 61.73 | W-NEG-LG-f200-d5-n | 45.15 | 37.03 | 27.84 |
NEG-LG-f500-d5-n | 45.83 | 37.20 | 63.80 | W-NEG-LG-f500-d5-n | 45.32 | 35.79 | 25.47 |
NEG-LG-f1000-d5-n | 46.42 | 41.83 | 59.36 | W-NEG-LG-f1000-d5-n | 46.95 | 43.61 | 34.17 |
Baseline | 41.98 | 39.55 | 54.47 | WSD-n (baseline) | 45.70 | 48.27 | 60.75 |
Reference | 32.71 | 17.36 | 32.56 | – | – | – | – |