A comparison between different search result clustering approaches (percentages). The best results for each of the three classes of algorithms is shown in bold.
Algorithm . | Algorithm . | Web1T . | ukWaC . | ||||||
---|---|---|---|---|---|---|---|---|---|
ARI . | JI . | F1 . | #cl. . | ARI . | JI . | F1 . | # cl. . | ||
WSI-based | Curvature | 67.03 | 74.10 | 58.34 | 2.3 | 64.86 | 72.74 | 58.84 | 3.5 |
SquaT++V | 69.65 | 75.69 | 59.19 | 2.1 | 69.27 | 75.55 | 59.18 | 2.3 | |
SquaT++E | 69.88 | 75.82 | 59.39 | 2.7 | 69.84 | 75.74 | 59.70 | 3.9 | |
B-MST | 60.76 | 71.51 | 64.56 | 5.0 | 61.15 | 72.24 | 65.57 | 5.0 | |
HyperLex | 60.86 | 72.05 | 65.41 | 13.0 | 56.59 | 72.00 | 70.69 | 17.0 | |
Chinese Whispers | 67.75 | 75.37 | 64.25 | 12.5 | 68.77 | 75.45 | 59.66 | 6.5 | |
SRC systems | Lingo | −0.53 | 36.36 | 16.73 | 2.0 | −0.53 | 36.36 | 16.73 | 2.0 |
STC | −7.90 | 38.23 | 14.96 | 2.0 | −7.90 | 38.23 | 14.96 | 2.0 | |
KeySRC | 14.34 | 27.77 | 63.11 | 18.5 | 14.34 | 27.77 | 63.11 | 18.5 | |
Baselines | All-in-one | 0.00 | 47.12 | 42.40 | 1.0 | 0.00 | 47.12 | 42.40 | 1.0 |
Singleton | 0.00 | 0.00 | 68.17 | 100.0 | 0.00 | 0.00 | 68.17 | 100.0 | |
Wikipedia | 13.83 | 56.02 | 14.33 | 5.7 | 13.83 | 56.02 | 14.33 | 5.7 |
Algorithm . | Algorithm . | Web1T . | ukWaC . | ||||||
---|---|---|---|---|---|---|---|---|---|
ARI . | JI . | F1 . | #cl. . | ARI . | JI . | F1 . | # cl. . | ||
WSI-based | Curvature | 67.03 | 74.10 | 58.34 | 2.3 | 64.86 | 72.74 | 58.84 | 3.5 |
SquaT++V | 69.65 | 75.69 | 59.19 | 2.1 | 69.27 | 75.55 | 59.18 | 2.3 | |
SquaT++E | 69.88 | 75.82 | 59.39 | 2.7 | 69.84 | 75.74 | 59.70 | 3.9 | |
B-MST | 60.76 | 71.51 | 64.56 | 5.0 | 61.15 | 72.24 | 65.57 | 5.0 | |
HyperLex | 60.86 | 72.05 | 65.41 | 13.0 | 56.59 | 72.00 | 70.69 | 17.0 | |
Chinese Whispers | 67.75 | 75.37 | 64.25 | 12.5 | 68.77 | 75.45 | 59.66 | 6.5 | |
SRC systems | Lingo | −0.53 | 36.36 | 16.73 | 2.0 | −0.53 | 36.36 | 16.73 | 2.0 |
STC | −7.90 | 38.23 | 14.96 | 2.0 | −7.90 | 38.23 | 14.96 | 2.0 | |
KeySRC | 14.34 | 27.77 | 63.11 | 18.5 | 14.34 | 27.77 | 63.11 | 18.5 | |
Baselines | All-in-one | 0.00 | 47.12 | 42.40 | 1.0 | 0.00 | 47.12 | 42.40 | 1.0 |
Singleton | 0.00 | 0.00 | 68.17 | 100.0 | 0.00 | 0.00 | 68.17 | 100.0 | |
Wikipedia | 13.83 | 56.02 | 14.33 | 5.7 | 13.83 | 56.02 | 14.33 | 5.7 |