Results of graph-based WSI algorithms with Web1T and ukWaC and various similarity measures (Word Overlap, Degree Overlap, and Token Overlap). The reported measures are Adjusted Rand Index (ARI), Jaccard Index (JI), and F1 (percentages). We also show the average number of clusters per query produced by each algorithm.
| Algorithm . | Sim. . | Web1T . | ukWaC . | ||||||
|---|---|---|---|---|---|---|---|---|---|
| ARI . | JI . | F1 . | # cl. . | ARI . | JI . | F1 . | # cl. . | ||
| Curvature | WO | 67.03 | 74.10 | 58.34 | 2.3 | 64.86 | 72.74 | 58.84 | 3.5 |
| DO | 66.88 | 73.76 | 58.67 | 2.3 | 64.02 | 71.04 | 59.85 | 3.5 | |
| TO | 67.14 | 74.04 | 58.36 | 2.3 | 65.03 | 72.46 | 58.73 | 3.5 | |
| SquaT++V | WO | 69.65 | 75.69 | 59.19 | 2.1 | 69.27 | 75.55 | 59.18 | 2.3 |
| DO | 69.21 | 75.45 | 59.19 | 2.1 | 68.73 | 75.14 | 59.75 | 2.3 | |
| TO | 69.67 | 75.69 | 59.19 | 2.1 | 69.33 | 75.55 | 59.23 | 2.3 | |
| SquaT++E | WO | 69.88 | 75.82 | 59.39 | 2.7 | 69.84 | 75.74 | 59.70 | 3.9 |
| DO | 69.63 | 75.74 | 60.99 | 2.7 | 69.86 | 75.35 | 63.00 | 3.9 | |
| TO | 69.88 | 75.83 | 59.40 | 2.7 | 69.86 | 75.70 | 59.78 | 3.9 | |
| B-MST | WO | 60.76 | 71.51 | 64.56 | 5.0 | 61.15 | 72.24 | 65.57 | 5.0 |
| DO | 66.48 | 69.37 | 64.84 | 5.0 | 67.60 | 70.02 | 67.41 | 5.0 | |
| TO | 63.17 | 71.21 | 64.04 | 5.0 | 64.18 | 71.93 | 65.46 | 5.0 | |
| HyperLex | WO | 60.86 | 72.05 | 65.41 | 13.0 | 56.59 | 72.00 | 70.69 | 17.0 |
| DO | 66.27 | 68.00 | 71.91 | 13.0 | 65.92 | 67.31 | 76.88 | 17.0 | |
| TO | 62.82 | 70.87 | 65.08 | 13.0 | 61.64 | 70.61 | 70.42 | 17.0 | |
| Chinese Whispers | WO | 67.75 | 75.37 | 60.25 | 12.5 | 68.77 | 75.45 | 59.66 | 6.5 |
| DO | 65.95 | 69.49 | 70.33 | 12.5 | 67.86 | 72.34 | 66.16 | 6.5 | |
| TO | 67.57 | 74.69 | 60.50 | 12.5 | 68.97 | 75.28 | 59.79 | 6.5 | |
| Algorithm . | Sim. . | Web1T . | ukWaC . | ||||||
|---|---|---|---|---|---|---|---|---|---|
| ARI . | JI . | F1 . | # cl. . | ARI . | JI . | F1 . | # cl. . | ||
| Curvature | WO | 67.03 | 74.10 | 58.34 | 2.3 | 64.86 | 72.74 | 58.84 | 3.5 |
| DO | 66.88 | 73.76 | 58.67 | 2.3 | 64.02 | 71.04 | 59.85 | 3.5 | |
| TO | 67.14 | 74.04 | 58.36 | 2.3 | 65.03 | 72.46 | 58.73 | 3.5 | |
| SquaT++V | WO | 69.65 | 75.69 | 59.19 | 2.1 | 69.27 | 75.55 | 59.18 | 2.3 |
| DO | 69.21 | 75.45 | 59.19 | 2.1 | 68.73 | 75.14 | 59.75 | 2.3 | |
| TO | 69.67 | 75.69 | 59.19 | 2.1 | 69.33 | 75.55 | 59.23 | 2.3 | |
| SquaT++E | WO | 69.88 | 75.82 | 59.39 | 2.7 | 69.84 | 75.74 | 59.70 | 3.9 |
| DO | 69.63 | 75.74 | 60.99 | 2.7 | 69.86 | 75.35 | 63.00 | 3.9 | |
| TO | 69.88 | 75.83 | 59.40 | 2.7 | 69.86 | 75.70 | 59.78 | 3.9 | |
| B-MST | WO | 60.76 | 71.51 | 64.56 | 5.0 | 61.15 | 72.24 | 65.57 | 5.0 |
| DO | 66.48 | 69.37 | 64.84 | 5.0 | 67.60 | 70.02 | 67.41 | 5.0 | |
| TO | 63.17 | 71.21 | 64.04 | 5.0 | 64.18 | 71.93 | 65.46 | 5.0 | |
| HyperLex | WO | 60.86 | 72.05 | 65.41 | 13.0 | 56.59 | 72.00 | 70.69 | 17.0 |
| DO | 66.27 | 68.00 | 71.91 | 13.0 | 65.92 | 67.31 | 76.88 | 17.0 | |
| TO | 62.82 | 70.87 | 65.08 | 13.0 | 61.64 | 70.61 | 70.42 | 17.0 | |
| Chinese Whispers | WO | 67.75 | 75.37 | 60.25 | 12.5 | 68.77 | 75.45 | 59.66 | 6.5 |
| DO | 65.95 | 69.49 | 70.33 | 12.5 | 67.86 | 72.34 | 66.16 | 6.5 | |
| TO | 67.57 | 74.69 | 60.50 | 12.5 | 68.97 | 75.28 | 59.79 | 6.5 | |