Citation recommendation results (** 0.01 significance level and * 0.05 significance level for paired t test against the best baseline scores for a case).
Model . | DBLP . | ACL . | ||||||
---|---|---|---|---|---|---|---|---|
Recall@10 . | MAP@10 . | MRR@10 . | nDCG@10 . | Recall@10 . | MAP@10 . | MRR@10 . | nDCG@10 . | |
W2V (case 1) | 20.47 | 10.54 | 10.54 | 14.71 | 27.25 | 13.74 | 13.74 | 19.51 |
W2V (case 2) | 20.46 | 10.55 | 10.55 | 14.71 | 26.54 | 13.55 | 13.55 | 19.19 |
W2V (case 3) | 20.15 | 10.40 | 10.40 | 14.49 | 26.06 | 13.21 | 13.21 | 18.66 |
D2V-nc (case 1) | 7.90 | 3.17 | 3.17 | 4.96 | 19.92 | 9.06 | 9.06 | 13.39 |
D2V-nc (case 2) | 7.90 | 3.17 | 3.17 | 4.96 | 19.89 | 9.06 | 9.06 | 13.38 |
D2V-nc (case 3) | 7.91 | 3.17 | 3.17 | 4.97 | 19.89 | 9.07 | 9.07 | 13.38 |
D2V-cac (case 1) | 7.91 | 3.17 | 3.17 | 4.97 | 20.51 | 9.24 | 9.24 | 13.68 |
D2V-cac (case 2) | 7.90 | 3.17 | 3.17 | 4.97 | 20.29 | 9.17 | 9.17 | 13.58 |
D2V-cac (case 3) | 7.89 | 3.17 | 3.17 | 4.97 | 20.51 | 9.24 | 9.24 | 13.69 |
HD2V (case 1) | 28.41 | 14.20 | 14.20 | 20.37 | 37.53 | 19.64 | 19.64 | 27.20 |
HD2V (case 2) | 28.42 | 14.20 | 14.20 | 20.38 | 36.83 | 19.62 | 19.62 | 27.18 |
HD2V (case 3) | 28.41 | 14.20 | 14.20 | 20.37 | 36.24 | 19.32 | 19.32 | 26.79 |
DC2V (case 1) | 44.23 | 21.80 | 21.80 | 31.34 | 36.89 | 20.44 | 20.44 | 27.72 |
DC2V (case 2) | 40.31 | 20.16 | 20.16 | 28.69 | 33.71 | 18.47 | 18.47 | 25.17 |
DC2V (case 3) | 40.37 | 19.02 | 19.02 | 26.84 | 31.14 | 16.97 | 16.97 | 23.20 |
SciBERT (case 1) | 4.63 | 2.13 | 2.13 | 2.71 | 0.01 | 0.02 | 0.01 | 0.03 |
SciBERT (case 2) | 4.63 | 2.13 | 2.13 | 2.71 | 0.05 | 0.13 | 0.05 | 0.19 |
SciBERT (case 3) | 4.70 | 2.17 | 2.17 | 2.76 | 0.01 | 0.02 | 0.01 | 0.03 |
DACRD2V (case 1) | 1.04 | 0.40 | 0.40 | 5.50 | 6.42 | 2.43 | 2.43 | 3.35 |
DACRD2V (case 2) | 1.04 | 0.40 | 0.40 | 5.50 | 6.64 | 2.43 | 2.43 | 3.36 |
DACRD2V (case 3) | 1.04 | 0.40 | 0.40 | 5.50 | 6.64 | 2.43 | 2.43 | 3.36 |
DACRDC2V (case 1) | 49.51* | 23.58* | 23.58* | 34.38* | 42.43* * | 22.92* * | 22.92* * | 31.64* * |
DACRDC2V (case 2) | 45.39* * | 22.32* * | 22.32* * | 31.98* * | 40.13* * | 21.93* * | 21.93* * | 30.04* * |
DACRDC2V (case 3) | 42.32* * | 21.39* * | 21.39* * | 30.22* * | 38.01* * | 20.84* * | 20.84* * | 28.45* * |
Model . | DBLP . | ACL . | ||||||
---|---|---|---|---|---|---|---|---|
Recall@10 . | MAP@10 . | MRR@10 . | nDCG@10 . | Recall@10 . | MAP@10 . | MRR@10 . | nDCG@10 . | |
W2V (case 1) | 20.47 | 10.54 | 10.54 | 14.71 | 27.25 | 13.74 | 13.74 | 19.51 |
W2V (case 2) | 20.46 | 10.55 | 10.55 | 14.71 | 26.54 | 13.55 | 13.55 | 19.19 |
W2V (case 3) | 20.15 | 10.40 | 10.40 | 14.49 | 26.06 | 13.21 | 13.21 | 18.66 |
D2V-nc (case 1) | 7.90 | 3.17 | 3.17 | 4.96 | 19.92 | 9.06 | 9.06 | 13.39 |
D2V-nc (case 2) | 7.90 | 3.17 | 3.17 | 4.96 | 19.89 | 9.06 | 9.06 | 13.38 |
D2V-nc (case 3) | 7.91 | 3.17 | 3.17 | 4.97 | 19.89 | 9.07 | 9.07 | 13.38 |
D2V-cac (case 1) | 7.91 | 3.17 | 3.17 | 4.97 | 20.51 | 9.24 | 9.24 | 13.68 |
D2V-cac (case 2) | 7.90 | 3.17 | 3.17 | 4.97 | 20.29 | 9.17 | 9.17 | 13.58 |
D2V-cac (case 3) | 7.89 | 3.17 | 3.17 | 4.97 | 20.51 | 9.24 | 9.24 | 13.69 |
HD2V (case 1) | 28.41 | 14.20 | 14.20 | 20.37 | 37.53 | 19.64 | 19.64 | 27.20 |
HD2V (case 2) | 28.42 | 14.20 | 14.20 | 20.38 | 36.83 | 19.62 | 19.62 | 27.18 |
HD2V (case 3) | 28.41 | 14.20 | 14.20 | 20.37 | 36.24 | 19.32 | 19.32 | 26.79 |
DC2V (case 1) | 44.23 | 21.80 | 21.80 | 31.34 | 36.89 | 20.44 | 20.44 | 27.72 |
DC2V (case 2) | 40.31 | 20.16 | 20.16 | 28.69 | 33.71 | 18.47 | 18.47 | 25.17 |
DC2V (case 3) | 40.37 | 19.02 | 19.02 | 26.84 | 31.14 | 16.97 | 16.97 | 23.20 |
SciBERT (case 1) | 4.63 | 2.13 | 2.13 | 2.71 | 0.01 | 0.02 | 0.01 | 0.03 |
SciBERT (case 2) | 4.63 | 2.13 | 2.13 | 2.71 | 0.05 | 0.13 | 0.05 | 0.19 |
SciBERT (case 3) | 4.70 | 2.17 | 2.17 | 2.76 | 0.01 | 0.02 | 0.01 | 0.03 |
DACRD2V (case 1) | 1.04 | 0.40 | 0.40 | 5.50 | 6.42 | 2.43 | 2.43 | 3.35 |
DACRD2V (case 2) | 1.04 | 0.40 | 0.40 | 5.50 | 6.64 | 2.43 | 2.43 | 3.36 |
DACRD2V (case 3) | 1.04 | 0.40 | 0.40 | 5.50 | 6.64 | 2.43 | 2.43 | 3.36 |
DACRDC2V (case 1) | 49.51* | 23.58* | 23.58* | 34.38* | 42.43* * | 22.92* * | 22.92* * | 31.64* * |
DACRDC2V (case 2) | 45.39* * | 22.32* * | 22.32* * | 31.98* * | 40.13* * | 21.93* * | 21.93* * | 30.04* * |
DACRDC2V (case 3) | 42.32* * | 21.39* * | 21.39* * | 30.22* * | 38.01* * | 20.84* * | 20.84* * | 28.45* * |