Recommendation scores, proportion of identical items in top 15 words ranked from self-attention, and additive attention.
. | Seed 1 (default) . | Seed 2 . | Seed 3 . | Max Difference . | Max %Change . |
---|---|---|---|---|---|
Recall@10 | 49.51 | 48.31 | 49.79 | 1.48 | 3.06 |
MAP@10 | 23.58 | 22.95 | 23.63 | 0.68 | 2.96 |
MRR@10 | 23.58 | 22.95 | 23.63 | 0.68 | 2.96 |
nDCG@10 | 34.38 | 33.49 | 34.49 | 1 | 2.99 |
(a) Recommendation scores from DACR models initialized with three seeds | |||||
Seed 1 & Seed 2 | Seed 1 & Seed 3 | Seed 2 & Seed 3 | |||
Proportion | 73.33% | 73.33% | 100.00% | ||
(b) The proportion of identical items in top 15 words ranked from self-attention weights between the model with three seeds | |||||
Seed 1 & Seed 2 | Seed 1 & Seed 3 | Seed 2 & Seed 3 | |||
Proportion | 100% | 93.33% | 93.33% | ||
(c)The proportion of identical items in top 15 words ranked from additive attention weights between the model with three seeds |
. | Seed 1 (default) . | Seed 2 . | Seed 3 . | Max Difference . | Max %Change . |
---|---|---|---|---|---|
Recall@10 | 49.51 | 48.31 | 49.79 | 1.48 | 3.06 |
MAP@10 | 23.58 | 22.95 | 23.63 | 0.68 | 2.96 |
MRR@10 | 23.58 | 22.95 | 23.63 | 0.68 | 2.96 |
nDCG@10 | 34.38 | 33.49 | 34.49 | 1 | 2.99 |
(a) Recommendation scores from DACR models initialized with three seeds | |||||
Seed 1 & Seed 2 | Seed 1 & Seed 3 | Seed 2 & Seed 3 | |||
Proportion | 73.33% | 73.33% | 100.00% | ||
(b) The proportion of identical items in top 15 words ranked from self-attention weights between the model with three seeds | |||||
Seed 1 & Seed 2 | Seed 1 & Seed 3 | Seed 2 & Seed 3 | |||
Proportion | 100% | 93.33% | 93.33% | ||
(c)The proportion of identical items in top 15 words ranked from additive attention weights between the model with three seeds |