Results with Sep +Coop and Joint +Coop reranking the top-k candidates. Bold numbers indicate which k value resulted in the highest score for each separate model.
| Model . | k . | Image Retrieval . | Text Retrieval . | Image Retrieval . | Text Retrieval . | Image Retrieval . | Text Retrieval . | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | ||
| MSCOCO 1k . | MSCOCO 5k . | Flickr30k . | |||||||||||||||||
| Sep+Coop | 10 | 75.4 | 94.8 | 97.2 | 88.4 | 98.8 | 99.7 | 53.2 | 80.3 | 86.6 | 71.1 | 90.9 | 94.3 | 75.9 | 92.2 | 93.4 | 89.2 | 97.8 | 98.4 |
| 20 | 75.3 | 95.2 | 98.1 | 87.9 | 98.9 | 99.8 | 52.8 | 80.5 | 88.5 | 70.2 | 91.6 | 95.0 | 76.0 | 93.0 | 95.0 | 88.7 | 98.3 | 99.2 | |
| 50 | 75.2 | 95.0 | 98.2 | 87.9 | 99.1 | 99.8 | 52.6 | 80.1 | 88.4 | 70.1 | 91.4 | 95.5 | 75.9 | 93.4 | 96.3 | 88.9 | 98.4 | 99.4 | |
| Joint+Coop | 10 | 75.4 | 95.5 | 97.8 | 88.0 | 98.8 | 99.9 | 54.8 | 81.2 | 88.0 | 70.9 | 91.2 | 95.0 | 76.5 | 93.2 | 95.0 | 88.9 | 97.3 | 98.6 |
| 20 | 75.5 | 95.4 | 98.2 | 88.1 | 98.6 | 99.5 | 54.7 | 81.3 | 88.9 | 70.8 | 91.0 | 95.2 | 76.4 | 93.6 | 96.2 | 89.4 | 97.7 | 99.0 | |
| 50 | 75.4 | 95.4 | 98.3 | 88.2 | 98.4 | 99.4 | 54.6 | 81.2 | 88.8 | 70.7 | 91.1 | 95.3 | 76.5 | 93.5 | 96.5 | 89.1 | 98.0 | 98.9 | |
| Model . | k . | Image Retrieval . | Text Retrieval . | Image Retrieval . | Text Retrieval . | Image Retrieval . | Text Retrieval . | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | R@1 . | R@5 . | R@10 . | ||
| MSCOCO 1k . | MSCOCO 5k . | Flickr30k . | |||||||||||||||||
| Sep+Coop | 10 | 75.4 | 94.8 | 97.2 | 88.4 | 98.8 | 99.7 | 53.2 | 80.3 | 86.6 | 71.1 | 90.9 | 94.3 | 75.9 | 92.2 | 93.4 | 89.2 | 97.8 | 98.4 |
| 20 | 75.3 | 95.2 | 98.1 | 87.9 | 98.9 | 99.8 | 52.8 | 80.5 | 88.5 | 70.2 | 91.6 | 95.0 | 76.0 | 93.0 | 95.0 | 88.7 | 98.3 | 99.2 | |
| 50 | 75.2 | 95.0 | 98.2 | 87.9 | 99.1 | 99.8 | 52.6 | 80.1 | 88.4 | 70.1 | 91.4 | 95.5 | 75.9 | 93.4 | 96.3 | 88.9 | 98.4 | 99.4 | |
| Joint+Coop | 10 | 75.4 | 95.5 | 97.8 | 88.0 | 98.8 | 99.9 | 54.8 | 81.2 | 88.0 | 70.9 | 91.2 | 95.0 | 76.5 | 93.2 | 95.0 | 88.9 | 97.3 | 98.6 |
| 20 | 75.5 | 95.4 | 98.2 | 88.1 | 98.6 | 99.5 | 54.7 | 81.3 | 88.9 | 70.8 | 91.0 | 95.2 | 76.4 | 93.6 | 96.2 | 89.4 | 97.7 | 99.0 | |
| 50 | 75.4 | 95.4 | 98.3 | 88.2 | 98.4 | 99.4 | 54.6 | 81.2 | 88.8 | 70.7 | 91.1 | 95.3 | 76.5 | 93.5 | 96.5 | 89.1 | 98.0 | 98.9 | |