Skip to Main Content
Table 2: 

Test-set retrieval quality of ColBERT-QA3 (with gains over ColBERT-QA1) at various depths.

MetricNQTQSQ
C3ΔC1C3ΔC1C3ΔC1
k = 1 52.9 +5.7 68.0 +2.6 56.0 +2.1 
k = 5 75.6 +4.2 80.7 +1.6 75.1 +2.1 
k = 10 81.4 +2.8 83.6 +1.3 79.6 +1.4 
k = 20 85.3 +2.3 85.6 +0.9 83.7 +1.6 
k = 50 88.6 +1.6 87.4 +0.5 87.7 +1.8 
k = 100 90.1 +1.1 88.4 +0.2 89.4 +1.4 
 
MRR@100 62.8 +4.8 73.7 +2.2 64.5 +2.1 
MetricNQTQSQ
C3ΔC1C3ΔC1C3ΔC1
k = 1 52.9 +5.7 68.0 +2.6 56.0 +2.1 
k = 5 75.6 +4.2 80.7 +1.6 75.1 +2.1 
k = 10 81.4 +2.8 83.6 +1.3 79.6 +1.4 
k = 20 85.3 +2.3 85.6 +0.9 83.7 +1.6 
k = 50 88.6 +1.6 87.4 +0.5 87.7 +1.8 
k = 100 90.1 +1.1 88.4 +0.2 89.4 +1.4 
 
MRR@100 62.8 +4.8 73.7 +2.2 64.5 +2.1 
Close Modal

or Create an Account

Close Modal
Close Modal