Skip to Main Content
Table 2: 

Test-set retrieval quality of ColBERT-QA3 (with gains over ColBERT-QA1) at various depths.

MetricNQTQSQ
C3ΔC1C3ΔC1C3ΔC1
k = 1 52.9 +5.7 68.0 +2.6 56.0 +2.1 
k = 5 75.6 +4.2 80.7 +1.6 75.1 +2.1 
k = 10 81.4 +2.8 83.6 +1.3 79.6 +1.4 
k = 20 85.3 +2.3 85.6 +0.9 83.7 +1.6 
k = 50 88.6 +1.6 87.4 +0.5 87.7 +1.8 
k = 100 90.1 +1.1 88.4 +0.2 89.4 +1.4 
 
MRR@100 62.8 +4.8 73.7 +2.2 64.5 +2.1 
MetricNQTQSQ
C3ΔC1C3ΔC1C3ΔC1
k = 1 52.9 +5.7 68.0 +2.6 56.0 +2.1 
k = 5 75.6 +4.2 80.7 +1.6 75.1 +2.1 
k = 10 81.4 +2.8 83.6 +1.3 79.6 +1.4 
k = 20 85.3 +2.3 85.6 +0.9 83.7 +1.6 
k = 50 88.6 +1.6 87.4 +0.5 87.7 +1.8 
k = 100 90.1 +1.1 88.4 +0.2 89.4 +1.4 
 
MRR@100 62.8 +4.8 73.7 +2.2 64.5 +2.1 
View Large
Close Modal
This Feature Is Available To Subscribers Only

or Create an Account

Close Modal
Close Modal
This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy.
Accept