Inference speeds of various configurations of RePAQ compared to FiD models on NQ.
| Model . | Retriever . | Reranker . | Exact Match . | Q/sec . |
|---|---|---|---|---|
| FiD-large | – | – | 51.4 | 0.5 |
| FiD-base | – | – | 48.2 | 2 |
| RePAQ | base | – | 40.9 | 1400 |
| RePAQ | xlarge | – | 41.5 | 800 |
| RePAQ | base | base | 45.7 | 55 |
| RePAQ | xlarge | xxlarge | 47.6 | 6 |
| Model . | Retriever . | Reranker . | Exact Match . | Q/sec . |
|---|---|---|---|---|
| FiD-large | – | – | 51.4 | 0.5 |
| FiD-base | – | – | 48.2 | 2 |
| RePAQ | base | – | 40.9 | 1400 |
| RePAQ | xlarge | – | 41.5 | 800 |
| RePAQ | base | base | 45.7 | 55 |
| RePAQ | xlarge | xxlarge | 47.6 | 6 |