Exact matching accuracy of the proposed system on the Spider dev set, with the different ranges of overlap scores.
| Overlap Score . | Accuracy . | Examples . |
|---|---|---|
| 0.0 ≤ O(Q, S) ≤ 0.2 | 32.5% | 40 |
| 0.2 < O(Q, S) ≤ 0.4 | 47.3% | 74 |
| 0.4 < O(Q, S) ≤ 0.6 | 46.7% | 182 |
| 0.6 < O(Q, S) ≤ 0.8 | 67.0% | 282 |
| 0.8 < O(Q, S) ≤ 1.0 | 80.5% | 456 |
| Total | 66.6% | 1,034 |
| Overlap Score . | Accuracy . | Examples . |
|---|---|---|
| 0.0 ≤ O(Q, S) ≤ 0.2 | 32.5% | 40 |
| 0.2 < O(Q, S) ≤ 0.4 | 47.3% | 74 |
| 0.4 < O(Q, S) ≤ 0.6 | 46.7% | 182 |
| 0.6 < O(Q, S) ≤ 0.8 | 67.0% | 282 |
| 0.8 < O(Q, S) ≤ 1.0 | 80.5% | 456 |
| Total | 66.6% | 1,034 |