Ablations for residuals and feature concatenation on TyDi QA. Rows are cumulative (each row contains all changes from the previous).
| Model . | SelectP . | MinSpan . |
|---|---|---|
| Canine-C | 65.7 | 53.0 |
| No concatenation | 17.2 | 35.6 |
| +Final-to-initial resid. | 17.3 | 35.9 |
| +Final-to-downsampled resid. | 62.0 | 50.2 |
| Model . | SelectP . | MinSpan . |
|---|---|---|
| Canine-C | 65.7 | 53.0 |
| No concatenation | 17.2 | 35.6 |
| +Final-to-initial resid. | 17.3 | 35.9 |
| +Final-to-downsampled resid. | 62.0 | 50.2 |