Evaluation results on WikiSQL benchmark with other state-of-the-art systems.
| System . | Dev LF . | Dev X . | Test LF . | TestX . |
|---|---|---|---|---|
| SQLova (Hwang et al. 2019) | 81.6 % | 87.2 % | 80.7 % | 86.2 % |
| X-SQL (He et al. 2018) | 83.8 % | 89.5 % | 83.3 % | 88.7 % |
| Guo and Gao (2019) | 84.3 % | 90.3 % | 83.7 % | 89.2 % |
| HydraNet (Lyu et al. 2020) | 83.6 % | 89.1 % | 83.8 % | 89.2% |
| RYANSQL + BERT | 81.6 % | 87.7 % | 81.3 % | 87.0 % |
| System . | Dev LF . | Dev X . | Test LF . | TestX . |
|---|---|---|---|---|
| SQLova (Hwang et al. 2019) | 81.6 % | 87.2 % | 80.7 % | 86.2 % |
| X-SQL (He et al. 2018) | 83.8 % | 89.5 % | 83.3 % | 88.7 % |
| Guo and Gao (2019) | 84.3 % | 90.3 % | 83.7 % | 89.2 % |
| HydraNet (Lyu et al. 2020) | 83.6 % | 89.1 % | 83.8 % | 89.2% |
| RYANSQL + BERT | 81.6 % | 87.7 % | 81.3 % | 87.0 % |