Test results for all models on C levr and C losure. † stands for models trained with gold programs, ‡ for oracle models evaluated using gold programs, and ∓ for deterministically executed models that depend on domain-knowledge for execution (execution is not learned).
| . | C levr . | C losure . |
|---|---|---|
| MAC | 98.5 | 72.4 |
| FiLM | 97.0 | 60.1 |
| GLT (our model) | 99.1 | 96.1 ± 2.5 |
| NS-VQA †∓ | 100 | 77.2 |
| PG+EE (18K prog.) † | 95.4 | – |
| PG-Vector-NMN † | 98.0 | 71.3 |
| GT-Vector-NMN †‡ | 98.0 | 94.4 |
| . | C levr . | C losure . |
|---|---|---|
| MAC | 98.5 | 72.4 |
| FiLM | 97.0 | 60.1 |
| GLT (our model) | 99.1 | 96.1 ± 2.5 |
| NS-VQA †∓ | 100 | 77.2 |
| PG+EE (18K prog.) † | 95.4 | – |
| PG-Vector-NMN † | 98.0 | 71.3 |
| GT-Vector-NMN †‡ | 98.0 | 94.4 |