spBLEU of Masakhane-MT. We evaluate models on translating from English to six different African languages. We compare against the M2M-124 615M parameter model.
| . | Masakhane . | M2M-124 . |
|---|---|---|
| English Yoruba | 2.04 | 2.17 |
| English Zulu | 11.85 | 3.89 |
| English Swahili | 22.09 | 26.95 |
| English Shona | 8.19 | 11.74 |
| English Nyanja | 2.19 | 12.9 |
| English Luo | 5.33 | 3.37 |
| . | Masakhane . | M2M-124 . |
|---|---|---|
| English Yoruba | 2.04 | 2.17 |
| English Zulu | 11.85 | 3.89 |
| English Swahili | 22.09 | 26.95 |
| English Shona | 8.19 | 11.74 |
| English Nyanja | 2.19 | 12.9 |
| English Luo | 5.33 | 3.37 |