Transfer learning result (i.e., F1-score). Three tags: PER, ORG, & LOC. WikiAnn, eng-CoNLL, and the annotated datasets are trained for 50 epochs. Fine-tuning is only for 10 epochs. Results are averaged over 5 runs and the total average (avg) is computed over ibo, kin, lug, luo, wol, and yor languages. The overall highest F1-score is in bold, and the best F1-score in zero-shot settings is indicated with an asterisk (*).
| Method . | amh . | hau . | ibo . | kin . | lug . | luo . | pcm . | swa . | wol . | yor . | avg . |
|---|---|---|---|---|---|---|---|---|---|---|---|
| XLM-R-base | 69.71 | 91.03 | 86.16 | 73.76 | 80.51 | 75.81 | 86.87 | 88.65 | 69.56 | 78.05 | 77.30 |
| WikiAnn zero-shot | 27.68 | – | 21.90 | 9.56 | – | – | – | 36.91 | – | 10.42 | – |
| eng-CoNLL zero-shot | – | 67.52 | 47.71 | 38.17 | 39.45 | 34.19 | 67.27 | 76.40 | 24.33 | 39.04 | 37.15 |
| pcm zero-shot | – | 63.71 | 42.69 | 40.99 | 43.50 | 33.12 | – | 72.84 | 25.37 | 35.16 | 36.81 |
| swa zero-shot | – | 85.35* | 55.37 | 58.44 | 57.65* | 42.88* | 72.87* | – | 41.70 | 57.87* | 52.32 |
| hau zero-shot | – | – | 58.41* | 59.10* | 59.78 | 42.81 | 70.74 | 83.19* | 42.81* | 55.97 | 53.14* |
| WikiAnn + finetune | 70.92 | – | 85.24 | 72.84 | – | – | – | 87.90 | – | 76.78 | – |
| eng-CoNLL + finetune | – | 89.73 | 85.10 | 71.55 | 77.34 | 73.92 | 84.05 | 87.59 | 68.11 | 75.77 | 75.30 |
| pcm + finetune | – | 90.78 | 86.42 | 71.69 | 79.72 | 75.56 | – | 87.62 | 67.21 | 78.29 | 76.48 |
| swa + finetune | – | 91.50 | 87.11 | 74.84 | 80.21 | 74.49 | 86.74 | – | 68.47 | 80.68 | 77.63 |
| hau + finetune | – | – | 86.84 | 74.22 | 80.56 | 75.55 | 88.03 | 87.92 | 70.20 | 79.44 | 77.80 |
| combined East Langs. | – | – | – | 75.65 | 81.10 | 77.56 | – | 88.15 | – | – | – |
| combined West Langs. | – | 90.88 | 87.06 | – | – | – | 87.21 | – | 69.70 | 80.68 | – |
| combined 9 Langs. | – | 91.64 | 87.94 | 75.46 | 81.29 | 78.12 | 88.12 | 88.10 | 69.84 | 80.59 | 78.87 |
| Method . | amh . | hau . | ibo . | kin . | lug . | luo . | pcm . | swa . | wol . | yor . | avg . |
|---|---|---|---|---|---|---|---|---|---|---|---|
| XLM-R-base | 69.71 | 91.03 | 86.16 | 73.76 | 80.51 | 75.81 | 86.87 | 88.65 | 69.56 | 78.05 | 77.30 |
| WikiAnn zero-shot | 27.68 | – | 21.90 | 9.56 | – | – | – | 36.91 | – | 10.42 | – |
| eng-CoNLL zero-shot | – | 67.52 | 47.71 | 38.17 | 39.45 | 34.19 | 67.27 | 76.40 | 24.33 | 39.04 | 37.15 |
| pcm zero-shot | – | 63.71 | 42.69 | 40.99 | 43.50 | 33.12 | – | 72.84 | 25.37 | 35.16 | 36.81 |
| swa zero-shot | – | 85.35* | 55.37 | 58.44 | 57.65* | 42.88* | 72.87* | – | 41.70 | 57.87* | 52.32 |
| hau zero-shot | – | – | 58.41* | 59.10* | 59.78 | 42.81 | 70.74 | 83.19* | 42.81* | 55.97 | 53.14* |
| WikiAnn + finetune | 70.92 | – | 85.24 | 72.84 | – | – | – | 87.90 | – | 76.78 | – |
| eng-CoNLL + finetune | – | 89.73 | 85.10 | 71.55 | 77.34 | 73.92 | 84.05 | 87.59 | 68.11 | 75.77 | 75.30 |
| pcm + finetune | – | 90.78 | 86.42 | 71.69 | 79.72 | 75.56 | – | 87.62 | 67.21 | 78.29 | 76.48 |
| swa + finetune | – | 91.50 | 87.11 | 74.84 | 80.21 | 74.49 | 86.74 | – | 68.47 | 80.68 | 77.63 |
| hau + finetune | – | – | 86.84 | 74.22 | 80.56 | 75.55 | 88.03 | 87.92 | 70.20 | 79.44 | 77.80 |
| combined East Langs. | – | – | – | 75.65 | 81.10 | 77.56 | – | 88.15 | – | – | – |
| combined West Langs. | – | 90.88 | 87.06 | – | – | – | 87.21 | – | 69.70 | 80.68 | – |
| combined 9 Langs. | – | 91.64 | 87.94 | 75.46 | 81.29 | 78.12 | 88.12 | 88.10 | 69.84 | 80.59 | 78.87 |