Skip to Main Content
Table 13: 

Audit results for a sample of 100 sentences from ParaCrawl for each language pair, compared to the number of sentences available in the dataset. Language codes are as originally published. The length is measured in number of characters and averaged across the audited portion of each corpus.

CCCCSCBXWLNLporn# sentencesavg target length
en-so 80.81% 61.62% 1.01% 18.18% 14.14% 5.05% 0.00% 0.00% 14879 189.83 
en-ps 72.00% 53.00% 9.00% 10.00% 17.00% 10.00% 0.00% 0.00% 26321 141.01 
en-my 45.00% 9.00% 16.00% 20.00% 32.00% 9.00% 14.00% 0.00% 31374 147.07 
en-km 76.00% 51.00% 13.00% 12.00% 18.00% 6.00% 0.00% 0.00% 65113 121.20 
en-ne 73.00% 48.00% 1.00% 24.00% 23.00% 2.00% 0.00% 0.00% 92084 153.42 
en-sw 85.00% 60.00% 15.00% 10.00% 11.00% 2.00% 2.00% 0.00% 132517 167.34 
en-si 37.00% 31.00% 6.00% 0.00% 62.00% 0.00% 1.00% 0.00% 217407 123.06 
en-nn 35.92% 24.27% 8.74% 2.91% 49.51% 13.59% 0.97% 0.00% 323519 56.24 
es-eu 88.00% 66.00% 15.00% 7.00% 10.00% 1.00% 1.00% 0.00% 514610 121.31 
es-gl 89.00% 46.00% 6.00% 37.00% 4.00% 7.00% 0.00% 0.00% 1222837 107.88 
en-ru 81.00% 73.00% 6.00% 2.00% 19.00% 0.00% 0.00% 6.00% 5377911 101.28 
en-bg 95.15% 85.44% 0.97% 8.74% 4.85% 0.00% 0.00% 0.97% 6470710 112.29 
es-ca 80.00% 54.00% 19.00% 7.00% 11.00% 9.00% 0.00% 5.00% 6870183 107.21 
en-el 91.59% 68.22% 0.93% 22.43% 7.48% 0.93% 0.00% 0.00% 9402646 135.66 
en-pl 94.12% 76.47% 0.98% 16.67% 3.92% 1.96% 0.00% 0.98% 13744860 95.95 
en-nl 49.00% 32.00% 17.00% 0.00% 46.00% 3.00% 2.00% 0.00% 31295016 95.05 
en-pt 93.07% 92.08% 0.00% 0.99% 4.95% 1.98% 0.00% 0.00% 31486963 108.68 
en-it 60.82% 36.08% 16.49% 8.25% 38.14% 0.00% 1.03% 0.00% 40798278 127.55 
en-es 87.00% 54.00% 20.00% 13.00% 12.00% 0.00% 1.00% 0.50% 78662122 119.72 
en-de 82.83% 64.65% 13.13% 5.05% 13.13% 3.03% 1.01% 0.00% 82638202 111.43 
en-fr 89.62% 82.08% 4.72% 2.83% 10.38% 0.00% 0.00% 0.00% 104351522 144.20 
CCCCSCBXWLNLporn# sentencesavg target length
en-so 80.81% 61.62% 1.01% 18.18% 14.14% 5.05% 0.00% 0.00% 14879 189.83 
en-ps 72.00% 53.00% 9.00% 10.00% 17.00% 10.00% 0.00% 0.00% 26321 141.01 
en-my 45.00% 9.00% 16.00% 20.00% 32.00% 9.00% 14.00% 0.00% 31374 147.07 
en-km 76.00% 51.00% 13.00% 12.00% 18.00% 6.00% 0.00% 0.00% 65113 121.20 
en-ne 73.00% 48.00% 1.00% 24.00% 23.00% 2.00% 0.00% 0.00% 92084 153.42 
en-sw 85.00% 60.00% 15.00% 10.00% 11.00% 2.00% 2.00% 0.00% 132517 167.34 
en-si 37.00% 31.00% 6.00% 0.00% 62.00% 0.00% 1.00% 0.00% 217407 123.06 
en-nn 35.92% 24.27% 8.74% 2.91% 49.51% 13.59% 0.97% 0.00% 323519 56.24 
es-eu 88.00% 66.00% 15.00% 7.00% 10.00% 1.00% 1.00% 0.00% 514610 121.31 
es-gl 89.00% 46.00% 6.00% 37.00% 4.00% 7.00% 0.00% 0.00% 1222837 107.88 
en-ru 81.00% 73.00% 6.00% 2.00% 19.00% 0.00% 0.00% 6.00% 5377911 101.28 
en-bg 95.15% 85.44% 0.97% 8.74% 4.85% 0.00% 0.00% 0.97% 6470710 112.29 
es-ca 80.00% 54.00% 19.00% 7.00% 11.00% 9.00% 0.00% 5.00% 6870183 107.21 
en-el 91.59% 68.22% 0.93% 22.43% 7.48% 0.93% 0.00% 0.00% 9402646 135.66 
en-pl 94.12% 76.47% 0.98% 16.67% 3.92% 1.96% 0.00% 0.98% 13744860 95.95 
en-nl 49.00% 32.00% 17.00% 0.00% 46.00% 3.00% 2.00% 0.00% 31295016 95.05 
en-pt 93.07% 92.08% 0.00% 0.99% 4.95% 1.98% 0.00% 0.00% 31486963 108.68 
en-it 60.82% 36.08% 16.49% 8.25% 38.14% 0.00% 1.03% 0.00% 40798278 127.55 
en-es 87.00% 54.00% 20.00% 13.00% 12.00% 0.00% 1.00% 0.50% 78662122 119.72 
en-de 82.83% 64.65% 13.13% 5.05% 13.13% 3.03% 1.01% 0.00% 82638202 111.43 
en-fr 89.62% 82.08% 4.72% 2.83% 10.38% 0.00% 0.00% 0.00% 104351522 144.20 
Close Modal

or Create an Account

Close Modal
Close Modal