MIT Press

Table 3

Pearson correlation coefficients between manually assigned readability labels and the readability scores assigned by different readability measures in the unsupervised setting. The highest correlation for each corpus is marked with bold typeface.

Measure/Data set	WeeBit	OneStopEnglish	Newsela	Slovenian SB
RLM perplexity-balanced	−0.082	0.405	0.512	0.303
RLM perplexity-simple	−0.115	0.420	0.470	/
RLM perplexity-normal	−0.127	0.283	0.341	/
TCN perplexity-balanced	0.034	0.476	0.537	0.173
TCN perplexity-simple	0.025	0.518	0.566	/
TCN perplexity-normal	−0.015	0.303	0.250	/
BERT perplexity	−0.123	−0.162	−0.673	−0.563

RLM RSRS-balanced	0.497	0.551	0.890	0.732
RLM RSRS-simple	0.506	0.569	0.893	/
RLM RSRS-normal	0.490	0.536	0.886	/
TCN RSRS-balanced	0.393	0.601	0.894	0.789
TCN RSRS-simple	0.385	0.615	0.894	/
TCN RSRS-normal	0.348	0.582	0.886	/
BERT RSRS	0.279	0.384	0.674	0.126

GFI	0.544	0.550	0.849	0.730
FRE	−0.433	−0.485	−0.775	−0.614
FKGL	0.544	0.533	0.865	0.697
ARI	0.488	0.520	0.875	0.658
DCRF	0.420	0.496	0.735	0.686
SMOG	0.456	0.498	0.813	0.770
ASL	0.508	0.498	0.906	0.683

Measure/Data set	WeeBit	OneStopEnglish	Newsela	Slovenian SB
RLM perplexity-balanced	−0.082	0.405	0.512	0.303
RLM perplexity-simple	−0.115	0.420	0.470	/
RLM perplexity-normal	−0.127	0.283	0.341	/
TCN perplexity-balanced	0.034	0.476	0.537	0.173
TCN perplexity-simple	0.025	0.518	0.566	/
TCN perplexity-normal	−0.015	0.303	0.250	/
BERT perplexity	−0.123	−0.162	−0.673	−0.563

RLM RSRS-balanced	0.497	0.551	0.890	0.732
RLM RSRS-simple	0.506	0.569	0.893	/
RLM RSRS-normal	0.490	0.536	0.886	/
TCN RSRS-balanced	0.393	0.601	0.894	0.789
TCN RSRS-simple	0.385	0.615	0.894	/
TCN RSRS-normal	0.348	0.582	0.886	/
BERT RSRS	0.279	0.384	0.674	0.126

GFI	0.544	0.550	0.849	0.730
FRE	−0.433	−0.485	−0.775	−0.614
FKGL	0.544	0.533	0.865	0.697
ARI	0.488	0.520	0.875	0.658
DCRF	0.420	0.496	0.735	0.686
SMOG	0.456	0.498	0.813	0.770
ASL	0.508	0.498	0.906	0.683

View Large

This Feature Is Available To Subscribers Only