MIT Press

Skip to Main Content

Table 6:

Correlation between surprisal differences and morphological complexity measures for character, BPE, and Morfessor models. All p-values > 10⁻¹¹.

Difference	Measure	Spearman’s ρ
Δ_{BPE, char}	Types	0.95^***
	TTR	0.92^***
	MATTR	0.77^***
	MLW	0.74^***

Δ_{Morfessor, char}	Types	0.71^***
	TTR	0.66^***
	MATTR	0.50^***
	MLW	0.53^***

Δ_{BPE, Morfessor}	Types	0.86^***
	TTR	0.86^***
	MATTR	0.80^***
	MLW	0.75^***

Difference	Measure	Spearman’s ρ
Δ_{BPE, char}	Types	0.95^***
	TTR	0.92^***
	MATTR	0.77^***
	MLW	0.74^***

Δ_{Morfessor, char}	Types	0.71^***
	TTR	0.66^***
	MATTR	0.50^***
	MLW	0.53^***

Δ_{BPE, Morfessor}	Types	0.86^***
	TTR	0.86^***
	MATTR	0.80^***
	MLW	0.75^***