Masked language modeling perplexity on CustomNews (lower is better). The Temporal model degrades less when evaluated on the future time slice.