The number of punctuation symbols found in the middle of dialog acts, depending on the applied segmentation. nolower and lower are predicted using XLNet with dialog-level context. The presence of punctuation in nolower variant provides the model with the necessary cues to preserve a similar distribution to the ground truth.