MIT Press

Table 9

Models’ performance (Precision, Recall, F₁) on recognizing emotions, having access only to the annotated (⁠ ${A^{Gold} \to E}_{model}$ ⁠) or predicted appraisal dimensions (⁠ ${A^{Pred} \to E}_{model}$ ⁠). Standard deviations are reported in Table 18 in the Appendix. Discretized/Scaled: input appraisals are represented as Boolean values/as values in the [0:1] interval. Δ: F₁ difference between the models leveraging appraisal predictions and gold ratings.

Emotion	Discretized							Scaled
	$\binom{A^{Gold} \to E}{model}$			$\binom{A^{Pred} \to E}{model}$			Δ_F₁	$\binom{A^{Gold} \to E}{model}$			$\binom{A^{Pred} \to E}{model}$			Δ_F₁
	P	R	F₁	P	R	F₁	Δ_F₁	P	R	F₁	P	R	F₁	Δ_F₁
Anger	.35	.46	.40	.35	.33	.34	− .06	.35	.46	.40	.28	.57	.37	− .03
Boredom	.44	.47	.46	.54	.69	.60	+.14	.47	.62	.54	.46	.60	.52	− .02
Disgust	.36	.32	.34	.42	.33	.37	+.03	.49	.44	.46	.58	.20	.29	− .17
Fear	.22	.33	.26	.25	.47	.32	+.06	.27	.34	.30	.26	.46	.33	+.03
Guilt	.30	.23	.26	.25	.08	.12	− .14	.32	.26	.28	.29	.15	.19	− .09
Joy	.28	.30	.28	.31	.31	.30	+.02	.29	.30	.29	.31	.24	.25	− .04
No emo.	.46	.46	.46	.46	.29	.35	− .11	.50	.46	.47	.53	.23	.31	− .16
Pride	.33	.39	.35	.27	.48	.34	− .01	.35	.38	.35	.29	.33	.29	− .06
Relief	.28	.13	.18	.33	.13	.19	+.01	.32	.18	.23	.36	.21	.26	+.03
Sadness	.31	.29	.30	.30	.39	.34	+.04	.37	.35	.36	.36	.24	.28	− .08
Shame	.26	.22	.24	.25	.19	.21	− .03	.27	.24	.25	.29	.37	.33	+.08
Surprise	.44	.44	.43	.46	.44	.44	+.01	.46	.43	.44	.63	.22	.31	− .13
Trust	.21	.14	.17	.29	.10	.15	− .02	.30	.23	.26	.23	.35	.27	+.01

Macro avg.	.33	.32	.32	.34	.32	.32	+.00	.37	.36	.35	.38	.32	.31	− .05

Emotion	Discretized							Scaled
	$\binom{A^{Gold} \to E}{model}$			$\binom{A^{Pred} \to E}{model}$			Δ_F₁	$\binom{A^{Gold} \to E}{model}$			$\binom{A^{Pred} \to E}{model}$			Δ_F₁
	P	R	F₁	P	R	F₁	Δ_F₁	P	R	F₁	P	R	F₁	Δ_F₁
Anger	.35	.46	.40	.35	.33	.34	− .06	.35	.46	.40	.28	.57	.37	− .03
Boredom	.44	.47	.46	.54	.69	.60	+.14	.47	.62	.54	.46	.60	.52	− .02
Disgust	.36	.32	.34	.42	.33	.37	+.03	.49	.44	.46	.58	.20	.29	− .17
Fear	.22	.33	.26	.25	.47	.32	+.06	.27	.34	.30	.26	.46	.33	+.03
Guilt	.30	.23	.26	.25	.08	.12	− .14	.32	.26	.28	.29	.15	.19	− .09
Joy	.28	.30	.28	.31	.31	.30	+.02	.29	.30	.29	.31	.24	.25	− .04
No emo.	.46	.46	.46	.46	.29	.35	− .11	.50	.46	.47	.53	.23	.31	− .16
Pride	.33	.39	.35	.27	.48	.34	− .01	.35	.38	.35	.29	.33	.29	− .06
Relief	.28	.13	.18	.33	.13	.19	+.01	.32	.18	.23	.36	.21	.26	+.03
Sadness	.31	.29	.30	.30	.39	.34	+.04	.37	.35	.36	.36	.24	.28	− .08
Shame	.26	.22	.24	.25	.19	.21	− .03	.27	.24	.25	.29	.37	.33	+.08
Surprise	.44	.44	.43	.46	.44	.44	+.01	.46	.43	.44	.63	.22	.31	− .13
Trust	.21	.14	.17	.29	.10	.15	− .02	.30	.23	.26	.23	.35	.27	+.01

Macro avg.	.33	.32	.32	.34	.32	.32	+.00	.37	.36	.35	.38	.32	.31	− .05

View Large

This Feature Is Available To Subscribers Only