MIT Press

Table 8

Appraisal prediction performance of human validators (⁠ ${T \to A}_{human}$ ⁠) and computational models (⁠ ${T \to A}_{model}$ ⁠). For the classification set-up, we report Precision, Recall, and F₁. For the regression set-up, we report the root mean square error (RMSE). Δ: difference between ${T \to A}_{model}$ and ${T \to A}_{human}$ ⁠. Standard deviations are reported in Table 17 in the Appendix.

Appraisal	Classification							Regression
	$\binom{T \to A}{human}$			$\binom{T \to A}{model}$			Δ_F₁	$\binom{T \to A}{human}$	$\binom{T \to A}{model}$	Δ_RMSE
	P	R	F₁	P	R	F₁	Δ_F₁	RMSE	RMSE	Δ_RMSE
Suddenness	.75	.61	.68	.70	.79	.74	+.06	1.47	1.33	− .14
Familiarity	.66	.45	.53	.77	.82	.79	+.26	1.49	1.42	− .07
Event Predict.	.60	.54	.56	.76	.74	.75	+.19	1.46	1.47	+.01
Pleasantness	.82	.84	.83	.88	.87	.88	+.05	1.10	1.30	+.20
Unpleasantness	.85	.84	.85	.79	.80	.80	− .05	1.22	1.26	+.04
Goal Relevance	.65	.67	.66	.73	.69	.71	+.05	1.52	1.57	+.05
Situat. Resp.	.70	.37	.48	.83	.87	.85	+.37	1.55	1.43	− .12
Own Resp.	.75	.71	.73	.81	.77	.79	+.06	1.32	1.40	+.08
Others’ Resp.	.75	.74	.74	.74	.72	.73	− .01	1.54	1.57	+.03
Anticip. Conseq.	.57	.48	.52	.67	.71	.69	+.17	1.61	1.50	− .11
Goal Support	.74	.62	.67	.80	.82	.81	+.14	1.36	1.33	− .03
Urgency	.66	.46	.54	.63	.60	.61	+.07	1.68	1.43	− .25
Own Control	.57	.48	.53	.78	.81	.79	+.26	1.48	1.35	− .13
Others’ Control	.76	.76	.76	.64	.60	.62	− .14	1.55	1.36	− .19
Situat. Control	.71	.40	.51	.84	.90	.87	+.36	1.53	1.35	− .18
Accept. Conseq.	.48	.39	.43	.63	.65	.64	+.21	1.44	1.36	− .08
Internal Standards	.68	.51	.57	.82	.83	.82	+.25	1.16	1.34	+.18
External Norms	.63	.52	.56	.90	.95	.92	+.36	1.77	1.44	− .33
Attention	.74	.75	.74	.50	.48	.48	− .26	1.38	1.27	− .11
Not Consider	.55	.53	.54	.83	.71	.77	+.23	1.56	1.53	− .03
Effort	.70	.54	.61	.69	.70	.70	+.09	1.47	1.38	− .09

Macro avg.	.68	.58	.62	.75	.75	.75	+.13	1.46	1.40	− .06

Appraisal	Classification							Regression
	$\binom{T \to A}{human}$			$\binom{T \to A}{model}$			Δ_F₁	$\binom{T \to A}{human}$	$\binom{T \to A}{model}$	Δ_RMSE
	P	R	F₁	P	R	F₁	Δ_F₁	RMSE	RMSE	Δ_RMSE
Suddenness	.75	.61	.68	.70	.79	.74	+.06	1.47	1.33	− .14
Familiarity	.66	.45	.53	.77	.82	.79	+.26	1.49	1.42	− .07
Event Predict.	.60	.54	.56	.76	.74	.75	+.19	1.46	1.47	+.01
Pleasantness	.82	.84	.83	.88	.87	.88	+.05	1.10	1.30	+.20
Unpleasantness	.85	.84	.85	.79	.80	.80	− .05	1.22	1.26	+.04
Goal Relevance	.65	.67	.66	.73	.69	.71	+.05	1.52	1.57	+.05
Situat. Resp.	.70	.37	.48	.83	.87	.85	+.37	1.55	1.43	− .12
Own Resp.	.75	.71	.73	.81	.77	.79	+.06	1.32	1.40	+.08
Others’ Resp.	.75	.74	.74	.74	.72	.73	− .01	1.54	1.57	+.03
Anticip. Conseq.	.57	.48	.52	.67	.71	.69	+.17	1.61	1.50	− .11
Goal Support	.74	.62	.67	.80	.82	.81	+.14	1.36	1.33	− .03
Urgency	.66	.46	.54	.63	.60	.61	+.07	1.68	1.43	− .25
Own Control	.57	.48	.53	.78	.81	.79	+.26	1.48	1.35	− .13
Others’ Control	.76	.76	.76	.64	.60	.62	− .14	1.55	1.36	− .19
Situat. Control	.71	.40	.51	.84	.90	.87	+.36	1.53	1.35	− .18
Accept. Conseq.	.48	.39	.43	.63	.65	.64	+.21	1.44	1.36	− .08
Internal Standards	.68	.51	.57	.82	.83	.82	+.25	1.16	1.34	+.18
External Norms	.63	.52	.56	.90	.95	.92	+.36	1.77	1.44	− .33
Attention	.74	.75	.74	.50	.48	.48	− .26	1.38	1.27	− .11
Not Consider	.55	.53	.54	.83	.71	.77	+.23	1.56	1.53	− .03
Effort	.70	.54	.61	.69	.70	.70	+.09	1.47	1.38	− .09

Macro avg.	.68	.58	.62	.75	.75	.75	+.13	1.46	1.40	− .06

View Large

This Feature Is Available To Subscribers Only