MIT Press

Table 5:

RUM modeling ingredients: Tasks (A–E).

Task	Upd. Gate u	Best Activations f	λ	η
(A)	not needed	ReLU, tanh, sigm.	any	N/A
(B)	not needed	any	1	N/A
(C)	necessary	ReLU	1	N/A
(D)	necessary	ReLU, tanh	0	1.0
(E)	necessary	ReLU	0	N/A

Task	Upd. Gate u	Best Activations f	λ	η
(A)	not needed	ReLU, tanh, sigm.	any	N/A
(B)	not needed	any	1	N/A
(C)	necessary	ReLU	1	N/A
(D)	necessary	ReLU, tanh	0	1.0
(E)	necessary	ReLU	0	N/A