Skip to Main Content
Table 8:
Hyperparameters for the Language Modeling Task.
Model
Learning Rate
Decay Rate
Batch Size
LSTM
0.001
0.99
32
GRU
0.001
0.99
32
uRNN
0.0001
0.9
32
oRNN
0.0001
0.9
32
EURNN
0.0001
0.5
32
GORU
0.001
0.9
32
Model
Learning Rate
Decay Rate
Batch Size
LSTM
0.001
0.99
32
GRU
0.001
0.99
32
uRNN
0.0001
0.9
32
oRNN
0.0001
0.9
32
EURNN
0.0001
0.5
32
GORU
0.001
0.9
32
View Large
Close Modal
Close Modal
This Feature Is Available To Subscribers Only
Sign In
or
Create an Account
Close Modal
Close Modal
This site uses cookies. By continuing to use our website, you are agreeing to
our privacy policy.
Accept