The hyperparameters used in our experiments.
| Hyperparameter . | # . |
|---|---|
| Random Seed | 212 |
| Sentiment maximum sequence length | 384 |
| POMS maximum sequence length | 32 |
| Stage 2 TC (adversarial) task λ | 1 |
| Stage 2 number of epochs | 5 |
| Stage 2 Sentiment batch size | 6 |
| Stage 2 POMS batch size | 24 |
| Stage 3 number of epochs | 50 |
| Stage 3 Sentiment batch size | 128 |
| Stage 3 POMS batch size | 200 |
| Stage 3 gradient accumulation steps | 4 |
| Stage 3 classifier dropout probability | 0.1 |
| Hyperparameter . | # . |
|---|---|
| Random Seed | 212 |
| Sentiment maximum sequence length | 384 |
| POMS maximum sequence length | 32 |
| Stage 2 TC (adversarial) task λ | 1 |
| Stage 2 number of epochs | 5 |
| Stage 2 Sentiment batch size | 6 |
| Stage 2 POMS batch size | 24 |
| Stage 3 number of epochs | 50 |
| Stage 3 Sentiment batch size | 128 |
| Stage 3 POMS batch size | 200 |
| Stage 3 gradient accumulation steps | 4 |
| Stage 3 classifier dropout probability | 0.1 |