Skip to Main Content
Table 10 
Game-level (top) and period-level (bottom) accuracy on a 0–100 scale. Best accuracy on each performance metric is highlighted in bold. CC stands for the most common class baseline. Models that involve text perform best in all game-level tasks and in three of seven period-level tasks.
ModelPFPTSFGRPRSRMSD2MSD3
CC 50.4 52.4 50.9 52.8 57.3 55.3 58.9 
  
AR(3)-M 43.7 49.6 48.9 51.9 57.3 53.7 59 
AR(3)-M* 48.1 54.9 51.5 47.8 57.5 55.3 56.3 
LSTM-M 50.1 50.5 48.2 48.8 58.2 56.9 55.9 
  
BoW-RF-T 50.8 50.8 51.1 53.7 57.8 54.9 59.3 
TFIDF-RF-T 51.5 53.7 53.3 53.3 57.6 58.0 57.6 
CNN-T 51.9 54.9 50.4 48.5 57.5 53.7 57.8 
LSTM-T 56.7 58.2 55.7 58.2 55.2 55.8 58.2 
BERT-L-T 54.9 55.6 55.6 57.5 59.5 57.8 60.5 
BERT-A-T 57.5 60.1 58.7 58.6 63.4 61.9 60.8 
  
LSTM-TM 57.5 58.2 55.5 57.7 61.6 59.7 55.8 
BERT-A-TM 59.3 60.7 60.5 60.1 61.2 59.7 60.8 
  
ModelPFPTSFGRPRSRMSD2MSD3
CC 52.2 54.1 51.5 64.8 64.3 64 75.1 
  
AR(3)-M 52.6 53.6 48.8 65 64.9 65.7 75.9 
AR(3)-M* 53.3 54.2 51.7 65 63.2 65.7 75.9 
LSTM-M 50.1 51.5 50.3 62.7 62.4 62.3 74.2 
  
BoW-RF-T 52.3 52.5 49.3 60 61.6 58.2 67.1 
TFIDF-RF-T 50.2 53.9 50.3 63.1 63.5 63.7 74.5 
CNN-T 51.6 53.3 49.4 59.2 62.5 57 68.1 
LSTM-T 51.6 53.7 52.3 64.1 64.9 63.1 74 
BERT-L-T 53.2 56 53.6 63.8 63.6 64.3 74.5 
BERT-A-T 55.6 53.7 52.3 64.3 63.7 64.2 75.1 
  
LSTM-TM 52.3 58.3 56.6 63.6 63.4 63.4 74.2 
BERT-A-TM 56.3 58.5 57.8 64.1 64.7 64.9 74.7 
ModelPFPTSFGRPRSRMSD2MSD3
CC 50.4 52.4 50.9 52.8 57.3 55.3 58.9 
  
AR(3)-M 43.7 49.6 48.9 51.9 57.3 53.7 59 
AR(3)-M* 48.1 54.9 51.5 47.8 57.5 55.3 56.3 
LSTM-M 50.1 50.5 48.2 48.8 58.2 56.9 55.9 
  
BoW-RF-T 50.8 50.8 51.1 53.7 57.8 54.9 59.3 
TFIDF-RF-T 51.5 53.7 53.3 53.3 57.6 58.0 57.6 
CNN-T 51.9 54.9 50.4 48.5 57.5 53.7 57.8 
LSTM-T 56.7 58.2 55.7 58.2 55.2 55.8 58.2 
BERT-L-T 54.9 55.6 55.6 57.5 59.5 57.8 60.5 
BERT-A-T 57.5 60.1 58.7 58.6 63.4 61.9 60.8 
  
LSTM-TM 57.5 58.2 55.5 57.7 61.6 59.7 55.8 
BERT-A-TM 59.3 60.7 60.5 60.1 61.2 59.7 60.8 
  
ModelPFPTSFGRPRSRMSD2MSD3
CC 52.2 54.1 51.5 64.8 64.3 64 75.1 
  
AR(3)-M 52.6 53.6 48.8 65 64.9 65.7 75.9 
AR(3)-M* 53.3 54.2 51.7 65 63.2 65.7 75.9 
LSTM-M 50.1 51.5 50.3 62.7 62.4 62.3 74.2 
  
BoW-RF-T 52.3 52.5 49.3 60 61.6 58.2 67.1 
TFIDF-RF-T 50.2 53.9 50.3 63.1 63.5 63.7 74.5 
CNN-T 51.6 53.3 49.4 59.2 62.5 57 68.1 
LSTM-T 51.6 53.7 52.3 64.1 64.9 63.1 74 
BERT-L-T 53.2 56 53.6 63.8 63.6 64.3 74.5 
BERT-A-T 55.6 53.7 52.3 64.3 63.7 64.2 75.1 
  
LSTM-TM 52.3 58.3 56.6 63.6 63.4 63.4 74.2 
BERT-A-TM 56.3 58.5 57.8 64.1 64.7 64.9 74.7 
View Large
Close Modal
This Feature Is Available To Subscribers Only

or Create an Account

Close Modal
Close Modal
This site uses cookies. By continuing to use our website, you are agreeing to our privacy policy.
Accept