Performance of the five classifiers on 17 combinations of time series. Bold indicates the best F1 (F) for each combination. The table and the experiments were previously reported in Salatino et al. (2020b)
| . | LR . | RF . | AB . | CNN . | LSTM . | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| P% . | R% . | F% . | P% . | R% . | F% . | P% . | R% . | F% . | P% . | R% . | F% . | P% . | R% . | F% . | |
| RA | 70.8 | 45.2 | 55.2 | 63.3 | 55.8 | 59.2 | 66.0 | 58.4 | 61.9 | 64.1 | 66.3 | 65.0 | 65.2 | 64.2 | 64.6 |
| RI | 83.5 | 67.1 | 74.4 | 78.9 | 69.8 | 74.0 | 80.0 | 73.1 | 76.4 | 79.2 | 75.1 | 77.0 | 79.1 | 74.8 | 76.9 |
| PA | 58.3 | 15.3 | 24.2 | 60.4 | 15.4 | 24.5 | 59.3 | 16.0 | 25.2 | 60.5 | 15.7 | 24.9 | 60.8 | 15.6 | 24.8 |
| PI | 76.5 | 69.0 | 72.5 | 73.9 | 68.4 | 71.0 | 75.6 | 71.8 | 73.6 | 73.7 | 76.6 | 75.0 | 74.1 | 76.6 | 75.2 |
| R | 73.7 | 48.8 | 58.7 | 65.5 | 59.7 | 62.5 | 68.6 | 63.1 | 65.6 | 67.6 | 69.2 | 68.3 | 67.2 | 69.4 | 68.2 |
| P | 76.5 | 68.6 | 72.3 | 72.8 | 67.6 | 70.0 | 74.4 | 71.6 | 73.0 | 73.2 | 76.1 | 74.6 | 73.1 | 76.6 | 74.8 |
| RA, RI | 85.7 | 70.9 | 77.6 | 80.5 | 76.0 | 78.2 | 82.6 | 76.6 | 79.5 | 78.9 | 75.1 | 76.8 | 82.2 | 79.3 | 80.7 |
| RA, PA | 70.3 | 47.0 | 56.3 | 63.1 | 55.5 | 59.0 | 66.5 | 59.3 | 62.6 | 64.5 | 65.1 | 64.5 | 65.4 | 64.2 | 64.6 |
| RA, PI | 79.6 | 73.7 | 76.5 | 77.2 | 74.3 | 75.7 | 79.1 | 76.5 | 77.7 | 75.2 | 76.3 | 75.7 | 77.4 | 81.9 | 79.5 |
| RI, PA | 83.3 | 67.0 | 74.3 | 77.9 | 70.8 | 74.1 | 79.6 | 73.0 | 76.1 | 78.6 | 75.6 | 77.0 | 79.1 | 75.2 | 77.1 |
| RI, PI | 83.4 | 77.3 | 80.2 | 81.0 | 77.3 | 79.1 | 82.7 | 78.6 | 80.6 | 82.0 | 78.6 | 80.2 | 81.7 | 81.2 | 81.4 |
| PA, PI | 76.7 | 68.6 | 72.4 | 74.2 | 69.0 | 71.5 | 75.9 | 71.5 | 73.6 | 71.1 | 70.8 | 70.9 | 73.8 | 76.7 | 75.2 |
| RA, RI, PA | 85.2 | 71.4 | 77.7 | 80.8 | 75.4 | 78.0 | 82.5 | 77.0 | 79.6 | 82.6 | 78.1 | 80.3 | 82.6 | 78.2 | 80.3 |
| RA, RI, PI | 85.4 | 79.8 | 82.5 | 84.5 | 80.5 | 82.4 | 84.6 | 81.2 | 82.9 | 83.8 | 84.7 | 84.2 | 84.1 | 85.4 | 84.7 |
| RA, PA, PI | 79.6 | 73.9 | 76.6 | 77.5 | 74.4 | 75.9 | 79.2 | 76.5 | 77.8 | 78.9 | 78.6 | 78.6 | 77.4 | 81.4 | 79.2 |
| RI, PA, PI | 83.6 | 77.5 | 80.4 | 81.1 | 78.0 | 79.5 | 82.7 | 78.6 | 80.6 | 82.2 | 80.9 | 81.5 | 81.1 | 81.0 | 81.1 |
| RA, RI, PA, PI | 85.4 | 79.8 | 82.5 | 83.8 | 80.0 | 81.8 | 84.6 | 81.2 | 82.9 | 84.7 | 81.3 | 82.9 | 83.2 | 86.1 | 84.6 |
| . | LR . | RF . | AB . | CNN . | LSTM . | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| P% . | R% . | F% . | P% . | R% . | F% . | P% . | R% . | F% . | P% . | R% . | F% . | P% . | R% . | F% . | |
| RA | 70.8 | 45.2 | 55.2 | 63.3 | 55.8 | 59.2 | 66.0 | 58.4 | 61.9 | 64.1 | 66.3 | 65.0 | 65.2 | 64.2 | 64.6 |
| RI | 83.5 | 67.1 | 74.4 | 78.9 | 69.8 | 74.0 | 80.0 | 73.1 | 76.4 | 79.2 | 75.1 | 77.0 | 79.1 | 74.8 | 76.9 |
| PA | 58.3 | 15.3 | 24.2 | 60.4 | 15.4 | 24.5 | 59.3 | 16.0 | 25.2 | 60.5 | 15.7 | 24.9 | 60.8 | 15.6 | 24.8 |
| PI | 76.5 | 69.0 | 72.5 | 73.9 | 68.4 | 71.0 | 75.6 | 71.8 | 73.6 | 73.7 | 76.6 | 75.0 | 74.1 | 76.6 | 75.2 |
| R | 73.7 | 48.8 | 58.7 | 65.5 | 59.7 | 62.5 | 68.6 | 63.1 | 65.6 | 67.6 | 69.2 | 68.3 | 67.2 | 69.4 | 68.2 |
| P | 76.5 | 68.6 | 72.3 | 72.8 | 67.6 | 70.0 | 74.4 | 71.6 | 73.0 | 73.2 | 76.1 | 74.6 | 73.1 | 76.6 | 74.8 |
| RA, RI | 85.7 | 70.9 | 77.6 | 80.5 | 76.0 | 78.2 | 82.6 | 76.6 | 79.5 | 78.9 | 75.1 | 76.8 | 82.2 | 79.3 | 80.7 |
| RA, PA | 70.3 | 47.0 | 56.3 | 63.1 | 55.5 | 59.0 | 66.5 | 59.3 | 62.6 | 64.5 | 65.1 | 64.5 | 65.4 | 64.2 | 64.6 |
| RA, PI | 79.6 | 73.7 | 76.5 | 77.2 | 74.3 | 75.7 | 79.1 | 76.5 | 77.7 | 75.2 | 76.3 | 75.7 | 77.4 | 81.9 | 79.5 |
| RI, PA | 83.3 | 67.0 | 74.3 | 77.9 | 70.8 | 74.1 | 79.6 | 73.0 | 76.1 | 78.6 | 75.6 | 77.0 | 79.1 | 75.2 | 77.1 |
| RI, PI | 83.4 | 77.3 | 80.2 | 81.0 | 77.3 | 79.1 | 82.7 | 78.6 | 80.6 | 82.0 | 78.6 | 80.2 | 81.7 | 81.2 | 81.4 |
| PA, PI | 76.7 | 68.6 | 72.4 | 74.2 | 69.0 | 71.5 | 75.9 | 71.5 | 73.6 | 71.1 | 70.8 | 70.9 | 73.8 | 76.7 | 75.2 |
| RA, RI, PA | 85.2 | 71.4 | 77.7 | 80.8 | 75.4 | 78.0 | 82.5 | 77.0 | 79.6 | 82.6 | 78.1 | 80.3 | 82.6 | 78.2 | 80.3 |
| RA, RI, PI | 85.4 | 79.8 | 82.5 | 84.5 | 80.5 | 82.4 | 84.6 | 81.2 | 82.9 | 83.8 | 84.7 | 84.2 | 84.1 | 85.4 | 84.7 |
| RA, PA, PI | 79.6 | 73.9 | 76.6 | 77.5 | 74.4 | 75.9 | 79.2 | 76.5 | 77.8 | 78.9 | 78.6 | 78.6 | 77.4 | 81.4 | 79.2 |
| RI, PA, PI | 83.6 | 77.5 | 80.4 | 81.1 | 78.0 | 79.5 | 82.7 | 78.6 | 80.6 | 82.2 | 80.9 | 81.5 | 81.1 | 81.0 | 81.1 |
| RA, RI, PA, PI | 85.4 | 79.8 | 82.5 | 83.8 | 80.0 | 81.8 | 84.6 | 81.2 | 82.9 | 84.7 | 81.3 | 82.9 | 83.2 | 86.1 | 84.6 |