English DRS parsing (PMB 2.2.0 test set); results for SPAR, SIM-SPAR, BOXER, Transition, Graph, Neural-BOXER, and MultiEnc are taken from respective papers; best result per metric shown in bold.
DRS . | Prec . | Rec . | F1 . |
---|---|---|---|
SPAR | 44.4 | 37.8 | 40.8 |
SIM-SPAR | 57.0 | 58.4 | 57.7 |
BOXER | 72.1 | 72.3 | 72.2 |
Transition | 75.6 | 74.6 | 75.1 |
Graph | – | – | 76.4 |
Neural-BOXER | 85.0 | 81.4 | 83.2 |
MultiEnc | 87.6 | 86.3 | 87.0 |
Cls-LSTM | 82.5 | 83.3 | 83.9 |
Tree-LSTM | 84.3 | 84.7 | 84.3 |
Cls-Transformer | 88.1 | 87.7 | 87.9 |
Tree-Transformer | 88.6 | 88.9 | 88.7 |
w/o bronze | 86.1 | 86.0 | 86.0 (−2.6) |
w/o bronze & silver | 79.9 | 84.4 | 82.1 (−6.5) |
DRS . | Prec . | Rec . | F1 . |
---|---|---|---|
SPAR | 44.4 | 37.8 | 40.8 |
SIM-SPAR | 57.0 | 58.4 | 57.7 |
BOXER | 72.1 | 72.3 | 72.2 |
Transition | 75.6 | 74.6 | 75.1 |
Graph | – | – | 76.4 |
Neural-BOXER | 85.0 | 81.4 | 83.2 |
MultiEnc | 87.6 | 86.3 | 87.0 |
Cls-LSTM | 82.5 | 83.3 | 83.9 |
Tree-LSTM | 84.3 | 84.7 | 84.3 |
Cls-Transformer | 88.1 | 87.7 | 87.9 |
Tree-Transformer | 88.6 | 88.9 | 88.7 |
w/o bronze | 86.1 | 86.0 | 86.0 (−2.6) |
w/o bronze & silver | 79.9 | 84.4 | 82.1 (−6.5) |