Oracle combination of the context-only systems using GloVe and BERT. min and max denote the minimum and maximum F1 of the systems combined and comb denotes the F1 of the combined system. The first two panels were trained on the Original English CoNLL 03 training data and tested on the original English CoNLL 03 test data and the WikiGold data. The last panel was trained and tested on the respective splits of MUC-6.
System . | CoNLL . | Wikipedia . | MUC-6 . | ||||||
---|---|---|---|---|---|---|---|---|---|
min . | max . | comb . | min . | max . | comb . | min . | max . | comb . | |
context-only LSTM – context-only BERT | 51.6 | 59.8 | 83.7 | 30.2 | 52.2 | 79.0 | 61.1 | 73.5 | 84.6 |
System . | CoNLL . | Wikipedia . | MUC-6 . | ||||||
---|---|---|---|---|---|---|---|---|---|
min . | max . | comb . | min . | max . | comb . | min . | max . | comb . | |
context-only LSTM – context-only BERT | 51.6 | 59.8 | 83.7 | 30.2 | 52.2 | 79.0 | 61.1 | 73.5 | 84.6 |