Performance of the rule-based model on the TACRED test partition. [1] is the set of manually written surface rules of Angeli et al. (2015) coupled with our syntactic rules (see Section 4.1). [2] is the set of rules generated from our explainability classifier’s outputs with gold labels on the training partition. [3] is the set of rules from the explainability classifier’s outputs with predicted labels on the test partition. We also evaluate the performance on combinations of these sets of rules: [2]+[3] contain all rules generated by our approach; [1]+[2]+[3] combine machine-generated rules with the manually written rules.