Skip to Main Content
Table 12 
Ablation study results for the axiom identification component. We remove features of the axiom identification component one by one as listed in Table 4 and observe the fall in performance in terms of the axiom identification performance as well as the overall performance to gauge the value of the various features.
  Axiom Identification F1 SAT Scores 
  Strict Comp. Relaxed Comp. Practice Official Textbook 
Content Sentence Overlap 56.2 73.8 56 43 42 
Geometry entities 64.0 80.4 61 49 46 
Keywords 67.5 81.0 62 54 48 
 
Discourse (Typography) RST edge 66.6 78.9 58 46 44 
Axm, Thm, Corr. 62.6 77.8 57 47 43 
Equation 66.2 78.6 57 46 42 
Associated Diagram 68.5 84.4 61 52 49 
Bold / Underline 68.2 82.0 62 52 48 
Bounding box 59.7 75.5 55 47 40 
XML structure 67.4 80.6 60 51 46 
 
 Unablated 70.4 87.6 64 55 51 
  Axiom Identification F1 SAT Scores 
  Strict Comp. Relaxed Comp. Practice Official Textbook 
Content Sentence Overlap 56.2 73.8 56 43 42 
Geometry entities 64.0 80.4 61 49 46 
Keywords 67.5 81.0 62 54 48 
 
Discourse (Typography) RST edge 66.6 78.9 58 46 44 
Axm, Thm, Corr. 62.6 77.8 57 47 43 
Equation 66.2 78.6 57 46 42 
Associated Diagram 68.5 84.4 61 52 49 
Bold / Underline 68.2 82.0 62 52 48 
Bounding box 59.7 75.5 55 47 40 
XML structure 67.4 80.6 60 51 46 
 
 Unablated 70.4 87.6 64 55 51 
Close Modal

or Create an Account

Close Modal
Close Modal