Skip to Main Content
Table 9: 
Performance of QDMR parsing models on the development and test set. GED+ is computed only for the subset of QDMR graphs with up to 5 nodes, covering 66.1% of QDMRs and 97.6% of high-level data.
DataMetricCopyRuleBasedSeq2SeqS2SDynamicCopynetCopynet (test)
QDMR Exact Match ⇑ 0.001 0.002 0.081 0.116 0.154 0.157 
SARI ⇑ 0.431 0.508 0.665 0.705 0.748 0.746 
GED ⇓ 0.937 0.799 0.398 0.363 0.318 0.322 
GED+ ⇓ 1.813 1.722 1.424 1.137 0.941 0.984 
 
QDMRhigh Exact Match ⇑ 0.001 0.010 0.001 0.015 0.081 0.083 
SARI ⇑ 0.501 0.554 0.379 0.504 0.722 0.722 
GED ⇓ 0.793 0.659 0.585 0.468 0.319 0.316 
GED+ ⇓ 1.102 1.395 1.655 1.238 0.716 0.709 
DataMetricCopyRuleBasedSeq2SeqS2SDynamicCopynetCopynet (test)
QDMR Exact Match ⇑ 0.001 0.002 0.081 0.116 0.154 0.157 
SARI ⇑ 0.431 0.508 0.665 0.705 0.748 0.746 
GED ⇓ 0.937 0.799 0.398 0.363 0.318 0.322 
GED+ ⇓ 1.813 1.722 1.424 1.137 0.941 0.984 
 
QDMRhigh Exact Match ⇑ 0.001 0.010 0.001 0.015 0.081 0.083 
SARI ⇑ 0.501 0.554 0.379 0.504 0.722 0.722 
GED ⇓ 0.793 0.659 0.585 0.468 0.319 0.316 
GED+ ⇓ 1.102 1.395 1.655 1.238 0.716 0.709 
Close Modal

or Create an Account

Close Modal
Close Modal