Table 1: 

Comparison of TopiOCQA with other QA datasets. TopiOCQA incorporates topical changes, along with several best practices of previous datasets. ⚠ represents that only a proportion of dataset satisfies the property.

DatasetMulti–turnOpen–domainFree–form answersInformation–seeking questionsTopic Switching
TopiOCQA (ours) ✓ ✓ ✓ ✓ ✓ 
QReCC (Anantha et al., 2021) ✓ ✓ ✓ ⚠ ⚠ 
OR-QuAC (Qu et al., 2020) ✓ ✓ ✗ ✓ ✗ 
CoQA (Reddy et al., 2019) ✓ ✗ ✓ ✗ ✗ 
QuAC (Choi et al., 2018) ✓ ✗ ✗ ✓ ✗ 
NarrativeQA (Kočiský et al., 2018) ✗ ✓ ✓ ✓ ✗ 
Natural Questions (Kwiatkowski et al., 2019) ✗ ✓ ✗ ✓ ✗ 
SQuAD 2.0 (Rajpurkar et al., 2018) ✗ ✗ ✗ ✗ ✗ 
DatasetMulti–turnOpen–domainFree–form answersInformation–seeking questionsTopic Switching
TopiOCQA (ours) ✓ ✓ ✓ ✓ ✓ 
QReCC (Anantha et al., 2021) ✓ ✓ ✓ ⚠ ⚠ 
OR-QuAC (Qu et al., 2020) ✓ ✓ ✗ ✓ ✗ 
CoQA (Reddy et al., 2019) ✓ ✗ ✓ ✗ ✗ 
QuAC (Choi et al., 2018) ✓ ✗ ✗ ✓ ✗ 
NarrativeQA (Kočiský et al., 2018) ✗ ✓ ✓ ✓ ✗ 
Natural Questions (Kwiatkowski et al., 2019) ✗ ✓ ✗ ✓ ✗ 
SQuAD 2.0 (Rajpurkar et al., 2018) ✗ ✗ ✗ ✗ ✗ 
Close Modal

or Create an Account

Close Modal
Close Modal