Comparison of TopiOCQA with other QA datasets. TopiOCQA incorporates topical changes, along with several best practices of previous datasets. ⚠ represents that only a proportion of dataset satisfies the property.
Dataset . | Multi–turn . | Open–domain . | Free–form answers . | Information–seeking questions . | Topic Switching . |
---|---|---|---|---|---|
TopiOCQA (ours) | ✓ | ✓ | ✓ | ✓ | ✓ |
QReCC (Anantha et al., 2021) | ✓ | ✓ | ✓ | ⚠ | ⚠ |
OR-QuAC (Qu et al., 2020) | ✓ | ✓ | ✗ | ✓ | ✗ |
CoQA (Reddy et al., 2019) | ✓ | ✗ | ✓ | ✗ | ✗ |
QuAC (Choi et al., 2018) | ✓ | ✗ | ✗ | ✓ | ✗ |
NarrativeQA (Kočiský et al., 2018) | ✗ | ✓ | ✓ | ✓ | ✗ |
Natural Questions (Kwiatkowski et al., 2019) | ✗ | ✓ | ✗ | ✓ | ✗ |
SQuAD 2.0 (Rajpurkar et al., 2018) | ✗ | ✗ | ✗ | ✗ | ✗ |
Dataset . | Multi–turn . | Open–domain . | Free–form answers . | Information–seeking questions . | Topic Switching . |
---|---|---|---|---|---|
TopiOCQA (ours) | ✓ | ✓ | ✓ | ✓ | ✓ |
QReCC (Anantha et al., 2021) | ✓ | ✓ | ✓ | ⚠ | ⚠ |
OR-QuAC (Qu et al., 2020) | ✓ | ✓ | ✗ | ✓ | ✗ |
CoQA (Reddy et al., 2019) | ✓ | ✗ | ✓ | ✗ | ✗ |
QuAC (Choi et al., 2018) | ✓ | ✗ | ✗ | ✓ | ✗ |
NarrativeQA (Kočiský et al., 2018) | ✗ | ✓ | ✓ | ✓ | ✗ |
Natural Questions (Kwiatkowski et al., 2019) | ✗ | ✓ | ✗ | ✓ | ✗ |
SQuAD 2.0 (Rajpurkar et al., 2018) | ✗ | ✗ | ✗ | ✗ | ✗ |