ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chains
Minjun Zhu, Yixuan Weng, Shizhu He, Kang Liu, Jun Zhao

TL;DR
ReasonChainQA is a new benchmark for text-based complex question answering that emphasizes explicit reasoning chains and diverse multi-hop questions to improve interpretability and retrieval effectiveness.
Contribution
It introduces a benchmark with explicit evidence chains, diverse reasoning types, and supports answer generation and evidence extraction tasks for complex QA.
Findings
Supervised and unsupervised retrieval experiments highlight the importance of ReasonChainQA.
The dataset includes 12 reasoning types and 78 relations, supporting diverse multi-hop questions.
High-quality evidence extraction improves reasoning interpretability.
Abstract
The ability of reasoning over evidence has received increasing attention in question answering (QA). Recently, natural language database (NLDB) conducts complex QA in knowledge base with textual evidences rather than structured representations, this task attracts a lot of attention because of the flexibility and richness of textual evidence. However, existing text-based complex question answering datasets fail to provide explicit reasoning process, while it's important for retrieval effectiveness and reasoning interpretability. Therefore, we present a benchmark \textbf{ReasonChainQA} with explanatory and explicit evidence chains. ReasonChainQA consists of two subtasks: answer generation and evidence chains extraction, it also contains higher diversity for multi-hop questions with varying depths, 12 reasoning types and 78 relations. To obtain high-quality textual evidences for answering…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Natural Language Processing Techniques · Advanced Text Analysis Techniques
MethodsBalanced Selection
