Structured Knowledge Grounding for Question Answering
Yujie Lu, Siqi Ouyang, Kairui Zhou

TL;DR
This paper introduces a novel approach that leverages only language models to ground question-answering tasks in knowledge bases, using dynamic retrieval and deep fusion techniques to improve reasoning and coverage.
Contribution
It proposes a knowledge construction method with dynamic hop retrieval and a deep fusion mechanism, eliminating the need for graph-based techniques in knowledge grounding for QA.
Findings
Achieves state-of-the-art results on CommensenseQA benchmark.
Demonstrates effective knowledge grounding solely with language models.
Shows improved reasoning and coverage over previous methods.
Abstract
Can language models (LM) ground question-answering (QA) tasks in the knowledge base via inherent relational reasoning ability? While previous models that use only LMs have seen some success on many QA tasks, more recent methods include knowledge graphs (KG) to complement LMs with their more logic-driven implicit knowledge. However, effectively extracting information from structured data, like KGs, empowers LMs to remain an open question, and current models rely on graph techniques to extract knowledge. In this paper, we propose to solely leverage the LMs to combine the language and knowledge for knowledge based question-answering with flexibility, breadth of coverage and structured reasoning. Specifically, we devise a knowledge construction method that retrieves the relevant context with a dynamic hop, which expresses more comprehensivenes than traditional GNN-based techniques. And we…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Natural Language Processing Techniques · Advanced Graph Neural Networks
MethodsBalanced Selection
