Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering
Yu Zhang, Kehai Chen, Xuefeng Bai, zhao kang, Quanjiang Guo, Min Zhang

TL;DR
This paper introduces a novel approach combining question-guided re-scoring of knowledge graphs with an efficient knowledge injection method into language models, significantly improving the accuracy of knowledge graph question answering.
Contribution
It proposes Q-KGR for filtering relevant knowledge and Knowformer for effective knowledge injection into language models, advancing KGQA performance.
Findings
Outperforms existing KGQA systems on multiple benchmarks.
Effectively filters noisy knowledge pathways.
Enhances factual reasoning in language models.
Abstract
Knowledge graph question answering (KGQA) involves answering natural language questions by leveraging structured information stored in a knowledge graph. Typically, KGQA initially retrieve a targeted subgraph from a large-scale knowledge graph, which serves as the basis for reasoning models to address queries. However, the retrieved subgraph inevitably brings distraction information for knowledge utilization, impeding the model's ability to perform accurate reasoning. To address this issue, we propose a Question-guided Knowledge Graph Re-scoring method (Q-KGR) to eliminate noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge. Moreover, we introduce Knowformer, a parameter-efficient method for injecting the re-scored knowledge graph into large language models to enhance their ability to perform factual reasoning. Extensive experiments on…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsAdvanced Graph Neural Networks · Cognitive Computing and Networks · Semantic Web and Ontologies
