LinkQ: An LLM-Assisted Visual Interface for Knowledge Graph Question-Answering

TL;DR

LinkQ is a system that uses large language models to enable users to construct and refine knowledge graph queries through natural language, making KG data more accessible and easier to analyze.

Contribution

LinkQ introduces an LLM-based interface that simplifies KG query formulation and supports iterative refinement, addressing limitations of traditional query languages.

Findings

Practitioners found LinkQ effective for KG question-answering.

Users desire future LLM-assisted exploratory data analysis tools.

LinkQ prevents hallucinations by grounding queries in KG data.

Abstract

We present LinkQ, a system that leverages a large language model (LLM) to facilitate knowledge graph (KG) query construction through natural language question-answering. Traditional approaches often require detailed knowledge of a graph querying language, limiting the ability for users -- even experts -- to acquire valuable insights from KGs. LinkQ simplifies this process by implementing a multistep protocol in which the LLM interprets a user's question, then systematically converts it into a well-formed query. LinkQ helps users iteratively refine any open-ended questions into precise ones, supporting both targeted and exploratory analysis. Further, LinkQ guards against the LLM hallucinating outputs by ensuring users' questions are only ever answered from ground truth KG data. We demonstrate the efficacy of LinkQ through a qualitative study with five KG practitioners. Our results indicate that practitioners find LinkQ effective for KG question-answering, and desire future LLM-assisted exploratory data analysis systems.