GUIDEQ: Framework for Guided Questioning for progressive informational collection and classification
Priya Mishra, Suraj Racha, Kaustubh Ponkshe, Adit Akarsh, Ganesh, Ramakrishnan

TL;DR
GUIDEQ is a novel framework that uses guided questioning based on explainability and classifier outputs to iteratively gather relevant information, significantly improving text classification accuracy in QA systems.
Contribution
This work introduces GUIDEQ, a new framework that leverages explainability and classifier labels to generate targeted questions, enhancing information collection and classification performance.
Findings
GUIDEQ outperforms baseline LLM-based methods in F1-Score.
The framework generates higher quality, relevant questions.
Experimental results show improved classification accuracy.
Abstract
Question Answering (QA) is an important part of tasks like text classification through information gathering. These are finding increasing use in sectors like healthcare, customer support, legal services, etc., to collect and classify responses into actionable categories. LLMs, although can support QA systems, they face a significant challenge of insufficient or missing information for classification. Although LLMs excel in reasoning, the models rely on their parametric knowledge to answer. However, questioning the user requires domain-specific information aiding to collect accurate information. Our work, GUIDEQ, presents a novel framework for asking guided questions to further progress a partial information. We leverage the explainability derived from the classifier model for along with LLMs for asking guided questions to further enhance the information. This further information helps…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsIntelligent Tutoring Systems and Adaptive Learning
MethodsIs Venmo Customer Support Available 24/7? How to Reach a Real Person
