Self-Convinced Prompting: Few-Shot Question Answering with Repeated Introspection
Haodi Zhang, Min Cai, Xinhe Zhang, Chen Jason Zhang, Rui, Mao, Kaishun Wu

TL;DR
This paper introduces Self-Convinced Prompting, a framework that iteratively refines LLM responses through introspection, significantly improving performance on complex reasoning tasks across multiple datasets.
Contribution
It presents a novel iterative prompting framework with components for self-assessment and refinement, enhancing LLM reasoning beyond traditional few-shot prompting methods.
Findings
Achieves substantial performance improvements on 7 diverse datasets.
Demonstrates the effectiveness of iterative self-assessment in LLMs.
Validates the framework's general applicability across tasks.
Abstract
While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still fall short of human-level proficiency. Recent studies have established the effectiveness of prompts in steering LLMs towards generating desired outputs. Building on these insights, we introduce a novel framework that harnesses the potential of large-scale pre-trained language models, to iteratively enhance performance of the LLMs. Our framework incorporates three components: \textit{Normal CoT}, a \textit{Convincer}, and an \textit{Answerer}. It processes the output of a typical few-shot chain-of-thought prompt, assesses the correctness of the response, scrutinizes the answer, refines the reasoning, and ultimately produces a new solution. Experimental…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Multimodal Machine Learning Applications · Natural Language Processing Techniques
MethodsPathways Language Model
