Pragmatic Theories Enhance Understanding of Implied Meanings in LLMs
Takuma Sato, Seiya Kawano, Koichiro Yoshino

TL;DR
This paper shows that including pragmatic theories like Gricean pragmatics and Relevance Theory in prompts significantly improves language models' ability to interpret implied meanings, enhancing their pragmatic reasoning capabilities.
Contribution
Introducing a prompt-based approach that incorporates pragmatic theories to improve LLMs' understanding of implied meanings through guided reasoning.
Findings
Up to 9.6% improvement in pragmatic reasoning tasks
Mentioning pragmatic theories alone yields 1-3% performance boost in larger models
Pragmatic theory prompts outperform baseline reasoning methods
Abstract
The ability to accurately interpret implied meanings plays a crucial role in human communication and language use, and language models are also expected to possess this capability. This study demonstrates that providing language models with pragmatic theories as prompts is an effective in-context learning approach for tasks to understand implied meanings. Specifically, we propose an approach in which an overview of pragmatic theories, such as Gricean pragmatics and Relevance Theory, is presented as a prompt to the language model, guiding it through a step-by-step reasoning process to derive a final interpretation. Experimental results showed that, compared to the baseline, which prompts intermediate reasoning without presenting pragmatic theories (0-shot Chain-of-Thought), our methods enabled language models to achieve up to 9.6\% higher scores on pragmatic reasoning tasks. Furthermore,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
