ReflectivePrompt: Reflective evolution in autoprompting algorithms
Viktor N. Zhuravlev, Artur R. Khairullin, Ernest A. Dyagin, Alena N. Sitkina, Nikita I. Kulin

TL;DR
ReflectivePrompt introduces an evolutionary autoprompting method that employs reflective evolution to improve prompt optimization for large language models, achieving significant performance gains across multiple datasets.
Contribution
It presents a novel reflective evolution approach for autoprompting, enhancing prompt search precision and incorporating knowledge accumulation during evolution.
Findings
Achieves an average 28% improvement on BBH dataset.
Outperforms current state-of-the-art autoprompting methods.
Effective across classification and text generation tasks.
Abstract
Autoprompting is the process of automatically selecting optimized prompts for language models, which has been gaining popularity with the rapid advancement of prompt engineering, driven by extensive research in the field of large language models (LLMs). This paper presents ReflectivePrompt - a novel autoprompting method based on evolutionary algorithms that employs a reflective evolution approach for more precise and comprehensive search of optimal prompts. ReflectivePrompt utilizes short-term and long-term reflection operations before crossover and elitist mutation to enhance the quality of the modifications they introduce. This method allows for the accumulation of knowledge obtained throughout the evolution process and updates it at each epoch based on the current population. ReflectivePrompt was tested on 33 datasets for classification and text generation tasks using open-access…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
