Optimization is Better than Generation: Optimizing Commit Message Leveraging Human-written Commit Message
Jiawei Li, David Farag\'o, Christian Petrov, Iftekhar Ahmed

TL;DR
This paper introduces Commit Message Optimization (CMO), a method that enhances human-written commit messages by iterative optimization using LLMs and external feedback, outperforming existing generation methods.
Contribution
The paper presents a novel CMO approach that improves human-written commit messages through search-based optimization and LLMs, addressing limitations of current CMG techniques.
Findings
CMO generates more rational, comprehensive, and expressive messages.
Outperforms state-of-the-art CMG methods and human messages 88.2%-95.4% of the time.
Significantly improves quality of commit messages in software development.
Abstract
Commit messages are crucial in software development, supporting maintenance tasks and communication among developers. While Large Language Models (LLMs) have advanced Commit Message Generation (CMG) using various software contexts, some contexts developers consider are often missed by CMG techniques and can't be easily retrieved or even retrieved at all by automated tools. To address this, we propose Commit Message Optimization (CMO), which enhances human-written messages by leveraging LLMs and search-based optimization. CMO starts with human-written messages and iteratively improves them by integrating key contexts and feedback from external evaluators. Our extensive evaluation shows CMO generates commit messages that are significantly more Rational, Comprehensive, and Expressive while outperforming state-of-the-art CMG methods and human messages 88.2%-95.4% of the time.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsContext-Aware Activity Recognition Systems
