An Empirical Study of Java Code Improvements Based on Stack Overflow Answer Edits

TL;DR

This study analyzes how edits to Java answers on Stack Overflow can be used to improve open-source Java code, revealing that nearly half of the answer snippets are applicable for enhancement and some bug fixes are accepted.

Contribution

It introduces an empirical approach to leverage Stack Overflow answer edits for automatic code improvement in open-source Java projects.

Findings

6.91% of SO Java answers have multiple revisions

49.24% of answer snippets are applicable for code improvement

11 proposed bug fixes were accepted by project maintainers

Abstract

Suboptimal code is prevalent in software systems. Developers often write low-quality code due to factors like technical knowledge gaps, insufficient experience, time pressure, management decisions, or personal factors. Once integrated, the accumulation of this suboptimal code leads to significant maintenance costs and technical debt. Developers frequently consult external knowledge bases, such as API documentation and Q&A websites like Stack Overflow (SO), to aid their programming tasks. SO's crowdsourced, collaborative nature has created a vast repository of programming knowledge. Its community-curated content is constantly evolving, with new answers posted or existing ones edited. In this paper, we present an empirical study of SO Java answer edits and their application to improving code in open-source projects. We use a modified code clone search tool to analyze SO code snippets with version history and apply it to open-source Java projects. This identifies outdated or unoptimized code and suggests improved alternatives. Analyzing 140,840 Java accepted answers from SOTorrent and 10,668 GitHub Java projects, we manually categorized SO answer edits and created pull requests to open-source projects with the suggested code improvements. Our results show that 6.91% of SO Java accepted answers have more than one revision (average of 2.82). Moreover, 49.24% of the code snippets in the answer edits are applicable to open-source projects, and 11 out of 36 proposed bug fixes based on these edits were accepted by the GitHub project maintainers.