Bots Don't Mind Waiting, Do They? Comparing the Interaction With Automatically and Manually Created Pull Requests
Marvin Wyrich, Raoul Ghit, Tobias Haller, Christian M\"uller

TL;DR
This study compares how open source project maintainers interact with human versus bot-created pull requests, revealing that bot PRs are less likely to be accepted and take longer to merge, indicating room for improvement.
Contribution
It provides empirical evidence on the differences in maintainer interactions with bot and human pull requests, highlighting challenges faced by bots in open source workflows.
Findings
Bot PRs are accepted less frequently than human PRs.
Bot PRs take longer to be merged despite fewer changes.
Approximately one-third of all PRs are from bots.
Abstract
As a maintainer of an open source software project, you are usually happy about contributions in the form of pull requests that bring the project a step forward. Past studies have shown that when reviewing a pull request, not only its content is taken into account, but also, for example, the social characteristics of the contributor. Whether a contribution is accepted and how long this takes therefore depends not only on the content of the contribution. What we only have indications for so far, however, is that pull requests from bots may be prioritized lower, even if the bots are explicitly deployed by the development team and are considered useful. One goal of the bot research and development community is to design helpful bots to effectively support software development in a variety of ways. To get closer to this goal, in this GitHub mining study, we examine the measurable…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
