MSR Mining Challenge: The SmartSHARK Repository Mining Data

TL;DR

The paper introduces the SmartSHARK repository mining data, a comprehensive dataset capturing detailed software project evolution, including changes, issues, CI, pull requests, and annotations, facilitating advanced research in software engineering.

Contribution

It presents a unique, richly annotated dataset combining diverse data sources and labels, enabling complex longitudinal and multi-source analyses in software evolution research.

Findings

Rich, detailed data enables complex analyses.

Annotations improve data usability.

Supports longitudinal and multi-source research.

Abstract

The SmartSHARK repository mining data is a collection of rich and detailed information about the evolution of software projects. The data is unique in its diversity and contains detailed information about each change, issue tracking data, continuous integration data, as well as pull request and code review data. Moreover, the data does not contain only raw data scraped from repositories, but also annotations in form of labels determined through a combination of manual analysis and heuristics, as well as links between the different parts of the data set. The SmartSHARK data set provides a rich source of data that enables us to explore research questions that require data from different sources and/or longitudinal data over time.