SpaceX: Exploring metrics with the SPACE model for developer productivity

TL;DR

This paper introduces the SPACE model to measure developer productivity more holistically by analyzing open-source repositories with advanced statistical and sentiment analysis techniques, revealing insights into emotional states and collaboration dynamics.

Contribution

It operationalizes the SPACE framework using repository mining, statistical models, and sentiment analysis to create a composite productivity metric addressing previous heuristics' limitations.

Findings

Negative affect correlates with increased commit frequency

Interaction topology outperforms volume metrics in capturing collaboration

Proposes a new Composite Productivity Score (CPS) for developers

Abstract

This empirical investigation elucidates the limitations of deterministic, unidimensional productivity heuristics by operationalizing the SPACE framework through extensive repository mining. Utilizing a dataset derived from open-source repositories, the study employs rigorous statistical methodologies including Generalized Linear Mixed Models (GLMM) and RoBERTa-based sentiment classification to synthesize a holistic, multi-faceted productivity metric. Analytical results reveal a statistically significant positive correlation between negative affective states and commit frequency, implying a cycle of iterative remediation driven by frustration. Furthermore, the investigation has demonstrated that analyzing the topology of contributor interactions yields superior fidelity in mapping collaborative dynamics compared to traditional volume-based metrics. Ultimately, this research posits a Composite Productivity Score (CPS) to address the heterogeneity of developer efficacy.