A conceptual framework for SPI evaluation

TL;DR

This paper presents SPI-MEF, a comprehensive framework based on literature review, to guide practitioners in planning, executing, and evaluating software process improvements effectively.

Contribution

The paper introduces SPI-MEF, a novel, adaptable framework for evaluating SPI initiatives, integrating expert feedback to enhance usability and applicability.

Findings

SPI-MEF supports structured evaluation planning.

Expert feedback improved framework usability.

Framework integrates with existing measurement programs.

Abstract

Software Process Improvement (SPI) encompasses the analysis and modification of the processes within software development, aimed at improving key areas that contribute to the organizations' goals. The task of evaluating whether the selected improvement path meets these goals is challenging. On the basis of the results of a systematic literature review on SPI measurement and evaluation practices, we developed a framework (SPI Measurement and Evaluation Framework (SPI-MEF)) that supports the planning and implementation of SPI evaluations. SPI-MEF guides the practitioner in scoping the evaluation, determining measures, and performing the assessment. SPI-MEF does not assume a specific approach to process improvement and can be integrated in existing measurement programs, refocusing the assessment on evaluating the improvement initiative's outcome. Sixteen industry and academic experts evaluated the framework's usability and capability to support practitioners, providing additional insights that were integrated in the application guidelines of the framework.