# Agility Measurements Mismatch: A Validation Study on Three Agile Team Assessments in Software Engineering

## TL;DR

This study evaluates three agile team assessment tools to determine if they produce consistent results, revealing low correlation and highlighting the immature state of agility measurement methods.

## Contribution

The paper provides an empirical validation of three agile assessment tools, showing their lack of convergent validity and the need for more mature measurement approaches.

## Key findings

- Low correlation among tools' results
- Questions with similar meanings yielded different answers
- Agility measurement methods are still immature

## Abstract

Many tools have been created for measuring the agility of software teams, thus creating a saturation in the field. Three agile measurement tools were selected in order to validate whether they yield sim-ilar results. The surveys of the tools were given to teams in Company A (N = 30). The questions were grouped into agile practices which were checked for correlation in order to establish convergent validity. In addition, we checked whether the questions identified to be the same among the tools would be given the same replies by the respondents. We could not establish convergent validity since the correlations of the data gathered were very few and low. In addition, the questions which were identified to have the same meaning among the tools did not have the same answers from the respondents. We conclude that the area of measuring agility is still immature and more work needs to be done. Not all tools are applicable to every team but they should be selected on the basis of how a team has transitioned to agile.