# Compatibility of the CEN-ISO/TS 82304-2 Health App Assessment Framework With Catalan and Italian Health Authorities’ Needs: Qualitative Interview Study

## TL;DR

This study checks if a European health app assessment framework meets the needs of Catalan and Italian health authorities, finding it compatible with their key requirements.

## Contribution

The study evaluates the compatibility of the CEN-ISO/TS 82304-2 health app assessment framework with the needs of two EU health authorities.

## Key findings

- Health authorities perceive value in integrating quality health apps and using an assessment framework.
- The TS framework is compatible with 3 gains, 7 pains, and 6 jobs identified in the study.
- Common needs and compatibility may reduce uncertainty in adopting the TS framework.

## Abstract

Health authorities of European Union (EU) member states are increasingly working to integrate quality health apps into their health care systems. Given the current lack of unified EU assessment criteria, the European Commission initiated Technical Specification (TS) CEN-ISO 82304-2:2021—Health and wellness apps—Quality and reliability (hereinafter the “TS”) to address the scattered EU landscape of assessment frameworks (AFs) for health apps. The adoption of an AF, such as the TS, falls within member state competence and is considered an uncertainty-reduction process. Evaluations by peers as well as ensuring the compatibility of the TS with the needs of health authorities can reduce uncertainty and mediate harmonization.

This study aims to examine the compatibility of the TS with the needs of Catalan and Italian health authorities.

Semistructured interviews were conducted with key informants from a regional (Catalonia in Spain) and national (Italy) health authority, and a thematic analysis was carried out. Main themes were established deductively, following the aspects defined by the value proposition canvas: (1) health authorities’ needs (“gains,” “pains,” and “jobs”) and (2) the TS “products and services” and their distinct characteristics (“gain creators” and “pain relievers”). Subthemes were generated inductively. The compatibility of the needs with the TS was theoretically determined by the researchers. The results were visualized using the value proposition canvas. Two participant validation steps confirmed that the most relevant aspects of the predefined themes had been captured.

Despite the diversity of the 2 health authorities, subthemes were common and categorized into 9 gains, 9 pains, and 11 jobs. Key findings include the health authorities’ perceived value of, and need for, integrating quality health apps and using an AF (gains), along with the related policy, implementation, and operational activities (jobs). The lack of enabling EU legislation and standardization, resulting in a need for the multiple authorities involved to consent, made achieving an AF challenging (pains). Nine products and services related to the TS and 17 distinct characteristics (eg, its multistakeholder evidence base) were found to be compatible with 3 gains (eg, stimulating the prescription and use of apps), 7 pains (eg, legislation and harmonization issues), and 6 jobs (eg, assessing apps). Indirect effects, 3 anticipated future services, and 1 anticipated gain creator and pain reliever increase this compatibility.

Our results suggest that the health authorities share common fundamental needs, and that the TS is compatible with these needs. The identified needs and compatibility can potentially reduce peer authorities’ uncertainties in adopting an AF in general and the TS in particular. More research is recommended to confirm and translate our results in other contexts and further fine-tune compatibility to achieve wide adoption of the TS and accelerate the uptake of health apps.