Sociotechnical Challenges of Machine Learning in Healthcare and Social Welfare

TL;DR

This paper develops a framework to understand sociotechnical challenges in applying machine learning to healthcare and social welfare, emphasizing real-world practice and deployment issues.

Contribution

It introduces a systematic framework categorizing eleven sociotechnical challenges along care pathways, based on qualitative research and practitioner workshops.

Findings

A categorization of eleven sociotechnical challenges.

A process-oriented account of challenge emergence.

Enhanced vocabulary for analyzing ML in care settings.

Abstract

Sociotechnical challenges of machine learning in healthcare and social welfare are mismatches between how a machine learning tool functions and the structure of care practices. While prior research has documented many such issues, existing accounts often attribute them either to designers' limited social understanding or to inherent technical constraints, offering limited support for systematic description and comparison across settings. In this paper, we present a framework for conceptualizing sociotechnical challenges of machine learning grounded in qualitative fieldwork, a review of longitudinal deployment studies, and co-design workshops with healthcare and social welfare practitioners. The framework comprises (1) a categorization of eleven sociotechnical challenges organized along an ML-enabled care pathway, and (2) a process-oriented account of the conditions through which these challenges emerge across design and use. By providing a parsimonious vocabulary and an explanatory lens focused on practice, this work supports more precise analysis of how machine learning tools function and malfunction within real-world care delivery.