# Machine Learning–Based Audiovisual Phenotyping for Measuring Communication, Shared Decision-Making, and Trust

**Authors:** Shely Khaikin, Vineet Tiruvadi, Jeffrey Brooks, Alice Baird, Anne-Catherine Grela-Mpoko, Lindsey Hoffman, Jadyn Crossley, Menachem Leasy, Jaime Fineman, Margot Savoy, Laura Igarabuza, Anuradha Paranjape, Cheryl YS Foo, Michael L Birnbaum, Yaara Zisman-Ilani

PMC · DOI: 10.2196/85906 · 2026-03-03

## TL;DR

This paper explores using machine learning to analyze audio and video data to better understand patient communication and trust in healthcare.

## Contribution

The novelty lies in using audiovisual phenotyping to objectively assess communication and decision-making in healthcare.

## Key findings

- Machine learning can detect discrepancies between self-reported experiences and nonverbal cues.
- This approach offers an objective way to evaluate communication quality in healthcare settings.
- It has potential to promote health equity by improving shared decision-making.

## Abstract

Machine learning–based audiovisual phenotyping can reveal hidden discrepancies between patients’ self-reported experiences and nonverbal expressions, offering a promising tool for objectively assessing communication quality and advancing health equity.

## Full-text entities

- **Species:** Homo sapiens (human, species) [taxon 9606]

---
Source: https://tomesphere.com/paper/PMC12984015