# DepressionMIGNN: A Multiple-Instance Learning-Based Depression Detection Model with Graph Neural Networks

## TL;DR

This paper introduces a new AI model for detecting depression using video, audio, and text data, which outperforms existing methods by analyzing long-term behavioral patterns.

## Contribution

The novel framework uses graph neural networks to model temporal behavioral patterns for depression detection.

## Key findings

- The model achieved an MAE of 5.25 and RMSE of 6.75 on the AVEC2014 dataset.
- It achieved a CCC of 0.554 and RMSE of 4.61 on the AVEC2019 dataset.
- The approach outperforms existing methods that focus on momentary expressions.

## Abstract

The global prevalence of depression necessitates the application of technological solutions, particularly sensor-based systems, to augment scarce resources for early diagnostic purposes. In this study, we use benchmark datasets that contain multimodal data including video, audio, and transcribed text. To address depression detection as a chronic long-term disorder reflected by temporal behavioral patterns, we propose a novel framework that segments videos into utterance-level instances using GRU for contextual representation, and then constructs graphs where utterance embeddings serve as nodes connected through dual relationships capturing both chronological development and intermittent relevant information. Graph neural networks are employed to learn multi-dimensional edge relationships and align multimodal representations across different temporal dependencies. Our approach achieves superior performance with an MAE of 5.25 and RMSE of 6.75 on AVEC2014, and CCC of 0.554 and RMSE of 4.61 on AVEC2019, demonstrating significant improvements over existing methods that focus primarily on momentary expressions.