VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understanding

TL;DR

This paper introduces VidHalluc, a comprehensive benchmark for evaluating hallucinations in multimodal large language models for video understanding, and proposes DINO-HEAL, a training-free method to reduce such hallucinations.

Contribution

The paper presents the largest benchmark for hallucinations in video MLLMs and a novel, training-free method to mitigate hallucinations during inference.

Findings

Most MLLMs are vulnerable to hallucinations in video understanding.

VidHalluc effectively identifies hallucination-prone cases across action, temporal sequence, and scene transition.

DINO-HEAL improves hallucination mitigation by an average of 3.02%. in tests.

Abstract

Multimodal large language models (MLLMs) have recently shown significant advancements in video understanding, excelling in content reasoning and instruction-following tasks. However, hallucination, where models generate inaccurate or misleading content, remains underexplored in the video domain. Building on the observation that MLLM visual encoders often fail to distinguish visually different yet semantically similar video pairs, we introduce VidHalluc, the largest benchmark designed to examine hallucinations in MLLMs for video understanding. It consists of 5,002 videos, paired to highlight cases prone to hallucinations. VidHalluc assesses hallucinations across three critical dimensions: (1) action, (2) temporal sequence, and (3) scene transition. Comprehensive testing shows that most MLLMs are vulnerable to hallucinations across these dimensions. Furthermore, we propose DINO-HEAL, a training-free method that reduces hallucinations by incorporating spatial saliency from DINOv2 to reweight visual features during inference. Our results show that DINO-HEAL consistently improves performance on VidHalluc, achieving an average improvement of 3.02% in mitigating hallucinations across all tasks. Both the VidHalluc benchmark and DINO-HEAL code are available at https://people-robots.github.io/vidhalluc.