Overreliance on AI in Information-seeking from Video Content

TL;DR

This study examines how generative AI influences video-based information-seeking, revealing improvements in accuracy and efficiency but also highlighting risks of over-reliance and misinformation, with implications for safety and trust.

Contribution

It provides empirical evidence on the effects of AI assistance in video search, including risks of over-reliance and misinformation, through a large-scale user experiment.

Findings

AI assistance improves accuracy by up to 35%.

Efficiency increases by up to 25%.

Over-reliance on AI can cause accuracy drops up to 32%.

Abstract

The ubiquity of multimedia content is reshaping online information spaces, particularly in social media environments. At the same time, search is being rapidly transformed by generative AI, with large language models (LLMs) routinely deployed as intermediaries between users and multimedia content to retrieve and summarize information. Despite their growing influence, the impact of LLM inaccuracies and potential vulnerabilities on multimedia information-seeking tasks remains largely unexplored. We investigate how generative AI affects accuracy, efficiency, and confidence in information retrieval from videos. We conduct an experiment with around 900 participants on 8,000+ video-based information-seeking tasks, comparing behavior across three conditions: (1) access to videos only, (2) access to videos with LLM-based AI assistance, and (3) access to videos with a deceiving AI assistant designed to provide false answers. We find that AI assistance increases accuracy by 3-7% when participants viewed the relevant video segment, and by 27-35% when they did not. Efficiency increases by 10% for short videos and 25% for longer ones. However, participants tend to over-rely on AI outputs, resulting in accuracy drops of up to 32% when interacting with the deceiving AI. Alarmingly, self-reported confidence in answers remains stable across all three conditions. Our findings expose fundamental safety risks in AI-mediated video information retrieval.