Counting Circuits: Mechanistic Interpretability of Visual Reasoning in Large Vision-Language Models

TL;DR

This paper investigates how large vision-language models perform counting, revealing a shared counting circuit, introducing interpretability methods, and demonstrating that targeted fine-tuning improves counting accuracy and general visual reasoning.

Contribution

The study uncovers a structured counting circuit in LVLMs, introduces novel interpretability techniques, and shows that synthetic image-based fine-tuning enhances counting and reasoning performance.

Findings

LVLMs exhibit human-like counting behavior.

Introduction of Visual Activation Patching and HeadLens methods.

Fine-tuning with synthetic images improves counting and reasoning accuracy.

Abstract

Counting serves as a simple but powerful test of a Large Vision-Language Model's (LVLM's) reasoning; it forces the model to identify each individual object and then add them all up. In this study, we investigate how LVLMs implement counting using controlled synthetic and real-world benchmarks, combined with mechanistic analyses. Our results show that LVLMs display a human-like counting behavior, with precise performance on small numerosities and noisy estimation for larger quantities. We introduce two novel interpretability methods, Visual Activation Patching and HeadLens, and use them to uncover a structured "counting circuit" that is largely shared across a variety of visual reasoning tasks. Building on these insights, we propose a lightweight intervention strategy that exploits simple and abundantly available synthetic images to fine-tune arbitrary pretrained LVLMs exclusively on counting. Despite the narrow scope of this fine-tuning, the intervention not only enhances counting accuracy on in-distribution synthetic data, but also yields an average improvement of +8.36% on out-of-distribution counting benchmarks and an average gain of +1.54% on complex, general visual reasoning tasks for Qwen2.5-VL. These findings highlight the central, influential role of counting in visual reasoning and suggest a potential pathway for improving overall visual reasoning capabilities through targeted enhancement of counting mechanisms.