VB-Mitigator: An Open-source Framework for Evaluating and Advancing Visual Bias Mitigation
Ioannis Sarridis, Christos Koutlis, Symeon Papadopoulos, and Christos Diou

TL;DR
VB-Mitigator is an open-source framework that standardizes evaluation and comparison of visual bias mitigation techniques in computer vision, promoting reproducibility and accelerating progress toward fairer AI systems.
Contribution
It introduces a unified, extensible platform with multiple mitigation methods, datasets, and evaluation practices to advance research in visual bias mitigation.
Findings
Provides a comprehensive benchmark of state-of-the-art methods.
Facilitates reproducibility and fair comparison across studies.
Supports integration of new methods and datasets easily.
Abstract
Bias in computer vision models remains a significant challenge, often resulting in unfair, unreliable, and non-generalizable AI systems. Although research into bias mitigation has intensified, progress continues to be hindered by fragmented implementations and inconsistent evaluation practices. Disparate datasets and metrics used across studies complicate reproducibility, making it difficult to fairly assess and compare the effectiveness of various approaches. To overcome these limitations, we introduce the Visual Bias Mitigator (VB-Mitigator), an open-source framework designed to streamline the development, evaluation, and comparative analysis of visual bias mitigation techniques. VB-Mitigator offers a unified research environment encompassing 12 established mitigation methods, 7 diverse benchmark datasets. A key strength of VB-Mitigator is its extensibility, allowing for seamless…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVisual perception and processing mechanisms · Ophthalmology and Visual Impairment Studies · Ocular and Laser Science Research
