# Improving Alignment in LVLMs with Debiased Self-Judgment

## TL;DR

This paper introduces a novel internal self-evaluation method for LVLMs that reduces hallucinations and improves alignment without external data, enhancing safety and performance.

## Contribution

The paper proposes a debiased self-judgment score that enables LVLMs to self-evaluate and improve alignment autonomously, reducing reliance on external datasets.

## Key findings

- Significantly reduces hallucinations in LVLM outputs.
- Improves safety and alignment quality.
- Outperforms traditional alignment methods.

## Abstract

The rapid advancements in Large Language Models (LLMs) and Large Visual-Language Models (LVLMs) have opened up new opportunities for integrating visual and linguistic modalities. However, effectively aligning these modalities remains challenging, often leading to hallucinations--where generated outputs are not grounded in the visual input--and raising safety concerns across various domains. Existing alignment methods, such as instruction tuning and preference tuning, often rely on external datasets, human annotations, or complex post-processing, which limit scalability and increase costs. To address these challenges, we propose a novel approach that generates the debiased self-judgment score, a self-evaluation metric created internally by the model without relying on external resources. This enables the model to autonomously improve alignment. Our method enhances both decoding strategies and preference tuning processes, resulting in reduced hallucinations, enhanced safety, and improved overall capability. Empirical results show that our approach significantly outperforms traditional methods, offering a more effective solution for aligning LVLMs.