Mitigating Label Noise using Prompt-Based Hyperbolic Meta-Learning in Open-Set Domain Generalization

TL;DR

This paper introduces HyProMeta, a novel prompt-based hyperbolic meta-learning framework designed to improve open-set domain generalization in the presence of label noise, demonstrating superior performance on new benchmarks.

Contribution

It proposes HyProMeta, combining hyperbolic prototypes and prompt learning, to address label noise in open-set domain generalization, a previously overlooked challenge.

Findings

HyProMeta outperforms existing methods on new noisy OSDG benchmarks.

Hyperbolic prototypes improve robustness to label noise.

Learnable prompts enhance generalization to unseen classes.

Abstract

Open-Set Domain Generalization (OSDG) is a challenging task requiring models to accurately predict familiar categories while minimizing confidence for unknown categories to effectively reject them in unseen domains. While the OSDG field has seen considerable advancements, the impact of label noise--a common issue in real-world datasets--has been largely overlooked. Label noise can mislead model optimization, thereby exacerbating the challenges of open-set recognition in novel domains. In this study, we take the first step towards addressing Open-Set Domain Generalization under Noisy Labels (OSDG-NL) by constructing dedicated benchmarks derived from widely used OSDG datasets, including PACS and DigitsDG. We evaluate baseline approaches by integrating techniques from both label denoising and OSDG methodologies, highlighting the limitations of existing strategies in handling label noise effectively. To address these limitations, we propose HyProMeta, a novel framework that integrates hyperbolic category prototypes for label noise-aware meta-learning alongside a learnable new-category agnostic prompt designed to enhance generalization to unseen classes. Our extensive experiments demonstrate the superior performance of HyProMeta compared to state-of-the-art methods across the newly established benchmarks. The source code of this work is released at https://github.com/KPeng9510/HyProMeta.