SeNeDiF-OOD: Semantic Nested Dichotomy Fusion for Out-of-Distribution Detection Methodology in Open-World Classification. A Case Study on Monument Style Classification

TL;DR

SeNeDiF-OOD introduces a hierarchical fusion approach for out-of-distribution detection, effectively handling diverse OOD data in open-world classification, demonstrated through a monument style recognition case study.

Contribution

The paper presents a novel hierarchical fusion framework, SeNeDiF-OOD, for improved OOD detection that addresses semantic heterogeneity in open-world environments.

Findings

Significantly outperforms traditional OOD detection baselines.

Effectively filters diverse OOD categories including adversarial attacks.

Maintains high in-distribution classification performance.

Abstract

Out-of-distribution (OOD) detection is a fundamental requirement for the reliable deployment of artificial intelligence applications in open-world environments. However, addressing the heterogeneous nature of OOD data, ranging from low-level corruption to semantic shifts, remains a complex challenge that single-stage detectors often fail to resolve. To address this issue, we propose SeNeDiF-OOD, a novel methodology based on Semantic Nested Dichotomy Fusion. This framework decomposes the detection task into a hierarchical structure of binary fusion nodes, where each layer is designed to integrate decision boundaries aligned with specific levels of semantic abstraction. To validate the proposed framework, we present a comprehensive case study using MonuMAI, a real-world architectural style recognition system exposed to an open environment. This application faces a diverse range of inputs, including non-monument images, unknown architectural styles, and adversarial attacks, making it an ideal testbed for our proposal. Through extensive experimental evaluation in this domain, results demonstrate that our hierarchical fusion methodology significantly outperforms traditional baselines, effectively filtering these diverse OOD categories while preserving in-distribution performance.