DegBins: Degradation-Driven Binning for Depth Super-Resolution

TL;DR

DegBins introduces a degradation-aware binning approach for depth super-resolution, reformulating the task as a hybrid classification-regression problem to better handle complex, spatially varying degradations.

Contribution

It proposes a novel adaptive binning framework that models degradation relationships and employs multi-stage refinement for improved depth reconstruction.

Findings

Outperforms state-of-the-art methods on five benchmarks.

Achieves higher accuracy and robustness in depth recovery.

Effectively handles severe degradations and complex structures.

Abstract

Depth super-resolution (DSR) aims to recover a high-resolution (HR) depth map from its low-resolution (LR) counterpart. With color image guidance, this task is typically formulated as learning the residual between HR and LR in a low-dimensional feature space. However, this additive formulation is insufficient to accurately capture the complex relationship between HR and LR, especially under spatially varying degradations. In this paper, we introduce DegBins, a novel DSR framework that leverages degradation-driven binning to adaptively enhance residual modeling. Specifically, DegBins reformulates the regression-based DSR as a hybrid classification-regression problem, where the residual depth is represented as a linear combination of discrete depth bins weighted by their learned probability distribution, yielding more flexible and expressive representations. Furthermore, DegBins models the degradation relationship between HR and LR in a high-dimensional feature space, enabling adaptive bin range adjustment and probability optimization conditioned on local degradation characteristics. To progressively improve reconstruction quality, DegBins adopts a multi-stage refinement scheme, where each stage performs finer-grained bin partitioning and probability updating based on the former estimation. This coarse-to-fine design facilitates more accurate depth recovery, particularly in regions with severe degradations or complex structural variations. Extensive experiments across five benchmarks demonstrate that DegBins consistently outperforms existing state-of-the-art methods in terms of accuracy, robustness, and generalization.