Ordinal Constrained Binary Code Learning for Nearest Neighbor Search

TL;DR

This paper introduces Ordinal Constraint Hashing (OCH), a novel method that efficiently preserves ordinal relations in binary code learning for large-scale nearest neighbor search, outperforming existing approaches.

Contribution

The paper proposes a graph-based approximation method with ordinal constraint projection and a stochastic gradient descent algorithm to improve ordinal-preserving hashing efficiency and effectiveness.

Findings

OCH outperforms state-of-the-art hashing methods on large-scale visual search datasets.

The method effectively reduces the size of ordinal graphs while maintaining ranking quality.

Experimental results demonstrate superior retrieval accuracy on LabelMe, Tiny100K, and GIST1M datasets.

Abstract

Recent years have witnessed extensive attention in binary code learning, a.k.a. hashing, for nearest neighbor search problems. It has been seen that high-dimensional data points can be quantized into binary codes to give an efficient similarity approximation via Hamming distance. Among existing schemes, ranking-based hashing is recent promising that targets at preserving ordinal relations of ranking in the Hamming space to minimize retrieval loss. However, the size of the ranking tuples, which shows the ordinal relations, is quadratic or cubic to the size of training samples. By given a large-scale training data set, it is very expensive to embed such ranking tuples in binary code learning. Besides, it remains a dificulty to build ranking tuples efficiently for most ranking-preserving hashing, which are deployed over an ordinal graph-based setting. To handle these problems, we propose a novel ranking-preserving hashing method, dubbed Ordinal Constraint Hashing (OCH), which efficiently learns the optimal hashing functions with a graph-based approximation to embed the ordinal relations. The core idea is to reduce the size of ordinal graph with ordinal constraint projection, which preserves the ordinal relations through a small data set (such as clusters or random samples). In particular, to learn such hash functions effectively, we further relax the discrete constraints and design a specific stochastic gradient decent algorithm for optimization. Experimental results on three large-scale visual search benchmark datasets, i.e. LabelMe, Tiny100K and GIST1M, show that the proposed OCH method can achieve superior performance over the state-of-the-arts approaches.