A Highly Efficient Adaptive-Sieving-Based Algorithm for the High-Dimensional Rank Lasso Problem

TL;DR

This paper introduces an adaptive-sieving-based algorithm for the high-dimensional rank lasso problem, improving efficiency and robustness in high-dimensional data analysis with nonsmooth loss functions.

Contribution

It proposes a novel adaptive-sieving algorithm that leverages sparsity and solves smaller subproblems, enhancing efficiency for high-dimensional rank lasso problems.

Findings

The algorithm is robust against different noise types.

It outperforms existing methods in high-dimensional settings.

It maintains statistical advantages of the hdr lasso model.

Abstract

The high-dimensional rank lasso (hdr lasso) model is an efficient approach to deal with high-dimensional data analysis. It was proposed as a tuning-free robust approach for the high-dimensional regression and was demonstrated to enjoy several statistical advantages over other approaches. The hdr lasso problem is essentially an $L_1$-regularized optimization problem whose loss function is Jaeckel's dispersion function with Wilcoxon scores. Due to the nondifferentiability of the above loss function, many classical algorithms for lasso-type problems are unable to solve this model. In this paper, inspired by the adaptive sieving strategy for the exclusive lasso problem [1], we propose an adaptive-sieving-based algorithm to solve the hdr lasso problem. The proposed algorithm makes full use of the sparsity of the solution. In each iteration, a subproblem with the same form as the original model is solved, but in a much smaller size. We apply the proximal point algorithm to solve the subproblem, which fully takes advantage of the two nonsmooth terms. Extensive numerical results demonstrate that the proposed algorithm (AS-PPA) is robust for different types of noises, which verifies the attractive statistical property as shown in [2]. Moreover, AS-PPA is also highly efficient, especially for the case of high-dimensional features, compared with other methods.