Exact Dynamic Programming for Solow--Polasky Diversity Subset Selection on Lines and Staircases

TL;DR

This paper develops an exact dynamic programming algorithm for Solow--Polasky diversity subset selection on ordered finite point sets, connecting biodiversity metrics with metric geometry and extending to higher-dimensional staircase analogues.

Contribution

It provides a detailed proof of the scaled consecutive-gap identity, an $O(kn^2)$ dynamic program, and applies the same approach to monotone biobjective Pareto-fronts and $ ^d$ staircases.

Findings

Derived a closed-form formula for diversity based on point gaps.

Established an efficient dynamic programming algorithm for fixed-cardinality subset selection.

Extended the method to higher-dimensional monotone staircase structures.

Abstract

This paper studies exact fixed-cardinality Solow--Polasky diversity subset selection on ordered finite $\ell_1$ point sets, with monotone biobjective Pareto fronts and their higher-dimensional staircase analogues as central applications. Solow--Polasky diversity was introduced in biodiversity conservation, whereas the same inverse-matrix expression appears in metric geometry as magnitude: for a finite metric space $(X,d)$ with exponential similarity matrix $Z_{ij}=e^{-q d(x_i,x_j)}$, the quantity $\1^\top Z^{-1}\1$ is the magnitude of the scaled finite metric space $(X,qd)$ whenever the weighting is defined by the inverse matrix. Thus, in this finite exponential-kernel setting, Solow--Polasky diversity and magnitude are mathematically the same object viewed through different motivations. Building on the linear-chain magnitude formula of Leinster and Willerton, the paper gives a detailed proof of the scaled consecutive-gap identity $ \SP(X)=1+\sum_r \tanh(qg_r/2),$ where the $g_r$ are the gaps between consecutive selected points. It then proves an exact Bellman-recursion theorem for maximizing this value over all subsets of a prescribed cardinality, yielding an $O(kn^2)$ dynamic program for an ordered $n$-point candidate set and subset size $k$. Finally, the paper proves ordered $\ell_1$ reductions showing that the same algorithm applies to monotone biobjective Pareto-front approximations and, more generally, to finite coordinatewise monotone $\ell_1$ staircases in $\R^d$. These are precisely the ordered $\ell_1$ chains for which the $\ell_1$-distance becomes a line metric along the chosen order, so the one-dimensional dynamic program applies without modification. Keywords: Solow--Polasky diversity; magnitude; metric geometry; dynamic programming; ordered points; $\ell_1$ geometry; Pareto-front approximation.