A Low-Complexity Multi-Survivor Dynamic Programming for Constrained Discrete Optimization

TL;DR

This paper introduces a novel multi-survivor dynamic programming algorithm that efficiently solves constrained discrete optimization problems, including applications in 5G and DNA sequencing, offering optimal solutions with reduced computational effort.

Contribution

The paper presents a new multi-survivor dynamic programming method that guarantees optimality for constrained discrete optimization problems, improving computational efficiency over existing methods.

Findings

Successfully applied to 5G quantizer bit allocation

Effective in DNA fragment assembly

Demonstrates significant computational savings

Abstract

Constrained discrete optimization problems are encountered in many areas of communication and machine learning. We consider the case where the objective function satisfies Bellman's optimality principle without the constraints on which we place no conditions. We first show that these problems are a generalization of optimization in constrained Markov decision processes with finite horizon used in reinforcement learning and are NP-Hard. We then present a novel multi-survivor dynamic programming (msDP) algorithm that guarantees optimality at significant computational savings. We demonstrate this by solving 5G quantizer bit allocation and DNA fragment assembly problems. The results are very promising and suggest that msDP can be used for many applications.