An O(log N) Parallel Algorithm for Newton Step Computations with Applications to Moving Horizon Estimation

TL;DR

This paper introduces a non-iterative parallel algorithm with O(log N) complexity for computing the Newton step in Moving Horizon Estimation, significantly speeding up constrained optimal estimation problems on parallel hardware.

Contribution

A novel parallel algorithm exploiting problem structure for efficient Newton step computation in MHE, reducing complexity growth and enabling faster real-time estimation.

Findings

Logarithmic complexity growth in horizon length

Successful implementation on parallel hardware

Potential applications to smoothing problems

Abstract

In Moving Horizon Estimation (MHE) the computed estimate is found by solving a constrained finite-time optimal estimation problem in real-time at each sample in a receding horizon fashion. The constrained estimation problem can be solved by, e.g., interior-point (IP) or active-set (AS) methods, where the main computational effort in both methods is known to be the computation of the search direction, i.e., the Newton step. This is often done using generic sparsity exploiting algorithms or serial Riccati recursions, but as parallel hardware is becoming more commonly available the need for parallel algorithms for computing the Newton step is increasing. In this paper a tailored, non-iterative parallel algorithm for computing the Newton step using the Riccati recursion is presented. The algorithm exploits the special structure of the Karush-Kuhn-Tucker system for the optimal estimation problem. As a result it is possible to obtain logarithmic complexity growth in the estimation horizon length, which can be used to reduce the computation time for IP and AS methods when applied to what is today considered as challenging estimation problems. Promising numerical results have been obtained using an ANSI-C implementation of the proposed algorithm running on true parallel hardware. Beyond MHE, due to similarities in the problem structure, the algorithm can be applied to various forms of on-line and off-line smoothing problems.