YANNs: Y-wise Affine Neural Networks for Exact and Efficient Representations of Piecewise Linear Functions

TL;DR

YANNs are a novel neural network architecture that exactly and efficiently represent piecewise affine functions, enabling fast, stable, and feasible control solutions without training.

Contribution

Introduction of YANNs, a fully-explainable, training-free neural network architecture that exactly represents piecewise affine functions for control applications.

Findings

YANNs can represent multi-parametric control laws exactly.

YANNs evaluate faster than traditional methods in real-time.

Numerical studies show scalability with input/output dimensions.

Abstract

This work formally introduces Y-wise Affine Neural Networks (YANNs), a fully-explainable network architecture that continuously and efficiently represent piecewise affine functions with polytopic subdomains. Following from the proofs, it is shown that the development of YANNs requires no training to achieve the functionally equivalent representation. YANNs thus maintain all mathematical properties of the original formulations. Multi-parametric model predictive control is utilized as an application showcase of YANNs, which theoretically computes optimal control laws as a piecewise affine function of states, outputs, setpoints, and disturbances. With the exact representation of multi-parametric control laws, YANNs retain essential control-theoretic guarantees such as recursive feasibility and stability. This sets YANNs apart from the existing works which apply neural networks for approximating optimal control laws instead of exactly representing them. By optimizing the inference speed of the networks, YANNs can evaluate substantially faster in real-time compared to traditional piecewise affine function calculations. Numerical case studies are presented to demonstrate the algorithmic scalability with respect to the input/output dimensions and the number of subdomains. YANNs represent a significant advancement in control as the first neural network-based controller that inherently ensures both feasibility and stability. Future applications can leverage them as an efficient and interpretable starting point for data-driven modeling/control.