Efficient reformulations of ReLU deep neural networks for surrogate modelling in power system optimisation

TL;DR

This paper introduces a linear programming reformulation for convexified ReLU deep neural networks, enabling efficient and accurate surrogate modelling in power system optimisation, outperforming existing methods in computational speed and fidelity.

Contribution

It presents a novel LP reformulation for convexified ReLU DNNs with non-negative weights, facilitating their integration into power system optimisation problems.

Findings

Reformulation achieves comparable solution quality to PWL and MIP methods.

Significantly improves computational performance over existing approaches.

Maintains model fidelity while enabling scalable optimisation.

Abstract

The ongoing decarbonisation of power systems is driving an increasing reliance on distributed energy resources, which introduces complex and nonlinear interactions that are difficult to capture in conventional optimisation models. As a result, machine learning based surrogate modelling has emerged as a promising approach, but integrating machine learning models such as ReLU deep neural networks (DNNs) directly into optimisation often results in nonconvex and computationally intractable formulations. This paper proposes a linear programming (LP) reformulation for a class of convexified ReLU DNNs with non-negative weight matrices beyond the first layer, enabling a tight and tractable embedding of learned surrogate models in optimisation. We evaluate the method using a case study on learning the prosumer's responsiveness within an aggregator bidding problem in the Danish tertiary capacity market. The proposed reformulation is benchmarked against state-of-the-art alternatives, including piecewise linearisation (PWL), MIP-based embedding, and other LP relaxations. Across multiple neural network architectures and market scenarios, the convexified ReLU DNN achieves solution quality comparable to PWL and MIP-based reformulations while significantly improving computational performance and preserving model fidelity, unlike penalty-based reformulations. The results demonstrate that convexified ReLU DNNs offer a scalable and reliable methodology for integrating learned surrogate models in optimisation, with applicability to a wide range of emerging power system applications.