Input Convex Lipschitz Recurrent Neural Networks for Robust and Efficient Process Modeling and Optimization

TL;DR

This paper introduces ICL-RNN, a novel neural network architecture that combines input convexity and Lipschitz continuity to enhance robustness and efficiency in process modeling and optimization tasks.

Contribution

The paper proposes a new recurrent neural network architecture, ICL-RNN, that integrates convexity and Lipschitz constraints for improved robustness and computational efficiency.

Findings

ICL-RNN outperforms existing recurrent units in efficiency and robustness.

Successfully applied to chemical process modeling and waste heat recovery systems.

Source code is publicly available for reproducibility.

Abstract

Computational efficiency and robustness are essential in process modeling, optimization, and control for real-world engineering applications. While neural network-based approaches have gained significant attention in recent years, conventional neural networks often fail to address these two critical aspects simultaneously or even independently. Inspired by natural physical systems and established literature, input convex architectures are known to enhance computational efficiency in optimization tasks, whereas Lipschitz-constrained architectures improve robustness. However, combining these properties within a single model requires careful review, as inappropriate methods for enforcing one property can undermine the other. To overcome this, we introduce a novel network architecture, termed Input Convex Lipschitz Recurrent Neural Networks (ICL-RNNs). This architecture seamlessly integrates the benefits of convexity and Lipschitz continuity, enabling fast and robust neural network-based modeling and optimization. The ICL-RNN outperforms existing recurrent units in both computational efficiency and robustness. Additionally, it has been successfully applied to practical engineering scenarios, such as chemical process modeling and the modeling and control of Organic Rankine Cycle-based waste heat recovery systems. Source code is available at https://github.com/killingbear999/ICLRNN.