On Representing Convex Quadratically Constrained Quadratic Programs via Graph Neural Networks
Chenyang Wu, Qian Chen, Akang Wang, Tian Ding, Ruoyu Sun, Wenguo Yang, Qingjiang Shi

TL;DR
This paper explores how graph neural networks can effectively represent convex quadratically constrained quadratic programs, enabling more scalable solutions for complex optimization problems in industrial applications.
Contribution
It introduces a novel tripartite graph representation for convex QCQPs and demonstrates GNNs' ability to capture key properties like feasibility and optimal solutions.
Findings
GNNs can reliably represent feasibility and optimality of QCQPs.
A new tripartite graph representation for QCQPs is proposed.
GNNs deepen understanding of QCQPs and facilitate future ML-based solutions.
Abstract
Convex quadratically constrained quadratic programs (QCQPs) involve finding a solution within a convex feasible region defined by quadratic constraints while minimizing a convex quadratic objective function. These problems arise in various industrial applications, including power systems and signal processing. Traditional methods for solving convex QCQPs primarily rely on matrix factorization, which quickly becomes computationally prohibitive as the problem size increases. Recently, graph neural networks (GNNs) have gained attention for their potential in representing and solving various optimization problems such as linear programs and linearly constrained quadratic programs. In this work, we investigate the representation power of GNNs in the context of QCQP tasks. Specifically, we propose a new tripartite graph representation for general convex QCQPs and properly associate it with…
Peer Reviews
Decision·Submitted to ICLR 2025
The tri-partite graph representation is new. The claim of Theorem 1 is impressive. Nonconvex counter examples are presented.
The results of the paper are presented without in-depth comparison and discussions that are necessary to argue the chosen graph representations are simplest possible. The numerical examples are limited to training performance and up to only mid-sized feasible QCQPs, which classic solvers are also capable of solving.
This paper introduces a new graph neural network architecture that improves upon existing models for optimization problems, specifically targeting quadratically constrained quadratic programs. The analysis of the universal approximation properties is solid. The paper is well-written and addresses the QCQP problem that has been largely unexplored in the literature.
a. The new tri-partite network contains O(n^2) nodes in each layer, where n is the number of variables. This represents a significant increase in computational cost compared to traditional GNNs, which have O(n) nodes per layer. b. While QCQP problems have applications across various industries, the experiments in this paper appear limited and address only small-scale examples. The authors could comment on this gap.
1. The authors represent QCQPs with tripartite graphs and prove that GNNs can predict the properties of convex QCQPs. 2. Counter examples are given to show that convexity is necessary.
1. The theoretical results are not surprising given existing works Chen et al. (2023a), Chen et al. (2023b), and Chen et al. (2024). In fact, the flow of the paper and the proof techniques are very similar to Chen et al. (2023a), Chen et al. (2023b), and Chen et al. (2024). 2. The numerical experiments are limited -- the instances have small sizes and the datasets are not general (they are perturbed from a few instances). __References:__ (Chen et al., 2023a) Ziang Chen, Jialin Liu, Xinshang W
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMachine Learning and Algorithms · Advanced Control Systems Optimization · Advanced Optimization Algorithms Research
