A GREAT Architecture for Edge-Based Graph Problems Like TSP
Attila Lischka, Filip Rydin, Jiaming Wu, Morteza Haghir Chehreghani, Bal\'azs Kulcs\'ar

TL;DR
This paper introduces GREAT, a graph neural network architecture designed for edge-based routing problems, capable of handling both Euclidean and non-Euclidean costs, and demonstrates its effectiveness on various vehicle routing problems.
Contribution
The paper presents a novel GNN model called GREAT that effectively addresses non-Euclidean routing problems, expanding the applicability of learning-based approaches.
Findings
GREAT achieves competitive results on non-Euclidean routing problems.
The framework successfully handles both Euclidean and non-Euclidean variants.
It is among the first to address non-Euclidean vehicle routing problems with learning-based methods.
Abstract
In the last years, an increasing number of learning-based approaches have been proposed to tackle combinatorial optimization problems such as routing problems. Many of these approaches are based on graph neural networks (GNNs) or related transformers, operating on the Euclidean coordinates representing the routing problems. However, such models are ill-suited for a wide range of real-world problems that feature non-Euclidean and asymmetric edge costs. To overcome this limitation, we propose a novel GNN-based and edge-focused neural model called Graph Edge Attention Network (GREAT). Using GREAT as an encoder to capture the properties of a routing problem instance, we build a reinforcement learning framework which we apply to both Euclidean and non-Euclidean variants of vehicle routing problems such as Traveling Salesman Problem, Capacitated Vehicle Routing Problem and Orienteering…
Peer Reviews
Decision·ICLR 2025 Conference Withdrawn Submission
* The paper addresses tasks on non-sparse graphs for which the majority of GNNs are not well suited * The paper is clear and well organized, with nice illustrations in Fig 3 and 4 of the idea of the edge-based message passing
* There have been many variations of combining GNNs with Transformers, the paper cites some (Sec 2.2) and the proposed architecture ia slight variation of existing ones. * Missing important references/baselines: * [1] solves the same edge classification task with excellent performance on the euclidian TSP. Since this is the same setting as in Sec 4.1, it should be used as a learning-based baseline, as well as the cited [Joshi et al 2019] * [2] addresses the asymetric TSP with a combinatio
Pros: The topic is machine learning for combinatorial optimization(CO). Unlike general ML use cases, CO is challenging even for modern deep learning models. Investigating challenging use cases like CO is noteworthy to envelope the machine learning techniques.
Cons: After carefully reading the paper, my concerns are with the technique, the experiments and the presentation. First, I use the following bullet points to summarize my concerns on the technique: - I understand that the authors intend to emphasize their empirical contributions. However, I didn't see much novelty in the idea of "edge-attention". I understand that it seems reasonable for edge-centric problems like TSP, but my major question is: what distinguishes the proposed model from the no
There is little works for coordinate-free TSP solver. So the work is a highly original one based on GNN, which is proved to work on the problem. The proposed GNN, GREAT, is a node-free GNN, different from previous GNNs. Though designed for the coordinate-free TSP, the work might have some inspirations for researchers of GNN from other fields to explore new application scenarios of GNNs.
1. The model scalability is not demonstrated. Experiments are run on instances of no more than 100 nodes. The methods needs to be run on more than 1000 nodes to demonstrate the scalability. 2. The claim of “state-of-the-art” in the abstract might be over-claiming. Reasons are listed as follows: a. Some recent works, e.g. GLOP, have also achieved to surpass MatNet on ATSP. Since the comparison with these works are inaccessible, it is very hard to claim that GREAT achieves state-of-the-art. b.
The motivation is well demonstrated and reasonable. GREAT addresses the limitations of traditional GNNs, which are not well-suited for dense graphs and suffer from over-smoothing issues. The model operates on edges rather than nodes, making it ideal for tasks where edge selection is crucial. The authors evaluates GREAT in a supervised setting for edge classification in TSP and a reinforcement learning framework based on GREAT that achieves good performance on asymmetric TSP distributions.
1. The main experimental evaluation is limited and incomplete. **1) Task level.** If the authors claim GREAT to be a new GNN architecture aimed at edge-based problems, it is expected that the model should be evaluated on more classic edge-level graph tasks such as link prediction and edge classification, similar to what GAT did in its paper. **2) Model level.** If the authors intend to specifically focus on combinatorial optimization (CO) problems on graphs, especially (A)TSP, there are numerous
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGraph Theory and Algorithms · Constraint Satisfaction and Optimization · Data Management and Algorithms
MethodsSoftmax · Attention Is All You Need
