Graph-Based Operator Learning from Limited Data on Irregular Domains
Yile Li, Shandian Zhe

TL;DR
This paper introduces GOLA, a graph-based operator learning framework with attention and Fourier encoding, enabling effective PDE modeling on irregular domains with limited data.
Contribution
GOLA combines graph neural networks with attention mechanisms and Fourier encoding to handle irregular domains and sparse data in operator learning for PDEs.
Findings
Outperforms baselines on 2D PDEs with irregular sampling.
Shows strong generalization in data-scarce regimes.
Efficiently models complex spatial dependencies.
Abstract
Operator learning seeks to approximate mappings from input functions to output solutions, particularly in the context of partial differential equations (PDEs). While recent advances such as DeepONet and Fourier Neural Operator (FNO) have demonstrated strong performance, they often rely on regular grid discretizations, limiting their applicability to complex or irregular domains. In this work, we propose a Graph-based Operator Learning with Attention (GOLA) framework that addresses this limitation by constructing graphs from irregularly sampled spatial points and leveraging attention-enhanced Graph Neural Netwoks (GNNs) to model spatial dependencies with global information. To improve the expressive capacity, we introduce a Fourier-based encoder that projects input functions into a frequency space using learnable complex coefficients, allowing for flexible embeddings even with sparse or…
Peer Reviews
Decision·ICLR 2026 Conference Withdrawn Submission
Exploring additional architectures for neural operators, especially on irregular domains or with irregularly sampled discretizations, is an important area of research to further improve our ability to make surrogate models for PDE solution operators.
The paper claims that the method can be used for learning operators on irregular domains, however all experimental results are for rectangular domains. The sampling within these domains is not necessarily on a grid, but throughout the paper there is no evidence support any claims for irregular domains themselves. Not addressing irregular domains properly is also the cause for some incorrect theoretical arguments. In particular, the paper references the existence of the complex exponentials
The paper is presented in high clarity.
Regarding the experiments: 1. The baseline models are not SOTA, where the latest is AFNO, a work in 2021. The baseline should include some SOTA neural operators, e.g., Transolver [1]. 2. The author claimed generalization across sample densities and resolutions. However, the experiments are conducted only for GOLA. How about the baseline models? Is GOLA better at generalization across sample densities and resolutions, or worse? 3. On data efficiency, again, comparison should be made among baselin
1. **Learnable Fourier encoder on spatial graphs.** Turning inputs into a complex Fourier basis lets the model capture long-range/global interactions with few coefficients, while graph message passing refines local structure. Because of the learned frequencies, the model can generalize across resolutions (the spectral representation is not tied to a fixed grid). This also reduces aliasing artifacts compared with naïve coordinate MLPs and gives a compact, physics-plausible feature space for op
1. **Outdated or incomplete comparisons on irregular-domain PDE learning.** The related work and experimental baselines underrepresent recent approaches across **GNN** [1], **implicit neural representations (INR/SIREN/coordinate networks)** [2], and **Transformer-style neural operators** [3] tailored to unstructured meshes or scattered points. Without head-to-head evaluations against stronger and more recent models (e.g., graph/mesh operators with positional encodings, attention-based operato
1. The paper targets an important challenge: operator learning on irregular and sparse domains. 2. The writing is overall structured and readable.
1. Limited Novelty and Overlap with Existing Work - Both Fourier encoding and attention mechanisms have been extensively explored in the context of graph neural networks, including Fourier Feature Networks, Graph Attention Networks (GATs), and Graph Transformer networks (GTN). - The proposed combination in GOLA therefore appears incremental, as similar designs integrating spectral embeddings with attention-based message passing already exist in prior operator learning and geometric deep learning
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEducational Technology and Assessment · Advanced Graph Neural Networks · Neural Networks and Applications
MethodsSoftmax · Attention Is All You Need · Diffusion
