Discrete Graph Auto-Encoder
Yoann Boget, Magda Gregorova, Alexandros Kalousis

TL;DR
The paper introduces Discrete Graph Auto-Encoder (DGAE), a novel framework combining permutation-equivariant auto-encoding and auto-regressive modeling to improve graph distribution modeling.
Contribution
It proposes a new two-step graph auto-encoder that uses discrete latent representations and Transformer-based auto-regressive modeling, addressing limitations of existing methods.
Findings
Competitive performance across multiple datasets.
Effective use of discrete latent representations.
Validation through extensive ablation studies.
Abstract
Despite advances in generative methods, accurately modeling the distribution of graphs remains a challenging task primarily because of the absence of predefined or inherent unique graph representation. Two main strategies have emerged to tackle this issue: 1) restricting the number of possible representations by sorting the nodes, or 2) using permutation-invariant/equivariant functions, specifically Graph Neural Networks (GNNs). In this paper, we introduce a new framework named Discrete Graph Auto-Encoder (DGAE), which leverages the strengths of both strategies and mitigate their respective limitations. In essence, we propose a strategy in 2 steps. We first use a permutation-equivariant auto-encoder to convert graphs into sets of discrete latent node representations, each node being represented by a sequence of quantized vectors. In the second step, we sort the sets of discrete latent…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Graph Neural Networks · Graph Theory and Algorithms · Topic Modeling
MethodsAttention Is All You Need · Linear Layer · Byte Pair Encoding · Residual Connection · Dropout · Layer Normalization · Multi-Head Attention · Adam · Softmax · Dense Connections
