ReLU Networks for Exact Generation of Similar Graphs

TL;DR

This paper presents a theoretical framework for ReLU neural networks that can deterministically generate graphs within a specified edit distance from a source graph, ensuring validity without training data.

Contribution

It introduces the first known ReLU network architecture with provable guarantees for generating valid graphs within a bounded edit distance from a source graph.

Findings

Networks can generate graphs with up to 1400 vertices within the specified edit distance.

The proposed networks operate with constant depth and O(n^2 d) size.

Baseline models fail to meet the edit distance constraints.

Abstract

Generation of graphs constrained by a specified graph edit distance from a source graph is important in applications such as cheminformatics, network anomaly synthesis, and structured data augmentation. Despite the growing demand for such constrained generative models in areas including molecule design and network perturbation analysis, the neural architectures required to provably generate graphs within a bounded graph edit distance remain largely unexplored. In addition, existing graph generative models are predominantly data-driven and depend heavily on the availability and quality of training data, which may result in generated graphs that do not satisfy the desired edit distance constraints. In this paper, we address these challenges by theoretically characterizing ReLU neural networks capable of generating graphs within a prescribed graph edit distance from a given graph. In particular, we show the existence of constant depth and O(n^2 d) size ReLU networks that deterministically generate graphs within edit distance d from a given input graph with n vertices, eliminating reliance on training data while guaranteeing validity of the generated graphs. Experimental evaluations demonstrate that the proposed network successfully generates valid graphs for instances with up to 1400 vertices and edit distance bounds up to 140, whereas baseline generative models fail to generate graphs with the desired edit distance. These results provide a theoretical foundation for constructing compact generative models with guaranteed validity.