Data-Adaptive Graph Framelets with Generalized Vanishing Moments for Graph Machine Learning

TL;DR

This paper introduces a flexible, data-adaptive graph framelet framework with generalized vanishing moments, enabling sparse, efficient representations and improved learning on heterophilous graphs through optimized transforms and feature generation.

Contribution

It presents a novel, general construction of graph framelets with generalized vanishing moments, learned via optimization, and applies them to heterophilous graph learning for enhanced node classification.

Findings

Effective sparse representations for graph signals.

Improved node classification on heterophilous graphs.

Superior performance in denoising and approximation tasks.

Abstract

In this paper, we propose a general framework for constructing tight framelet systems on graphs with localized supports based on partition trees. Our construction of framelets provides a simple and efficient way to obtain the orthogonality with $k$ arbitrary orthonormal vectors. When the $k$ vectors contain most of the energy of a family of graph signals, the orthogonality of the framelets intuitively possesses ``generalized ($k$-)vanishing'' moments, and thus, the coefficients are sparse. Moreover, our construction provides not only framelets that are overall sparse vectors but also fast and schematically concise transforms. In a data-adaptive setting, the graph framelet systems can be learned by conducting optimizations on Stiefel manifolds to provide the utmost sparsity for a given family of graph signals. Furthermore, we further exploit the generality of our proposed graph framelet systems for heterophilous graph learning, where graphs are characterized by connecting nodes mainly from different classes. The usual assumption that connected nodes are similar and belong to the same class for homophilious graphs is contradictory for heterophilous graphs. Thus, we are motivated to bypass simple assumptions on heterophilous graphs and focus on generating rich node features induced by the graph structure, so as to improve the graph learning ability of certain neural networks in node classification. We derive a specific system of graph framelets and propose a heuristic method to select framelets as features for neural network input. Several experiments demonstrate the effectiveness and superiority of our approach for non-linear approximation, denoising, and node classification.