Heterophily-Agnostic Hypergraph Neural Networks with Riemannian Local Exchanger

TL;DR

This paper introduces HealHGNN, a heterophily-agnostic hypergraph neural network leveraging Riemannian geometry to model long-range dependencies, achieving state-of-the-art results on diverse hypergraph datasets.

Contribution

It proposes a novel Riemannian geometry-based message passing mechanism with adaptive local heat exchangers for heterophily-agnostic hypergraph learning.

Findings

Achieves state-of-the-art performance on heterophilic hypergraphs

Effectively models long-range dependencies in hypergraphs

Provides theoretical guarantees for heterophily-agnostic message passing

Abstract

Hypergraphs are the natural description of higher-order interactions among objects, widely applied in social network analysis, cross-modal retrieval, etc. Hypergraph Neural Networks (HGNNs) have become the dominant solution for learning on hypergraphs. Traditional HGNNs are extended from message passing graph neural networks, following the homophily assumption, and thus struggle with the prevalent heterophilic hypergraphs that call for long-range dependence modeling. In this paper, we achieve heterophily-agnostic message passing through the lens of Riemannian geometry. The key insight lies in the connection between oversquashing and hypergraph bottleneck within the framework of Riemannian manifold heat flow. Building on this, we propose the novel idea of locally adapting the bottlenecks of different subhypergraphs. The core innovation of the proposed mechanism is the design of an adaptive local (heat) exchanger. Specifically, it captures the rich long-range dependencies via the Robin condition, and preserves the representation distinguishability via source terms, thereby enabling heterophily-agnostic message passing with theoretical guarantees. Based on this theoretical foundation, we present a novel Heat-Exchanger with Adaptive Locality for Hypergraph Neural Network (HealHGNN), designed as a node-hyperedge bidirectional systems with linear complexity in the number of nodes and hyperedges. Extensive experiments on both homophilic and heterophilic cases show that HealHGNN achieves the state-of-the-art performance.