The Logical Expressiveness of Topological Neural Networks

TL;DR

This paper characterizes the logical expressiveness of topological neural networks (TNNs), revealing their capabilities through new higher-order isomorphism tests and a novel topological counting logic.

Contribution

It introduces the $k$-CCWL test and topological counting logic, establishing their equivalence and providing a formal expressiveness theory for TNNs.

Findings

$k$-CCWL test characterizes TNNs' expressiveness

Topological counting logic extends standard counting logic

Exact equivalence between $k$-CCWL, TC$_k$, and pebble game

Abstract

Graph neural networks (GNNs) are the standard for learning on graphs, yet they have limited expressive power, often expressed in terms of the Weisfeiler-Leman (WL) hierarchy or within the framework of first-order logic. In this context, topological neural networks (TNNs) have recently emerged as a promising alternative for graph representation learning. By incorporating higher-order relational structures into message-passing schemes, TNNs offer higher representational power than traditional GNNs. However, a fundamental question remains open: what is the logical expressiveness of TNNs? Answering this allows us to characterize precisely which binary classifiers TNNs can represent. In this paper, we address this question by analyzing isomorphism tests derived from the underlying mechanisms of general TNNs. We introduce and investigate the power of higher-order variants of WL-based tests for combinatorial complexes, called $k$-CCWL test. In addition, we introduce the topological counting logic (TC$_k$), an extension of standard counting logic featuring a novel pairwise counting quantifier $ \exists^{N}(x_i,x_j)\, \varphi(x_i,x_j), $ which explicitly quantifies pairs $(x_i, x_j)$ satisfying property $\varphi$. We rigorously prove the exact equivalence: $ \text{k-CCWL} \equiv \text{TC}_{k{+}2} \equiv \text{Topological }(k{+}2)\text{-pebble game}.$ These results establish a logical expressiveness theory for TNNs.