ResolvNet: A Graph Convolutional Network with multi-scale Consistency
Christian Koke, Abhishek Saroha, Yuesong Shen, Marvin Eisenberger,, Daniel Cremers

TL;DR
ResolvNet is a novel graph neural network architecture designed to maintain multi-scale consistency, effectively propagating information across complex graph structures and across different resolutions, outperforming existing models.
Contribution
The paper introduces ResolvNet, a new GNN architecture that ensures multi-scale consistency both at node and graph levels, addressing limitations of existing models.
Findings
ResolvNet achieves superior performance on multiple real-world tasks.
It rigorously guarantees multi-scale consistency theoretically.
Outperforms baseline models significantly in experiments.
Abstract
It is by now a well known fact in the graph learning community that the presence of bottlenecks severely limits the ability of graph neural networks to propagate information over long distances. What so far has not been appreciated is that, counter-intuitively, also the presence of strongly connected sub-graphs may severely restrict information flow in common architectures. Motivated by this observation, we introduce the concept of multi-scale consistency. At the node level this concept refers to the retention of a connected propagation graph even if connectivity varies over a given graph. At the graph-level, multi-scale consistency refers to the fact that distinct graphs describing the same object at different resolutions should be assigned similar feature vectors. As we show, both properties are not satisfied by poular graph neural network architectures. To remedy these shortcomings,…
Peer Reviews
Decision·Submitted to ICLR 2024
The idea of separating a network into multiple scales is nice. The problem is well defined and motivated The use of resolvents to design filters is novel. A theory is developed to justify the methods. The experimental results show the usefulness of the method.
1. It would be good if the authors could demonstrate the performance of their methods on synthetically generated graphs, say using stochastic block models. That would allow all parameters to be controlled. 2. It is not clearly defined how the two kinds of filters are combined: does a node learn which filter to use? 3. There are some other obvious baselines with which the authors could compare their methods: a. Apply pooling to learn the clusters (say using diffpool, gpool, eigenpooling among
*Originality*: The paper identifies a novel issue in graph neural networks and introduces an effective framework, ResolvNet, to address it. This represents a significant and innovative contribution to the field. *Quality*: The investigative experiments and primary results presented in the paper are persuasive. Supported by solid theoretical proofs, this work stands out as a high-quality piece of research. *Clarity*: The paper is exceptionally well-organized. Its straightforward and lucid prese
*Insufficient Analysis*: The paper could benefit from more extensive ablation studies and parameter analyses. Understanding how variations in parameters like $\omega$ and $k$, as defined in the ResolvNet Layer, impact the final results would provide deeper insights. *Complexity of Concepts*: The concept of "resolvents" is not a commonly understood mathematical idea. Providing more explanations, along with practical application cases, would greatly aid readers in grasping this concept and its si
1. This paper study multi-scale consistency (distinct graphs describing the same object at different resolutions should be assigned similar feature vectors) of node representation in graph neural network, which is indeed an important topic that is less well explored. 2. This paper provide a very clear definition on multi-scale consistency in Definition 2.1, and explain in great details (using both figures, text, and examples) to help readers understand why it is important. 3. The proposed met
1. Experiment dataset is small. This is potentially because the proposed method has very high complexity due to matrix inverse (see feed-forward rule in paragraph **The ResolvNet Layer**. The authors need to conduct experiment on larger datasets (e.g., OGBN) and report complexity in terms of FLOP/Wall-clock time. 2. Part of the discription is not very clear, please refer to Questions.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Graph Neural Networks · Neural Networks and Applications · Brain Tumor Detection and Classification
MethodsGraph Neural Network
