The neural networks with tensor weights and emergent fermionic Wick rules in the large-width limit
Guojun Huang, Kai Zhou

TL;DR
This paper explores complex-valued neural networks with tensor weights, revealing fermionic Wick rules and determinant structures in their correlation functions in the large-width limit, extending neural-network quantum field theory to include fermionic features.
Contribution
It introduces a novel extension of neural-network quantum field theory by incorporating tensor weights that induce fermionic sign structures in the large-width limit.
Findings
Fermionic Wick rules emerge in the correlation functions of tensor-weighted CVNNs.
Correlation functions can be expressed as determinants of a scalar Euclidean kernel.
The study extends NN-QFT to include fermion-like symmetries in neural architectures.
Abstract
In this paper, we study complex-valued neural network (CVNNs) with tensor-valued hidden-to-output weights within the framework of neural-network quantum field theory (NN-QFT). For standard CVNNs with scalar weights, we derive the generating functional and identify the exact Gaussian process that arises in the infinite-width limit, together with its associated effective quantum state. When the last-layer weights are promoted to Clifford-algebra-valued tensors, the network output becomes complex matrix-valued, and a fermion-like sign structure in the large-width correlation functions of the network output is induced. We show that, in the infinite-width limit, correlators with equal numbers of and obey fermionic Wick rules and can be written as determinants built from a scalar Euclidean kernel . This provides a sign-structured extension…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
