Language as a Wave Phenomenon: Semantic Phase Locking and Interference in Neural Networks

TL;DR

This paper introduces PRISM, a complex-valued neural encoder that relies on phase angles to encode semantic relationships, demonstrating robustness and specific conditions for effective semantic representation in neural networks.

Contribution

The paper presents PRISM, a novel complex-valued encoder that emphasizes phase information over magnitude, revealing how semantic relationships are encoded through phase coherence in neural networks.

Findings

Semantic relationships correlate with phase coherence.

Model maintains performance under scalar attenuation.

Minimum sequence length needed for coherent output.

Abstract

The role of phase in neural sequence models remains poorly understood. To isolate this question, we introduce PRISM, a complex-valued encoder that enforces a unit-norm constraint ($|z| = 1$) and replaces attention with gated spectral filtering. Under this constraint, the model cannot use activation magnitude to distinguish signal from noise, and must instead rely on phase angles. We find that semantic relationships correlate with measurable phase structure: synonym pairs exhibit significantly higher phase coherence than random pairs ($R = 0.198$ vs.\ $0.072$, $p < 0.001$), and the model resolves lexical ambiguity via layer-specific phase rotations while maintaining near-unit gain. These phase representations are robust to scalar attenuation, retaining $97\%$ of translation quality when signal magnitude is uniformly reduced. We also identify a spectral density threshold: the model fails to generate coherent output from isolated tokens, requiring minimum sequence length to produce the interference patterns that support its computation. Finally, we show that a hybrid architecture (Wave-Particle Transformer) combining a phase-based encoder with standard attention matches Transformer baselines at $33$M parameters with fewer non-embedding parameters, though we do not claim this generalizes to larger scales. Our findings provide controlled evidence that phase angles can encode semantic information in complex-valued networks, and characterize the conditions under which this encoding succeeds and fails.