All-Optical Deep Learning with Quantum Nonlinearity

TL;DR

This paper introduces an all-optical deep learning system utilizing quantum emitters in nanophotonic structures, achieving high nonlinearity and significantly lower power consumption for AI tasks.

Contribution

It presents a novel quantum nonlinear optical neural network architecture with physics-aware training, enabling complex tasks and reducing power needs by seven orders of magnitude.

Findings

Successfully demonstrated nonlinear classification and reinforcement learning in all-optical neural networks.

Achieved operation at power levels below nanowatt per square micrometer, vastly reducing energy consumption.

Showed that optical power for large models scales sublinearly, enabling watt-level operation.

Abstract

The rapid scaling of deep neural networks comes at the cost of unsustainable power consumption. While optical neural networks offer an alternative, their capabilities remain constrained by the lack of efficient optical nonlinearities. To address this, we propose an all-optical deep learning architecture by embedding quantum emitters in inverse-designed nanophotonic structures. Due to their saturability, quantum emitters exhibit exceptionally strong nonlinearity compared with conventional materials. Using physics-aware training, we demonstrate that the proposed architecture can solve complex tasks, including nonlinear classification and reinforcement learning, which have not been realized in all-optical neural networks. To enable fair comparison across different platforms, we introduce a framework that quantitatively links nonlinearity to a network's expressive power. Analysis shows that our quantum activation, operating below nW/{\mu}m^2 intensity, reduces the power budget by seven orders of magnitude. System-level estimates show that the optical power required for large language models scales sublinearly with model size, enabling watt-level operation. Our results indicate that quantum nanophotonics provides a route toward sustainable AI inference.