Seamless Optical Cloud Computing across Edge-Metro Network for Generative AI

TL;DR

This paper introduces an optical cloud computing system that operates across edge-metro networks, significantly reducing energy consumption and enabling complex generative AI tasks through parallel optical processing.

Contribution

It presents a novel optical cloud computing architecture that seamlessly integrates with edge-metro networks and demonstrates substantial energy efficiency improvements.

Findings

Energy efficiency of 118.6 mW/TOPs achieved

Reduces power consumption by two orders of magnitude

Supports complex generative AI models via parallel optical computing

Abstract

The rapid advancement of generative artificial intelligence (AI) in recent years has profoundly reshaped modern lifestyles, necessitating a revolutionary architecture to support the growing demands for computational power. Cloud computing has become the driving force behind this transformation. However, it consumes significant power and faces computation security risks due to the reliance on extensive data centers and servers in the cloud. Reducing power consumption while enhancing computational scale remains persistent challenges in cloud computing. Here, we propose and experimentally demonstrate an optical cloud computing system that can be seamlessly deployed across edge-metro network. By modulating inputs and models into light, a wide range of edge nodes can directly access the optical computing center via the edge-metro network. The experimental validations show an energy efficiency of 118.6 mW/TOPs (tera operations per second), reducing energy consumption by two orders of magnitude compared to traditional electronic-based cloud computing solutions. Furthermore, it is experimentally validated that this architecture can perform various complex generative AI models through parallel computing to achieve image generation tasks.