Optoelectronic recurrent neural network using optical-electrical-optical converters with RC delay

TL;DR

This paper demonstrates through simulation that RC delay in optoelectronic RNNs with OEO converters can compensate for loop losses, maintaining high accuracy in time-series classification even at large scales.

Contribution

It introduces a novel understanding that RC delay can be exploited to offset loop losses in OE-RNNs, enabling high-performance large-scale optical time-series processing.

Findings

RC delay does not degrade RNN performance, can improve it.

High training accuracy achieved up to 32×32 scale.

Theoretical analysis identifies conditions for optimal performance.

Abstract

Optical neural network (ONN) has been attracting intense attention owing to their low latency and low-power consumption. Among the ONNs, optical recurrent neural network (RNN) enables low-power and high-speed time-series data processing using a compact loop structure. The loop losses need to be efficiently compensated so that the time-series information is maintained in the RNN operation. For this purpose, we focus on the optoelectronic RNN (OE-RNN) with optical-electrical-optical (OEO) converters to compensate for the loop losses. However, the effect of resistive-capacitive (RC) delay of OEO converters on the RNN performance is unclear. Here, we study in simulation an OE-RNN equipped with OEO converters with RC delay. We confirm that our modeled OE-RNN achieves the high training accuracy of time-series data classification even when RC delay is comparably large to the time interval of time-series data. Our analyses reveal that the accumulation of time-series data by RC delay does not degrade the RNN performance but rather can compensate for the degraded RNN performance due to loop losses. From the theoretical analysis referring to the gradient explosion and vanishing problems, we find the region related to loss and RC delay where the high training accuracy can be achieved. In simulation, we confirm this compensation effect in the large OE-RNN circuit up to 32$\times$32 scale. Our proposed scheme opens a new way of time-series data processing by utilizing RC delay for the optical computing and optical communication.