Noise-robust chemical reaction networks training artificial neural networks

TL;DR

This paper introduces a noise-robust chemical reaction network that performs neural network training and inference using smooth activation functions, ensuring stability and accuracy in biochemical computing despite reaction noise.

Contribution

It proposes a unified CRN model with smooth activation functions for both feed-forward and training, enhancing noise robustness and stability in biochemical neural networks.

Findings

CRN maintains accuracy under reaction noise

CRN is insensitive to reaction time and noise magnitude

Effective on XOR, Iris, MNIST, and non-linear regression tasks

Abstract

Artificial neural networks (NNs) can be implemented using chemical reaction networks (CRNs), where the concentrations of species act as inputs and outputs. In such biochemical computing, noise-robust computing is crucial due to the intrinsic and extrinsic noise present in chemical reactions. Previously suggested CRNs for feed-forward networks often utilized the rectified linear unit (ReLU) or discrete activation functions. However, one concern in this case is the discontinuities of the derivatives of those non-smooth functions, which can cause significant noise disruption during backpropagation. In this study, we propose a CRN that performs both feed-forward and training processes using smooth activation functions to avoid discontinuities in the backpropagation. All reactions occur in a single pot, and the reactions for training are bimolecular. Our case studies on XOR, Iris, MNIST datasets, and a non-linear regression model demonstrate that computation via the CRN (i) maintains accuracy despite noise in the reaction rates and the concentration of species and (ii) is insensitive to the choice of the running time and the magnitude of the noise in comparison to NNs with a non-smooth activation function. This work presents a noise-robust CRN for full NN computation, including backpropagation, paving the way for more stable and efficient biochemical computing systems.