Chasing the Echo State Property
Claudio Gallicchio

TL;DR
This paper investigates the stability of reservoir computing models under input-driven conditions, introducing an empirical index that broadens understanding of the Echo State Property's applicability.
Contribution
It introduces an empirical ESP index to analyze stability regimes of reservoirs, revealing a wider domain of ESP validity than previously recognized.
Findings
Empirical ESP index effectively assesses reservoir stability.
Input-driven reservoirs exhibit broader ESP validity domains.
Results on benchmark datasets provide new insights into reservoir dynamics.
Abstract
Reservoir Computing (RC) provides an efficient way for designing dynamical recurrent neural models. While training is restricted to a simple output component, the recurrent connections are left untrained after initialization, subject to stability constraints specified by the Echo State Property (ESP). Literature conditions for the ESP typically fail to properly account for the effects of driving input signals, often limiting the potentialities of the RC approach. In this paper, we study the fundamental aspect of asymptotic stability of RC models in presence of driving input, introducing an empirical ESP index that enables to easily analyze the stability regimes of reservoirs. Results on two benchmark datasets reveal interesting insights on the dynamical properties of input-driven reservoirs, suggesting that the actual domain of ESP validity is much wider than what covered by literature…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Reservoir Computing · Advanced Memory and Neural Computing · Neural Networks and Applications
MethodsHierarchical Feature Fusion · Dilated Convolution · Pointwise Convolution · Efficient Spatial Pyramid
