Neural Control Systems
Paolo Colusso, Damir Filipovi\'c

TL;DR
This paper introduces a control-theoretical approach to function learning using reproducing-kernel Hilbert spaces, deriving gradient-based optimization methods that are effective on toy and real-world problems.
Contribution
It presents a novel control-theoretic framework for function approximation, including gradient derivation and optimization techniques aligned with Pontryagin's maximum principle.
Findings
Gradient-based control optimization effectively learns functions from data.
Methods work on toy and real-world high-dimensional problems.
Approaches are versatile across different learning tasks.
Abstract
We propose a function-learning methodology with a control-theoretical foundation. We parametrise the approximating function as the solution to a control system on a reproducing-kernel Hilbert space, and propose several methods to find the set of controls which bring the initial function as close as possible to the target function. At first, we derive the expression for the gradient of the cost function with respect to the controls that parametrise the difference equations. This allows us to find the optimal controls by means of gradient descent. In addition, we show how to compute derivatives of the approximating functions with respect to the controls and describe two optimisation methods relying on linear approximations of the approximating functions. We show how the assumptions we make lead to results which are coherent with Pontryagin's maximum principle. We test the optimisation…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Applications
