Multilayer Perceptron with Functional Inputs: an Inverse Regression Approach
Louis Ferr\'e (GRIMM), Nathalie Villa (GRIMM)

TL;DR
This paper introduces a novel approach combining functional sliced inverse regression with neural networks for regression and classification tasks involving functional data, providing theoretical consistency and real-world validation.
Contribution
It develops a regularized version of functional sliced inverse regression integrated with neural networks, advancing functional data analysis methods.
Findings
The method achieves competitive accuracy on real-life datasets.
Consistency results support the theoretical validity of the approach.
The approach effectively reduces dimensionality in functional data analysis.
Abstract
Functional data analysis is a growing research field as more and more practical applications involve functional data. In this paper, we focus on the problem of regression and classification with functional predictors: the model suggested combines an efficient dimension reduction procedure [functional sliced inverse regression, first introduced by Ferr\'e & Yao (Statistics, 37, 2003, 475)], for which we give a regularized version, with the accuracy of a neural network. Some consistency results are given and the method is successfully confronted to real-life data.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Biau et al. , (2005) Biau, G., Bunea, F., & Wegkamp, M. (2005). Functional classification in Hilbert spaces. IEEE Trans. Inform. Theory , 51 , 2163–2172.
- 2Bishop, (1995) Bishop, C. (1995). Neural Networks for Pattern Recognition . Oxford University Press, New York.
- 3Borggaard & Thodberg, (1992) Borggaard, C. & Thodberg, H. (1992). Optimal minimal neural interpretation of spectra. Analytical Chemistry , 64 , 545–551.
- 4Bosq, (1991) Bosq, D. (1991). Modelization, non-parametric estimation and prediction for continuous time processes, In Nonparametric functional estimation and related topics, Nato ASI Series C (ed. Roussas, G.), 335 , 509–529. Kluwer Academic Publishers, Dortrecht.
- 5Cardot et al. , (1999) Cardot, H., Ferraty, F., & Sarda, P. (1999). Functional Linear Model. Statist. Probab. Lett. , 45 , 11–22.
- 6Chen & Chen, (1995) Chen, T. & Chen, H. (1995). Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems. IEEE Transactions on Neural Networks , 6 (4), 911–917.
- 7Cook & Weisberg, (1991) Cook, R. & Weisberg, S. (1991). Comment on sliced inverse regression for dimension reduction by K.C. Li. J. Amer. Statist. Assoc. , 86 , 328–332.
- 8Dauxois et al. , (2001) Dauxois, J., Ferré, L., & Yao, A. (2001). Un modèle semi-paramétrique pour variable aléatoire hilbertienne. C. R. Math. Acad. Sci. Paris , 327 (I), 947–952.
