Advancing Out-of-Distribution Detection via Local Neuroplasticity
Alessandro Canevaro, Julian Schmidt, Mohammad Sajad Marvi, Hang Yu,, Georg Martius, Julian Jordan

TL;DR
This paper introduces a novel out-of-distribution detection method using Kolmogorov-Arnold Networks' local neuroplasticity, outperforming existing techniques in image and medical data benchmarks.
Contribution
It proposes leveraging KANs' local plasticity for OOD detection, a novel approach that improves robustness and performance over traditional methods.
Findings
Superior OOD detection accuracy on benchmark datasets
Enhanced robustness in medical and image domains
Demonstrated effectiveness of local neuroplasticity in KANs
Abstract
In the domain of machine learning, the assumption that training and test data share the same distribution is often violated in real-world scenarios, requiring effective out-of-distribution (OOD) detection. This paper presents a novel OOD detection method that leverages the unique local neuroplasticity property of Kolmogorov-Arnold Networks (KANs). Unlike traditional multilayer perceptrons, KANs exhibit local plasticity, allowing them to preserve learned information while adapting to new tasks. Our method compares the activation patterns of a trained KAN against its untrained counterpart to detect OOD samples. We validate our approach on benchmarks from image and medical domains, demonstrating superior performance and robustness compared to state-of-the-art techniques. These results underscore the potential of KANs in enhancing the reliability of machine learning systems in diverse…
Peer Reviews
Decision·ICLR 2025 Poster
The described method is clearly defined and is easy to reproduce. The method is validated across image and tabular medical data benchmarks, demonstrating improved performance and robustness compared to other state-of-the-art OOD detectors. The findings highlight KANs' potential in enhancing model reliability across diverse environments by maintaining high detection accuracy, even with a relatively small training dataset. The results (although not on all datasets) look promising in terms of d
Despite the clarity, some steps of the approach implementation look like ad-hoc tricks for improving the method’s performance without developing a deep intuition why a particular step is better than alternatives (please, see questions below for details). The fact that not all datasets (leaderboards) from the OpenOOD were used for testing the approach, along with the obtained not perfect results on CIFAR-100, suggest that the datasets were selected manually. The authors need to prove absence of
1. It introduces an innovative approach to OOD detection, offering fresh ideas and a unique viewpoint that advances the current understanding of OOD detection techniques. 2. The paper effectively harness the neuroplasticity characteristic of KANs, ensuring that learning new tasks only affects the network regions activated by the training data, effective motivation for OOD detection. 3. The paper includes thorough experiments on standard benchmarks.
1. While the core idea is clear, the method appears loosely structured. Specifically, the role of multiplying location-specific information with regions activated by InD samples to achieve the delta function (used in the score function) is unclear (e.g., Eqn 5). Additionally, no study is provided to analyze these aspects, leaving parts of the methodology unexplored. 2. The paper does not present or discuss the generalization performance of models when KANs are incorporated into the training sche
+ The topic is very relevant. + The idea is novel and quite intuitive. + The results are motivating. Even though this is not the best performing all around, it is one of the top algorithms. + Authors do a great job explaining the method as well as motivating the approach. + Large set of experiments.
- The model - due to KANs - is heavily univariate. While authors do dataset partitioning to alleviate the problem, I do not see how they can actually do so. Unsupervised combinations of features are mentioned, however, their applicability also raises questions. - Partitioning the dataset requires having multiple trained models, which limits the applicability of the approach for large scale problems. - KANs are interesting but most recent work do not use these networks. This naturally
Code & Models
Videos
Taxonomy
TopicsMachine Learning and Algorithms · Adversarial Robustness in Machine Learning
Methods+ ( 1 ) ⟷ 805 ⟷ ( 330 ) ⟷ 4056|How do I file a complaint with Expedia?
