Modeling the Repetition-based Recovering of Acoustic and Visual Sources with Dendritic Neurons

TL;DR

This paper introduces a biologically inspired neuron model that can separate overlapping acoustic and visual sources by detecting recurring patterns, mimicking human auditory segregation abilities and extending to natural sounds and images.

Contribution

The study presents a novel somatodendritic neuron model with Hebbian learning for blind source separation, bridging computational modeling with human auditory perception.

Findings

Model replicates human-like sound segregation performance

Effective on synthesized and naturalistic sounds and images

Offers neuro-inspired insights into sensory processing

Abstract

In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. Source repetition produces temporal regularities that can be detected and used for segregation. Specifically, listeners can identify sounds occurring more than once across different mixtures, but not sounds heard only in a single mixture. However, whether such a behaviour can be computationally modelled has not yet been explored. Here, we propose a biologically inspired computational model to perform blind source separation on sequences of mixtures of acoustic stimuli. Our method relies on a somatodendritic neuron model trained with a Hebbian-like learning rule which can detect spatio-temporal patterns recurring in synaptic inputs. We show that the segregation capabilities of our model are reminiscent of the features of human performance in a variety of experimental settings involving synthesized sounds with naturalistic properties. Furthermore, we extend the study to investigate the properties of segregation on task settings not yet explored with human subjects, namely natural sounds and images. Overall, our work suggests that somatodendritic neuron models offer a promising neuro-inspired learning strategy to account for the characteristics of the brain segregation capabilities as well as to make predictions on yet untested experimental settings.