Modeling the Repetition-based Recovering of Acoustic and Visual Sources with Dendritic Neurons

• URL: http://arxiv.org/abs/2201.06123v1
• Date: Sun, 16 Jan 2022 19:35:59 GMT
• Title: Modeling the Repetition-based Recovering of Acoustic and Visual Sources with Dendritic Neurons
• Authors: Giorgia Dellaferrera, Toshitake Asabuki, Tomoki Fukai
• Abstract summary: In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. We propose a biologically inspired computational model to perform blind source separation on sequences of mixtures of acoustic stimuli.
• Score: 5.306881553301636
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In natural auditory environments, acoustic signals originate from the temporal superimposition of different sound sources. The problem of inferring individual sources from ambiguous mixtures of sounds is known as blind source decomposition. Experiments on humans have demonstrated that the auditory system can identify sound sources as repeating patterns embedded in the acoustic input. Source repetition produces temporal regularities that can be detected and used for segregation. Specifically, listeners can identify sounds occurring more than once across different mixtures, but not sounds heard only in a single mixture. However, whether such a behaviour can be computationally modelled has not yet been explored. Here, we propose a biologically inspired computational model to perform blind source separation on sequences of mixtures of acoustic stimuli. Our method relies on a somatodendritic neuron model trained with a Hebbian-like learning rule which can detect spatio-temporal patterns recurring in synaptic inputs. We show that the segregation capabilities of our model are reminiscent of the features of human performance in a variety of experimental settings involving synthesized sounds with naturalistic properties. Furthermore, we extend the study to investigate the properties of segregation on task settings not yet explored with human subjects, namely natural sounds and images. Overall, our work suggests that somatodendritic neuron models offer a promising neuro-inspired learning strategy to account for the characteristics of the brain segregation capabilities as well as to make predictions on yet untested experimental settings.

Related papers

• A Reservoir-based Model for Human-like Perception of Complex Rhythm Pattern [4.7368661961661775]
  We propose a hierarchical oscillator-based model to better understand the perception of complex musical rhythms in biological systems. We evaluate the model using several representative rhythm patterns spanning the upper, middle, and lower bounds of human musical perception. Our findings demonstrate that, while maintaining a high degree of synchronization accuracy, the model exhibits human-like rhythmic behaviours.
  arXiv  Detail & Related papers  (2025-03-16T14:02:42Z)
• Don't Cut Corners: Exact Conditions for Modularity in Biologically Inspired Representations [52.48094670415497]
  We develop a theory of when biologically inspired representations modularise with respect to source variables (sources) We derive necessary and sufficient conditions on a sample of sources that determine whether the neurons in an optimal biologically-inspired linear autoencoder modularise. Our theory applies to any dataset, extending far beyond the case of statistical independence studied in previous work.
  arXiv  Detail & Related papers  (2024-10-08T17:41:37Z)
• Stimulus-to-Stimulus Learning in RNNs with Cortical Inductive Biases [0.0]
  We propose a recurrent neural network model of stimulus substitution using two forms of inductive bias pervasive in the cortex. We show that the model generates a wide array of conditioning phenomena, and can learn large numbers of associations with an amount of training. Our framework highlights the importance of multi-compartment neuronal processing in the cortex, and showcases how it might confer cortical animals the evolutionary edge.
  arXiv  Detail & Related papers  (2024-09-20T13:01:29Z)
• Individualized Dosing Dynamics via Neural Eigen Decomposition [51.62933814971523]
  We introduce the Neural Eigen Differential Equation algorithm (NESDE) NESDE provides individualized modeling, tunable generalization to new treatment policies, and fast, continuous, closed-form prediction. We demonstrate the robustness of NESDE in both synthetic and real medical problems, and use the learned dynamics to publish simulated medical gym environments.
  arXiv  Detail & Related papers  (2023-06-24T17:01:51Z)
• Analyzing Diffusion as Serial Reproduction [12.389541192789167]
  Diffusion models learn to synthesize samples by inverting a diffusion process that gradually maps data into noise. Our work highlights how classic paradigms in cognitive science can shed light on state-of-the-art machine learning problems.
  arXiv  Detail & Related papers  (2022-09-29T14:35:28Z)
• Successes and critical failures of neural networks in capturing human-like speech recognition [1.1602089225841632]
  Speech recognition is inherently robust in humans to a number transformations at various spectrotemporal granularities. We evaluate state-of-the-art neural networks as stimulus-computable, optimized observers.
  arXiv  Detail & Related papers  (2022-04-06T06:35:10Z)
• Dependency-based Mixture Language Models [53.152011258252315]
  We introduce the Dependency-based Mixture Language Models. In detail, we first train neural language models with a novel dependency modeling objective. We then formulate the next-token probability by mixing the previous dependency modeling probability distributions with self-attention.
  arXiv  Detail & Related papers  (2022-03-19T06:28:30Z)
• EEGminer: Discovering Interpretable Features of Brain Activity with Learnable Filters [72.19032452642728]
  We propose a novel differentiable EEG decoding pipeline consisting of learnable filters and a pre-determined feature extraction module. We demonstrate the utility of our model towards emotion recognition from EEG signals on the SEED dataset and on a new EEG dataset of unprecedented size. The discovered features align with previous neuroscience studies and offer new insights, such as marked differences in the functional connectivity profile between left and right temporal areas during music listening.
  arXiv  Detail & Related papers  (2021-10-19T14:22:04Z)
• The Neural Coding Framework for Learning Generative Models [91.0357317238509]
  We propose a novel neural generative model inspired by the theory of predictive processing in the brain. In a similar way, artificial neurons in our generative model predict what neighboring neurons will do, and adjust their parameters based on how well the predictions matched reality.
  arXiv  Detail & Related papers  (2020-12-07T01:20:38Z)
• Automatic Recall Machines: Internal Replay, Continual Learning and the Brain [104.38824285741248]
  Replay in neural networks involves training on sequential data with memorized samples, which counteracts forgetting of previous behavior caused by non-stationarity. We present a method where these auxiliary samples are generated on the fly, given only the model that is being trained for the assessed objective. Instead the implicit memory of learned samples within the assessed model itself is exploited.
  arXiv  Detail & Related papers  (2020-06-22T15:07:06Z)
• Learning to infer in recurrent biological networks [4.56877715768796]
  We argue that the cortex may learn with an adversarial algorithm. We illustrate the idea on recurrent neural networks trained to model image and video datasets.
  arXiv  Detail & Related papers  (2020-06-18T19:04:47Z)
• Bio-Inspired Modality Fusion for Active Speaker Detection [1.0644456464343592]
  This paper presents a methodology for fusing correlated auditory and visual information for active speaker detection. The ability can have a wide range of applications, from teleconferencing systems to social robotics.
  arXiv  Detail & Related papers  (2020-02-28T20:56:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.