Semantically-correlated memories in a dense associative model

• URL: http://arxiv.org/abs/2404.07123v3
• Date: Sun, 2 Jun 2024 08:29:45 GMT
• Title: Semantically-correlated memories in a dense associative model
• Authors: Thomas F Burns,
• Abstract summary: I introduce a novel associative memory model named Correlated Associative Memory (CDAM) CDAM integrates both auto- and hetero-association in a unified framework for continuous-valued memory patterns. It is theoretically and numerically analysed, revealing four distinct dynamical modes.
• Score: 2.7195102129095003
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: I introduce a novel associative memory model named Correlated Dense Associative Memory (CDAM), which integrates both auto- and hetero-association in a unified framework for continuous-valued memory patterns. Employing an arbitrary graph structure to semantically link memory patterns, CDAM is theoretically and numerically analysed, revealing four distinct dynamical modes: auto-association, narrow hetero-association, wide hetero-association, and neutral quiescence. Drawing inspiration from inhibitory modulation studies, I employ anti-Hebbian learning rules to control the range of hetero-association, extract multi-scale representations of community structures in graphs, and stabilise the recall of temporal sequences. Experimental demonstrations showcase CDAM's efficacy in handling real-world data, replicating a classical neuroscience experiment, performing image retrieval, and simulating arbitrary finite automata.

Related papers

• Temporal Model On Quantum Logic [0.0]
  The framework formalizes the evolution of propositions over time using linear and branching temporal models. The hierarchical organization of memory is represented using directed acyclic graphs.
  arXiv  Detail & Related papers  (2025-02-09T17:16:53Z)
• Firing Rate Models as Associative Memory: Excitatory-Inhibitory Balance for Robust Retrieval [3.961279440272764]
  Firing rate models are dynamical systems widely used in applied and theoretical neuroscience to describe local cortical dynamics in neuronal populations. We propose a general framework that ensures the emergence of re-scaled memory patterns as stable equilibria in the firing rate dynamics. We analyze the conditions under which the memories are locally and globally stable, providing insights into constructing biologically-plausible and robust systems for associative memory retrieval.
  arXiv  Detail & Related papers  (2024-11-11T21:40:57Z)
• AM-MTEEG: Multi-task EEG classification based on impulsive associative memory [6.240145569484483]
  We propose a multi-task (MT) classification model, called AM-MTEEG, inspired by the principles of learning and memory in the human hippocampus. The model treats the EEG classification of each individual as an independent task and facilitates feature sharing across individuals. Experimental results in two BCI competition datasets show that our model improves average accuracy compared to state-of-the-art models.
  arXiv  Detail & Related papers  (2024-09-27T01:33:45Z)
• Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
  In this study, we first construct the brain-effective network via the dynamic causal model. We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE) This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
  arXiv  Detail & Related papers  (2024-05-21T20:37:07Z)
• Exploring Homogeneous and Heterogeneous Consistent Label Associations for Unsupervised Visible-Infrared Person ReID [57.500045584556794]
  We introduce a Modality-Unified Label Transfer (MULT) module that simultaneously accounts for both homogeneous and heterogeneous fine-grained instance-level structures. The proposed MULT ensures that the generated pseudo-labels maintain alignment across modalities while upholding structural consistency within intra-modality. Experiments demonstrate that our proposed method outperforms existing state-of-the-art USL-VI-ReID methods.
  arXiv  Detail & Related papers  (2024-02-01T15:33:17Z)
• Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration [50.62725807357586]
  This article presents a general Bayesian learning framework for multi-modal groupwise image registration. We propose a novel hierarchical variational auto-encoding architecture to realise the inference procedure of the latent variables. Experiments were conducted to validate the proposed framework, including four different datasets from cardiac, brain, and abdominal medical images.
  arXiv  Detail & Related papers  (2024-01-04T08:46:39Z)
• End-to-end Differentiable Clustering with Associative Memories [23.618514621460694]
  Clustering is a widely used unsupervised learning technique involving an intensive discrete optimization problem. We propose a novel unconstrained continuous relaxation of the discrete clustering problem, enabling end-to-end differentiable clustering with AM, dubbed ClAM. Our evaluations on varied datasets demonstrate that ClAM benefits from the self-supervision, and significantly improves upon both the traditional Lloyd's k-means algorithm, and more recent continuous clustering relaxations (by upto 60% in terms of the Silhouette Coefficient)
  arXiv  Detail & Related papers  (2023-06-05T19:34:36Z)
• Controllable Mind Visual Diffusion Model [58.83896307930354]
  Brain signal visualization has emerged as an active research area, serving as a critical interface between the human visual system and computer vision models. We propose a novel approach, referred to as Controllable Mind Visual Model Diffusion (CMVDM) CMVDM extracts semantic and silhouette information from fMRI data using attribute alignment and assistant networks. We then leverage a control model to fully exploit the extracted information for image synthesis, resulting in generated images that closely resemble the visual stimuli in terms of semantics and silhouette.
  arXiv  Detail & Related papers  (2023-05-17T11:36:40Z)
• On the Relationship Between Variational Inference and Auto-Associative Memory [68.8204255655161]
  We study how different neural network approaches to variational inference can be applied in this framework. We evaluate the obtained algorithms on the CIFAR10 and CLEVR image datasets and compare them with other associative memory models.
  arXiv  Detail & Related papers  (2022-10-14T14:18:47Z)
• Identification of brain states, transitions, and communities using functional MRI [0.5872014229110214]
  We propose a Bayesian model-based characterization of latent brain states and showcase a novel method based on posterior predictive discrepancy. Our results obtained through an analysis of task-fMRI data show appropriate lags between external task demands and change-points between brain states.
  arXiv  Detail & Related papers  (2021-01-26T08:10:00Z)
• Robust Finite Mixture Regression for Heterogeneous Targets [70.19798470463378]
  We propose an FMR model that finds sample clusters and jointly models multiple incomplete mixed-type targets simultaneously. We provide non-asymptotic oracle performance bounds for our model under a high-dimensional learning framework. The results show that our model can achieve state-of-the-art performance.
  arXiv  Detail & Related papers  (2020-10-12T03:27:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.