Memories in the Making: Predicting Video Memorability with Encoding
Phase EEG
- URL: http://arxiv.org/abs/2309.16704v1
- Date: Wed, 16 Aug 2023 22:39:27 GMT
- Title: Memories in the Making: Predicting Video Memorability with Encoding
Phase EEG
- Authors: Lorin Sweeney and Graham Healy and Alan F. Smeaton
- Abstract summary: This study delves into the elusive "moment of memorability"
By transforming subjects' encoding phase electroencephalography (EEG) signals into the visual domain, we investigate the neural signatures that underpin this moment.
Our findings support the involvement of theta band oscillations over the right temporal lobe in the encoding of declarative memory.
- Score: 2.2124795371148616
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In a world of ephemeral moments, our brain diligently sieves through a
cascade of experiences, like a skilled gold prospector searching for precious
nuggets amidst the river's relentless flow. This study delves into the elusive
"moment of memorability" -- a fleeting, yet vital instant where experiences are
prioritised for consolidation in our memory. By transforming subjects' encoding
phase electroencephalography (EEG) signals into the visual domain using
scaleograms and leveraging deep learning techniques, we investigate the neural
signatures that underpin this moment, with the aim of predicting
subject-specific recognition of video. Our findings not only support the
involvement of theta band (4-8Hz) oscillations over the right temporal lobe in
the encoding of declarative memory, but also support the existence of a
distinct moment of memorability, akin to the gold nuggets that define our
personal river of experiences.
Related papers
- Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks [59.38765771221084]
We present a physiologically inspired speech recognition architecture compatible and scalable with deep learning frameworks.
We show end-to-end gradient descent training leads to the emergence of neural oscillations in the central spiking neural network.
Our findings highlight the crucial inhibitory role of feedback mechanisms, such as spike frequency adaptation and recurrent connections, in regulating and synchronising neural activity to improve recognition performance.
arXiv Detail & Related papers (2024-04-22T09:40:07Z) - Wake-Sleep Consolidated Learning [9.596781985154927]
We propose Wake-Sleep Consolidated Learning to improve the performance of deep neural networks for visual classification tasks.
Our method learns continually via the synchronization between distinct wake and sleep phases.
We evaluate the effectiveness of our approach on three benchmark datasets.
arXiv Detail & Related papers (2023-12-06T18:15:08Z) - Saliency-Guided Hidden Associative Replay for Continual Learning [13.551181595881326]
Continual Learning is a burgeoning domain in next-generation AI, focusing on training neural networks over a sequence of tasks akin to human learning.
This paper presents the Saliency Guided Hidden Associative Replay for Continual Learning.
This novel framework synergizes associative memory with replay-based strategies. SHARC primarily archives salient data segments via sparse memory encoding.
arXiv Detail & Related papers (2023-10-06T15:54:12Z) - Memory in Plain Sight: Surveying the Uncanny Resemblances of Associative Memories and Diffusion Models [65.08133391009838]
generative process of Diffusion Models (DMs) has recently set state-of-the-art on many AI generation benchmarks.
We introduce a novel perspective to describe DMs using the mathematical language of memory retrieval from the field of energy-based Associative Memories (AMs)
We present a growing body of evidence that records DMs exhibiting empirical behavior we would expect from AMs, and conclude by discussing research opportunities that are revealed by understanding DMs as a form of energy-based memory.
arXiv Detail & Related papers (2023-09-28T17:57:09Z) - Egocentric Audio-Visual Object Localization [51.434212424829525]
We propose a geometry-aware temporal aggregation module to handle the egomotion explicitly.
The effect of egomotion is mitigated by estimating the temporal geometry transformation and exploiting it to update visual representations.
It improves cross-modal localization robustness by disentangling visually-indicated audio representation.
arXiv Detail & Related papers (2023-03-23T17:43:11Z) - A Deep Learning Approach for the Segmentation of Electroencephalography
Data in Eye Tracking Applications [56.458448869572294]
We introduce DETRtime, a novel framework for time-series segmentation of EEG data.
Our end-to-end deep learning-based framework brings advances in Computer Vision to the forefront.
Our model generalizes well in the task of EEG sleep stage segmentation.
arXiv Detail & Related papers (2022-06-17T10:17:24Z) - Shared memories driven by the intrinsic memorability of items [0.0]
Recent work has revealed a strong sway of the visual world itself in influencing what we remember and forget.
Research has revealed that the brain is sensitive to memorability both rapidly and automatically during late perception.
arXiv Detail & Related papers (2021-04-14T16:03:27Z) - Deep Recurrent Encoder: A scalable end-to-end network to model brain
signals [122.1055193683784]
We propose an end-to-end deep learning architecture trained to predict the brain responses of multiple subjects at once.
We successfully test this approach on a large cohort of magnetoencephalography (MEG) recordings acquired during a one-hour reading task.
arXiv Detail & Related papers (2021-03-03T11:39:17Z) - Predicting the Transition from Short-term to Long-term Memory based on
Deep Neural Network [1.4502611532302039]
We aim to predict long-term memory using deep neural networks.
spectral power of EEG signals of remembered items in short-term memory was calculated.
We show that long-term memory can be predicted with measured EEG signals during short-term memory.
arXiv Detail & Related papers (2020-12-07T08:00:35Z) - A Prospective Study on Sequence-Driven Temporal Sampling and Ego-Motion
Compensation for Action Recognition in the EPIC-Kitchens Dataset [68.8204255655161]
Action recognition is one of the top-challenging research fields in computer vision.
ego-motion recorded sequences have become of important relevance.
The proposed method aims to cope with it by estimating this ego-motion or camera motion.
arXiv Detail & Related papers (2020-08-26T14:44:45Z) - Neural Oscillations for Encoding and Decoding Declarative Memory using
EEG Signals [1.713291434132985]
This study investigates neural oscillations changes related to memory process.
For encoding phase, there was a significant decrease of power in low beta, high beta bands over fronto-central area.
For decoding phase, only significant decreases of alpha power were observed over fronto-central area.
arXiv Detail & Related papers (2020-02-04T04:53:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.