Minimizing the Effect of Sleep Deprivation in the Forward-Forward Algorithm

• URL: http://arxiv.org/abs/2609.06042v1
• Date: Sat, 05 Sep 2026 11:54:27 GMT
• Title: Minimizing the Effect of Sleep Deprivation in the Forward-Forward Algorithm
• Abstract summary: Previous research has demonstrated that sleep deprivation in the Forward-Forward algorithm has a catastrophic effect on learning efficacy.<n>To mitigate this issue, we explore several approaches; these include alternative activation, optimized loss function, and threshold tuning.<n>We additionally investigate the potential of caffeine-induced stimulation to enhance performance during sleep-deprived conditions.
• Score: 1.2752808844888015
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper addresses the challenge posed by sleep deprivation in the Forward-Forward algorithm, where separating the two passes in this algorithm and imbalancing the data processing in the passes is considered an imitation of the cognitive processes observed in humans suffering from sleep deprivation. Previous research has demonstrated that sleep deprivation in the Forward-Forward algorithm has a catastrophic effect on learning efficacy. To mitigate this issue, we explore several approaches; these include alternative activation, optimized loss function, and threshold tuning. To simulate periodic rest, we reduce the number of positive passes in alternating epochs, creating short break phases. We additionally investigate the potential of caffeine-induced stimulation to enhance performance during sleep-deprived conditions. Experimental evaluations conducted on the MNIST and Fashion-MNIST datasets demonstrate that these modifications improve accuracy under the context of sleep deprivation. For example, a 2%-62% accuracy gain is observed in a severe sleep deprivation setting (16 positive or awake periods and 1 negative or sleep period). The approaches also enhance the resilience of the algorithm and its alignment with the adaptive mechanisms of human cognition.

Related papers

• DeepBlip: Estimating Conditional Average Treatment Effects Over Time [48.20988325299593]
  We propose DeepBlip, the first neural framework for structural nested mean models (SNMMs)<n>Our method correctly adjusts for time-varying confounding to produce unbiased estimates, and its Neyman-orthogonal loss function ensures robustness to nuisance model misspecification.
  arXiv  Detail & Related papers  (2025-11-18T14:49:03Z)
• NapTune: Efficient Model Tuning for Mood Classification using Previous Night's Sleep Measures along with Wearable Time-series [20.901278227023585]
  Sleep is known to be a key factor in emotional regulation and overall mental health. In this study, we explore the integration of sleep measures from the previous night into wearable-based mood recognition. We propose NapTune, a novel prompt-tuning framework that utilizes sleep-related measures as additional inputs to a frozen pre-trained wearable time-series encoder.
  arXiv  Detail & Related papers  (2024-09-07T06:06:04Z)
• Sleep Deprivation in the Forward-Forward Algorithm [2.7195102129095003]
  We show the size of the gap between the sleep and awake phase influences the learning capabilities of the algorithm. We highlight the importance of negative data in diminishing the devastating effects of sleep deprivation.
  arXiv  Detail & Related papers  (2023-10-28T09:09:44Z)
• SI-SD: Sleep Interpreter through awake-guided cross-subject Semantic Decoding [5.283755248013948]
  We design a novel cognitive neuroscience experiment and collect a comprehensive, well-annotated electroencephalography (EEG) dataset from 134 subjects during both wakefulness and sleep. We develop SI-SD that enhances sleep semantic decoding through the position-wise alignment of neural latent sequence between wakefulness and sleep.
  arXiv  Detail & Related papers  (2023-09-28T14:06:34Z)
• A machine-learning sleep-wake classification model using a reduced number of features derived from photoplethysmography and activity signals [0.0]
  Photoplethys (mography) has been demonstrated to be an effective signal for sleep stage inference. In this work, we present a machine learning sleep-wake classification model based on the eXtreme Gradient Boosting algorithm. The performance of our method was comparable to current state-of-the-art methods with a Sensitivity of 91.15 $pm$ 1.16%, Specificity of 53.66 $pm$ 1.12%, F1-score of 83.88 $pm$ 0.56%, and Kappa of 48.0 $pm$ 0.86%.
  arXiv  Detail & Related papers  (2023-08-07T13:43:19Z)
• Sleep Activity Recognition and Characterization from Multi-Source Passively Sensed Data [67.60224656603823]
  Sleep Activity Recognition methods can provide indicators to assess, monitor, and characterize subjects' sleep-wake cycles and detect behavioral changes. We propose a general method that continuously operates on passively sensed data from smartphones to characterize sleep and identify significant sleep episodes. Thanks to their ubiquity, these devices constitute an excellent alternative data source to profile subjects' biorhythms in a continuous, objective, and non-invasive manner.
  arXiv  Detail & Related papers  (2023-01-17T15:18:45Z)
• Heterogeneous Hidden Markov Models for Sleep Activity Recognition from Multi-Source Passively Sensed Data [67.60224656603823]
  Psychiatric patients' passive activity monitoring is crucial to detect behavioural shifts in real-time. Sleep Activity Recognition constitutes a behavioural marker to portray patients' activity cycles. Mobile passively sensed data captured from smartphones constitute an excellent alternative to profile patients' biorhythm.
  arXiv  Detail & Related papers  (2022-11-08T17:29:40Z)
• Continual learning benefits from multiple sleep mechanisms: NREM, REM, and Synaptic Downscaling [51.316408685035526]
  Learning new tasks and skills in succession without losing prior learning is a computational challenge for both artificial and biological neural networks. Here, we investigate how modeling three distinct components of mammalian sleep together affects continual learning in artificial neural networks.
  arXiv  Detail & Related papers  (2022-09-09T13:45:27Z)
• Sleep syndromes onset detection based on automatic sleep staging algorithm [0.0]
  A Fast Fourier Transform is applied to 30 seconds long epochs of EEG recordings to provide localized time-frequency information. A deep convolutional LSTM neural network is trained for sleep stage classification. The code evaluation showed impressive results, reaching an accuracy of 86.43, precision of 77.76, recall of 93,32, F1-score of 89.12 with the final mean false error loss of 0.09.
  arXiv  Detail & Related papers  (2021-07-07T15:38:47Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)
• The Break-Even Point on Optimization Trajectories of Deep Neural Networks [64.7563588124004]
  We argue for the existence of the "break-even" point on this trajectory. We show that using a large learning rate in the initial phase of training reduces the variance of the gradient. We also show that using a low learning rate results in bad conditioning of the loss surface even for a neural network with batch normalization layers.
  arXiv  Detail & Related papers  (2020-02-21T22:55:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.