Dream2Learn: Structured Generative Dreaming for Continual Learning

• URL: http://arxiv.org/abs/2603.01935v1
• Date: Mon, 02 Mar 2026 14:52:10 GMT
• Title: Dream2Learn: Structured Generative Dreaming for Continual Learning
• Abstract summary: We introduce Dream2Learn, a framework in which a model autonomously generates structured synthetic experiences from its own internal representations.<n>By integrating dreamed classes into continual training, D2L proactively structures latent features to support forward knowledge transfer and adaptation to future tasks.
• Score: 15.555279110364706
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Continual learning requires balancing plasticity and stability while mitigating catastrophic forgetting. Inspired by human dreaming as a mechanism for internal simulation and knowledge restructuring, we introduce Dream2Learn (D2L), a framework in which a model autonomously generates structured synthetic experiences from its own internal representations and uses them for self-improvement. Rather than reconstructing past data as in generative replay, D2L enables a classifier to create novel, semantically distinct dreamed classes that are coherent with its learned knowledge yet do not correspond to previously observed data. These dreamed samples are produced by conditioning a frozen diffusion model through soft prompt optimization driven by the classifier itself. The generated data are not used to replace memory, but to expand and reorganize the representation space, effectively allowing the network to self-train on internally synthesized concepts. By integrating dreamed classes into continual training, D2L proactively structures latent features to support forward knowledge transfer and adaptation to future tasks. This prospective self-training mechanism mirrors the role of sleep in consolidating and reorganizing memory, turning internal simulations into a tool for improved generalization. Experiments on Mini-ImageNet, FG-ImageNet, and ImageNet-R demonstrate that D2L consistently outperforms strong rehearsal-based baselines and achieves positive forward transfer, confirming its ability to enhance adaptability through internally generated training signals.

Related papers

• On the Importance of Gating: Memorization vs. In-Context Learning in State Space Models [50.824624057327725]
  State Space Models (SSMs) have emerged as a compelling alternative to Transformers.<n>We show through theory and experiments that this gating mechanism causes SSMs to first learn an in-weights "memorization" solution.<n>On the other hand, we find that gating is often beneficial for improving generalization to long sequence lengths.
  arXiv  Detail & Related papers  (2026-09-15T02:36:13Z)
• On the Plasticity Collapse in Continual Machine Unlearning [26.744674850970625]
  Machine unlearning enables networks to selectively remove the influence of specific data in response to privacy and regulatory requirements.<n>While prior work largely studies single-shot unlearning, real-world systems must accommodate continual unlearning.<n>We show that continual unlearning operations accumulate geometric constraints in parameter space, leading to saturated subspaces that restrict future updates.
  arXiv  Detail & Related papers  (2026-08-30T02:33:40Z)
• Explicit Kinematic Guidance from Analytic Concepts for Vision-Language-Action Models [67.98329043920803]
  Current Vision-Language-Action (VLA) models rely mainly on 2D inputs, neglecting the rich object structural information and commonsense knowledge inherent in the 3D physical world.<n>This deficiency restricts their spatial awareness and adaptability for complex, high-precision manipulation.<n>We construct a Concept Expert module for VLA to build executable Analytic Concepts that represent objects as explicit, programmatic blueprints.
  arXiv  Detail & Related papers  (2026-07-29T06:24:25Z)
• Modular Memory is the Key to Continual Learning Agents [100.09688599754465]
  We argue that combining the strengths of In-Weight Learning (IWL) and the newly emerged capabilities of In-Context Learning (ICL) through the design of modular memory is the missing piece for continual adaptation at scale.<n>We outline a conceptual framework for modular memory-centric architectures that leverage ICL for rapid adaptation and knowledge accumulation, and IWL for stable updates to model capabilities.
  arXiv  Detail & Related papers  (2026-03-02T11:40:05Z)
• Synergizing Understanding and Generation with Interleaved Analyzing-Drafting Thinking [154.2388970262703]
  Unified Vision-Language Models (UVLMs) aim to advance multimodal learning by supporting both understanding and generation within a single framework.<n>We introduce the interleaved Analyzing-Drafting problem-solving loop (AD-Loop), a new think paradigm that alternates between analytic and drafting operations.<n>By interleaving textual thoughts with visual thoughts, AD-Loop enables models to iteratively refine both comprehension and outputs, fostering genuine synergy.
  arXiv  Detail & Related papers  (2026-02-24T23:26:09Z)
• Arcadia: Toward a Full-Lifecycle Framework for Embodied Lifelong Learning [80.6669596031697]
  We introduce Arcadia, a closed-loop framework that operationalizes embodied lifelong learning by tightly coupling four stages.<n> Arcadia delivers consistent gains on navigation and manipulation benchmarks and transfers robustly to physical robots.
  arXiv  Detail & Related papers  (2025-11-25T07:26:00Z)
• From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learning [59.88543114325153]
  We introduce the Seeing-to-Experiencing framework to scale the capability of navigation foundation models with reinforcement learning.<n>S2E combines the strengths of pre-training on videos and post-training through RL.<n>We establish a comprehensive end-to-end evaluation benchmark, NavBench-GS, built on photorealistic 3DGS reconstructions of real-world scenes.
  arXiv  Detail & Related papers  (2025-07-29T17:26:10Z)
• A Neural Network Model of Complementary Learning Systems: Pattern Separation and Completion for Continual Learning [2.9123921488295768]
  Learning new information without forgetting prior knowledge is central to human intelligence.<n>In contrast, neural network models suffer from catastrophic forgetting when acquiring new information.<n>We develop a neurally plausible continual learning model that achieves close to state-of-the-art accuracy (90%)<n>Our work provides a functional template for modeling memory consolidation, generalization, and continual learning in both biological and artificial systems.
  arXiv  Detail & Related papers  (2025-07-15T15:05:26Z)
• KPFlow: An Operator Perspective on Dynamic Collapse Under Gradient Descent Training of Recurrent Networks [9.512147747894026]
  We show how a gradient flow can be decomposed into a product that involves two operators.<n>We show how their interplay gives rise to low-dimensional latent dynamics under GD.<n>For multi-task training, we show that the operators can be used to measure how objectives relevant to individual sub-tasks align.
  arXiv  Detail & Related papers  (2025-07-08T20:33:15Z)
• DDAE++: Enhancing Diffusion Models Towards Unified Generative and Discriminative Learning [53.27049077100897]
  generative pre-training has been shown to yield discriminative representations, paving the way towards unified visual generation and understanding.<n>This work introduces self-conditioning, a mechanism that internally leverages the rich semantics inherent in denoising network to guide its own decoding layers.<n>Results are compelling: our method boosts both generation FID and recognition accuracy with 1% computational overhead and generalizes across diverse diffusion architectures.
  arXiv  Detail & Related papers  (2025-05-16T08:47:16Z)
• MuDreamer: Learning Predictive World Models without Reconstruction [58.0159270859475]
  We present MuDreamer, a robust reinforcement learning agent that builds upon the DreamerV3 algorithm by learning a predictive world model without the need for reconstructing input signals. Our method achieves comparable performance on the Atari100k benchmark while benefiting from faster training.
  arXiv  Detail & Related papers  (2024-05-23T22:09:01Z)
• Wake-Sleep Consolidated Learning [9.596781985154927]
  We propose Wake-Sleep Consolidated Learning to improve the performance of deep neural networks for visual classification tasks. Our method learns continually via the synchronization between distinct wake and sleep phases. We evaluate the effectiveness of our approach on three benchmark datasets.
  arXiv  Detail & Related papers  (2023-12-06T18:15:08Z)
• Dual Cognitive Architecture: Incorporating Biases and Multi-Memory Systems for Lifelong Learning [21.163070161951868]
  We introduce Dual Cognitive Architecture (DUCA), which includes multiple sub-systems, implicit and explicit knowledge representation, inductive bias, and a multi-memory system. DUCA shows improvement across different settings and datasets, and it also exhibits reduced task recency bias, without the need for extra information. To further test the versatility of lifelong learning methods on a challenging distribution shift, we introduce a novel domain-incremental dataset DN4IL.
  arXiv  Detail & Related papers  (2023-10-17T15:24:02Z)
• SELF: Self-Evolution with Language Feedback [68.6673019284853]
  'SELF' (Self-Evolution with Language Feedback) is a novel approach to advance large language models. It enables LLMs to self-improve through self-reflection, akin to human learning processes. Our experiments in mathematics and general tasks demonstrate that SELF can enhance the capabilities of LLMs without human intervention.
  arXiv  Detail & Related papers  (2023-10-01T00:52:24Z)
• Cognitively Inspired Learning of Incremental Drifting Concepts [31.3178953771424]
  Inspired by the nervous system learning mechanisms, we develop a computational model that enables a deep neural network to learn new concepts. Our model can generate pseudo-data points for experience replay and accumulate new experiences to past learned experiences without causing cross-task interference.
  arXiv  Detail & Related papers  (2021-10-09T23:26:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.