Dreaming is All You Need

• URL: http://arxiv.org/abs/2409.01633v3
• Date: Sun, 15 Sep 2024 12:17:03 GMT
• Title: Dreaming is All You Need
• Authors: Mingze Ni, Wei Liu,
• Abstract summary: This research introduces two novel deep learning models, SleepNet and DreamNet, to strike a balance between exploration and precision. SleepNet seamlessly integrates supervised learning with unsupervised sleep" stages using pre-trained encoder models. DreamNet employs full encoder-decoder frameworks to reconstruct the hidden states, mimicking the human "dreaming" process.
• Score: 6.706761900460658
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In classification tasks, achieving a harmonious balance between exploration and precision is of paramount importance. To this end, this research introduces two novel deep learning models, SleepNet and DreamNet, to strike this balance. SleepNet seamlessly integrates supervised learning with unsupervised ``sleep" stages using pre-trained encoder models. Dedicated neurons within SleepNet are embedded in these unsupervised features, forming intermittent ``sleep" blocks that facilitate exploratory learning. Building upon the foundation of SleepNet, DreamNet employs full encoder-decoder frameworks to reconstruct the hidden states, mimicking the human "dreaming" process. This reconstruction process enables further exploration and refinement of the learned representations. Moreover, the principle ideas of our SleepNet and DreamNet are generic and can be applied to both computer vision and natural language processing downstream tasks. Through extensive empirical evaluations on diverse image and text datasets, SleepNet and DreanNet have demonstrated superior performance compared to state-of-the-art models, showcasing the strengths of unsupervised exploration and supervised precision afforded by our innovative approaches.

Related papers

• MuDreamer: Learning Predictive World Models without Reconstruction [58.0159270859475]
  We present MuDreamer, a robust reinforcement learning agent that builds upon the DreamerV3 algorithm by learning a predictive world model without the need for reconstructing input signals. Our method achieves comparable performance on the Atari100k benchmark while benefiting from faster training.
  arXiv  Detail & Related papers  (2024-05-23T22:09:01Z)
• Visualizing Neural Network Imagination [2.1749194587826026]
  In certain situations, neural networks will represent environment states in their hidden activations. Our goal is to visualize what environment states the networks are representing. We define a quantitative interpretability metric and use it to demonstrate that hidden states can be highly interpretable.
  arXiv  Detail & Related papers  (2024-05-10T11:43:35Z)
• WaveSleepNet: An Interpretable Network for Expert-like Sleep Staging [4.4697567606459545]
  WaveSleepNet is an interpretable neural network for sleep staging. WaveSleepNet uses latent space representations to identify characteristic wave prototypes corresponding to different sleep stages. The efficacy of WaveSleepNet is validated across three public datasets.
  arXiv  Detail & Related papers  (2024-04-11T03:47:58Z)
• Seeing in Words: Learning to Classify through Language Bottlenecks [59.97827889540685]
  Humans can explain their predictions using succinct and intuitive descriptions. We show that a vision model whose feature representations are text can effectively classify ImageNet images.
  arXiv  Detail & Related papers  (2023-06-29T00:24:42Z)
• ImaginaryNet: Learning Object Detectors without Real Images and Annotations [66.30908705345973]
  We propose a framework to synthesize images by combining pretrained language model and text-to-image model. With the synthesized images and class labels, weakly supervised object detection can then be leveraged to accomplish Imaginary-Supervised Object Detection. Experiments show that ImaginaryNet can (i) obtain about 70% performance in ISOD compared with the weakly supervised counterpart of the same backbone trained on real data.
  arXiv  Detail & Related papers  (2022-10-13T10:25:22Z)
• Continual Learning, Fast and Slow [75.53144246169346]
  According to the Complementary Learning Systems theory, humans do effective emphcontinual learning through two complementary systems. We propose emphDualNets (for Dual Networks), a general continual learning framework comprising a fast learning system for supervised learning of specific tasks and a slow learning system for representation learning of task-agnostic general representation via Self-Supervised Learning (SSL) We demonstrate the promising results of DualNets on a wide range of continual learning protocols, ranging from the standard offline, task-aware setting to the challenging online, task-free scenario.
  arXiv  Detail & Related papers  (2022-09-06T10:48:45Z)
• Dreaming: Model-based Reinforcement Learning by Latent Imagination without Reconstruction [14.950054143767824]
  We propose a decoder-free extension of Dreamer, a leading model-based reinforcement learning (MBRL) method from pixels. We derive a likelihood-free and InfoMax objective of contrastive learning from the evidence lower bound of Dreamer. In comparison to Dreamer and other recent model-free reinforcement learning methods, our newly devised Dreamer with InfoMax and without generative decoder (Dreaming) achieves the best scores on 5 difficult simulated robotics tasks.
  arXiv  Detail & Related papers  (2020-07-29T00:14:40Z)
• Learning to learn generative programs with Memoised Wake-Sleep [52.439550543743536]
  We study a class of neuro-symbolic generative models in which neural networks are used both for inference and as priors over symbolic, data-generating programs. We propose the Memoised Wake-Sleep (MWS) algorithm, which extends Wake Sleep by explicitly storing and reusing the best programs discovered by the inference network throughout training.
  arXiv  Detail & Related papers  (2020-07-06T23:51:03Z)
• BiO-Net: Learning Recurrent Bi-directional Connections for Encoder-Decoder Architecture [82.64881585566825]
  We present a novel Bi-directional O-shape network (BiO-Net) that reuses the building blocks in a recurrent manner without introducing any extra parameters. Our method significantly outperforms the vanilla U-Net as well as other state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-07-01T05:07:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.