Neural networks that overcome classic challenges through practice

• URL: http://arxiv.org/abs/2410.10596v2
• Date: Sun, 15 Dec 2024 20:26:27 GMT
• Title: Neural networks that overcome classic challenges through practice
• Authors: Kazuki Irie, Brenden M. Lake,
• Abstract summary: We review recent work that uses metalearning to overcome several classic challenges by addressing the Problem of Incentive and Practice. We review applications of this principle to addressing four classic challenges for neural networks: systematic generalization, catastrophic forgetting, few-shot learning and multi-step reasoning.
• Score: 22.741266810854228
• License:
• Abstract: Since the earliest proposals for neural network models of the mind and brain, critics have pointed out key weaknesses in these models compared to human cognitive abilities. Here we review recent work that uses metalearning to overcome several classic challenges by addressing the Problem of Incentive and Practice -- that is, providing machines with both incentives to improve specific skills and opportunities to practice those skills. This explicit optimization contrasts with more conventional approaches that hope the desired behavior will emerge through optimizing related but different objectives. We review applications of this principle to addressing four classic challenges for neural networks: systematic generalization, catastrophic forgetting, few-shot learning and multi-step reasoning. We also discuss the prospects for understanding aspects of human development through this framework, and whether natural environments provide the right incentives and practice for learning how to make challenging generalizations.

Related papers

• How Vision-Language Tasks Benefit from Large Pre-trained Models: A Survey [59.23394353614928]
  In recent years, the rise of pre-trained models is driving the research on vision-language tasks. Inspired by the powerful capabilities of pre-trained models, new paradigms have emerged to solve the classic challenges.
  arXiv  Detail & Related papers  (2024-12-11T07:29:04Z)
• Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning [59.98430756337374]
  Supervised fine-tuning enhances the problem-solving abilities of language models across various mathematical reasoning tasks. Our work introduces a novel technique aimed at cultivating a deeper understanding of the training problems at hand. We propose reflective augmentation, a method that embeds problem reflection into each training instance.
  arXiv  Detail & Related papers  (2024-06-17T19:42:22Z)
• Avoiding Catastrophic Forgetting in Visual Classification Using Human Concept Formation [0.8159711103888622]
  We propose Cobweb4V, a novel visual classification approach that builds on Cobweb, a human like learning system. In this research, we conduct a comprehensive evaluation, showcasing the proficiency of Cobweb4V in learning visual concepts. These characteristics align with learning strategies in human cognition, positioning Cobweb4V as a promising alternative to neural network approaches.
  arXiv  Detail & Related papers  (2024-02-26T17:20:16Z)
• Towards Improving Robustness Against Common Corruptions using Mixture of Class Specific Experts [10.27974860479791]
  This paper introduces a novel paradigm known as the Mixture of Class-Specific Expert Architecture. The proposed architecture aims to mitigate vulnerabilities associated with common neural network structures.
  arXiv  Detail & Related papers  (2023-11-16T20:09:47Z)
• A Survey on Transferability of Adversarial Examples across Deep Neural Networks [53.04734042366312]
  adversarial examples can manipulate machine learning models into making erroneous predictions. The transferability of adversarial examples enables black-box attacks which circumvent the need for detailed knowledge of the target model. This survey explores the landscape of the adversarial transferability of adversarial examples.
  arXiv  Detail & Related papers  (2023-10-26T17:45:26Z)
• Learning Expressive Priors for Generalization and Uncertainty Estimation in Neural Networks [77.89179552509887]
  We propose a novel prior learning method for advancing generalization and uncertainty estimation in deep neural networks. The key idea is to exploit scalable and structured posteriors of neural networks as informative priors with generalization guarantees. We exhaustively show the effectiveness of this method for uncertainty estimation and generalization.
  arXiv  Detail & Related papers  (2023-07-15T09:24:33Z)
• Abrupt and spontaneous strategy switches emerge in simple regularised neural networks [8.737068885923348]
  We study whether insight-like behaviour can occur in simple artificial neural networks. Analyses of network architectures and learning dynamics revealed that insight-like behaviour crucially depended on a regularised gating mechanism. This suggests that insight-like behaviour can arise naturally from gradual learning in simple neural networks.
  arXiv  Detail & Related papers  (2023-02-22T12:48:45Z)
• Technical Challenges for Training Fair Neural Networks [62.466658247995404]
  We conduct experiments on both facial recognition and automated medical diagnosis datasets using state-of-the-art architectures. We observe that large models overfit to fairness objectives, and produce a range of unintended and undesirable consequences.
  arXiv  Detail & Related papers  (2021-02-12T20:36:45Z)
• Developing Constrained Neural Units Over Time [81.19349325749037]
  This paper focuses on an alternative way of defining Neural Networks, that is different from the majority of existing approaches. The structure of the neural architecture is defined by means of a special class of constraints that are extended also to the interaction with data. The proposed theory is cast into the time domain, in which data are presented to the network in an ordered manner.
  arXiv  Detail & Related papers  (2020-09-01T09:07:25Z)
• Revisit Systematic Generalization via Meaningful Learning [15.90288956294373]
  Recent studies argue that neural networks appear inherently ineffective in such cognitive capacity. We reassess the compositional skills of sequence-to-sequence models conditioned on the semantic links between new and old concepts.
  arXiv  Detail & Related papers  (2020-03-14T15:27:29Z)
• Neuro-evolutionary Frameworks for Generalized Learning Agents [1.2691047660244335]
  Recent successes of deep learning and deep reinforcement learning have firmly established their statuses as state-of-the-art artificial learning techniques. Longstanding drawbacks of these approaches point to a need for re-thinking the way such systems are designed and deployed. We discuss the anticipated improvements from such neuro-evolutionary frameworks, along with the associated challenges.
  arXiv  Detail & Related papers  (2020-02-04T02:11:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.