From Psychological Curiosity to Artificial Curiosity: Curiosity-Driven Learning in Artificial Intelligence Tasks

• URL: http://arxiv.org/abs/2201.08300v1
• Date: Thu, 20 Jan 2022 17:07:03 GMT
• Title: From Psychological Curiosity to Artificial Curiosity: Curiosity-Driven Learning in Artificial Intelligence Tasks
• Authors: Chenyu Sun, Hangwei Qian and Chunyan Miao
• Abstract summary: Psychological curiosity plays a significant role in human intelligence to enhance learning through exploration and information acquisition. In the Artificial Intelligence (AI) community, artificial curiosity provides a natural intrinsic motivation for efficient learning. CDL has become increasingly popular, where agents are self-motivated to learn novel knowledge.
• Score: 56.20123080771364
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Psychological curiosity plays a significant role in human intelligence to enhance learning through exploration and information acquisition. In the Artificial Intelligence (AI) community, artificial curiosity provides a natural intrinsic motivation for efficient learning as inspired by human cognitive development; meanwhile, it can bridge the existing gap between AI research and practical application scenarios, such as overfitting, poor generalization, limited training samples, high computational cost, etc. As a result, curiosity-driven learning (CDL) has become increasingly popular, where agents are self-motivated to learn novel knowledge. In this paper, we first present a comprehensive review on the psychological study of curiosity and summarize a unified framework for quantifying curiosity as well as its arousal mechanism. Based on the psychological principle, we further survey the literature of existing CDL methods in the fields of Reinforcement Learning, Recommendation, and Classification, where both advantages and disadvantages as well as future work are discussed. As a result, this work provides fruitful insights for future CDL research and yield possible directions for further improvement.

Related papers

• Bridging Neuroscience and AI: Environmental Enrichment as a Model for Forward Knowledge Transfer [0.0]
  We suggest that environmental enrichment (EE) can be used as a biological model for studying forward transfer. EE refers to animal studies that enhance cognitive, social, motor, and sensory stimulation. We discuss how artificial neural networks (ANNs) can be used to predict neural changes after enriched experiences.
  arXiv  Detail & Related papers  (2024-05-12T14:33:50Z)
• Visual Knowledge in the Big Model Era: Retrospect and Prospect [63.282425615863]
  Visual knowledge is a new form of knowledge representation that can encapsulate visual concepts and their relations in a succinct, comprehensive, and interpretable manner. As the knowledge about the visual world has been identified as an indispensable component of human cognition and intelligence, visual knowledge is poised to have a pivotal role in establishing machine intelligence.
  arXiv  Detail & Related papers  (2024-04-05T07:31:24Z)
• A Neuro-mimetic Realization of the Common Model of Cognition via Hebbian Learning and Free Energy Minimization [55.11642177631929]
  Large neural generative models are capable of synthesizing semantically rich passages of text or producing complex images. We discuss the COGnitive Neural GENerative system, such an architecture that casts the Common Model of Cognition.
  arXiv  Detail & Related papers  (2023-10-14T23:28:48Z)
• Advancing Perception in Artificial Intelligence through Principles of Cognitive Science [6.637438611344584]
  We focus on the cognitive functions of perception, which is the process of taking signals from one's surroundings as input, and processing them to understand the environment. We present a collection of methods in AI for researchers to build AI systems inspired by cognitive science.
  arXiv  Detail & Related papers  (2023-10-13T01:21:55Z)
• Incremental procedural and sensorimotor learning in cognitive humanoid robots [52.77024349608834]
  This work presents a cognitive agent that can learn procedures incrementally. We show the cognitive functions required in each substage and how adding new functions helps address tasks previously unsolved by the agent. Results show that this approach is capable of solving complex tasks incrementally.
  arXiv  Detail & Related papers  (2023-04-30T22:51:31Z)
• Machine Psychology [54.287802134327485]
  We argue that a fruitful direction for research is engaging large language models in behavioral experiments inspired by psychology. We highlight theoretical perspectives, experimental paradigms, and computational analysis techniques that this approach brings to the table. It paves the way for a "machine psychology" for generative artificial intelligence (AI) that goes beyond performance benchmarks.
  arXiv  Detail & Related papers  (2023-03-24T13:24:41Z)
• Deep Active Learning for Computer Vision: Past and Future [50.19394935978135]
  Despite its indispensable role for developing AI models, research on active learning is not as intensive as other research directions. By addressing data automation challenges and coping with automated machine learning systems, active learning will facilitate democratization of AI technologies.
  arXiv  Detail & Related papers  (2022-11-27T13:07:14Z)
• A Novel Multimodal Approach for Studying the Dynamics of Curiosity in Small Group Learning [2.55061802822074]
  We propose an integrated socio-cognitive account of curiosity that ties observable behaviors in peers to underlying curiosity states. We make a bipartite distinction between individual and interpersonal functions that contribute to curiosity, and multimodal behaviors that fulfill these functions. This work is a step towards designing learning technologies that can recognize and evoke moment-by-moment curiosity during learning in social contexts.
  arXiv  Detail & Related papers  (2022-04-01T16:12:40Z)
• The growth and form of knowledge networks by kinesthetic curiosity [0.39325957466009187]
  We show how network science, statistical physics, and philosophy can be integrated into an approach that coheres with and expands the psychological of specific-diversive and perceptual-epistemic curiosity. The kinesthetic model of curiosity offers a vibrant counterpart to the deliberative predictions of model-based reinforcement learning.
  arXiv  Detail & Related papers  (2020-06-04T15:30:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.