The Algonauts Project 2021 Challenge: How the Human Brain Makes Sense of a World in Motion

• URL: http://arxiv.org/abs/2104.13714v1
• Date: Wed, 28 Apr 2021 11:38:31 GMT
• Title: The Algonauts Project 2021 Challenge: How the Human Brain Makes Sense of a World in Motion
• Authors: R.M. Cichy, K. Dwivedi, B. Lahner, A. Lascelles, P. Iamshchinina, M. Graumann, A. Andonian, N.A.R. Murty, K. Kay, G. Roig, A. Oliva
• Abstract summary: We release the 2021 edition of the Algonauts Project Challenge: How the Human Brain Makes Sense of a World in Motion. We provide whole-brain fMRI responses recorded while 10 human participants viewed a rich set of over 1,000 short video clips depicting everyday events. The goal of the challenge is to accurately predict brain responses to these video clips.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The sciences of natural and artificial intelligence are fundamentally connected. Brain-inspired human-engineered AI are now the standard for predicting human brain responses during vision, and conversely, the brain continues to inspire invention in AI. To promote even deeper connections between these fields, we here release the 2021 edition of the Algonauts Project Challenge: How the Human Brain Makes Sense of a World in Motion (http://algonauts.csail.mit.edu/). We provide whole-brain fMRI responses recorded while 10 human participants viewed a rich set of over 1,000 short video clips depicting everyday events. The goal of the challenge is to accurately predict brain responses to these video clips. The format of our challenge ensures rapid development, makes results directly comparable and transparent, and is open to all. In this way it facilitates interdisciplinary collaboration towards a common goal of understanding visual intelligence. The 2021 Algonauts Project is conducted in collaboration with the Cognitive Computational Neuroscience (CCN) conference.

Related papers

• Decoding Linguistic Representations of Human Brain [21.090956290947275]
  We present a taxonomy of brain-to-language decoding of both textual and speech formats. This work integrates two types of research: neuroscience focusing on language understanding and deep learning-based brain decoding.
  arXiv  Detail & Related papers  (2024-07-30T07:55:44Z)
• AI for Mathematics: A Cognitive Science Perspective [86.02346372284292]
  Mathematics is one of the most powerful conceptual systems developed and used by the human species. Rapid progress in AI, particularly propelled by advances in large language models (LLMs), has sparked renewed, widespread interest in building such systems.
  arXiv  Detail & Related papers  (2023-10-19T02:00:31Z)
• Digital twin brain: a bridge between biological intelligence and artificial intelligence [12.55159053727258]
  We propose the Digital Twin Brain (DTB) as a transformative platform that bridges the gap between biological and artificial intelligence. The DTB consists of three core elements: the brain structure that is fundamental to the twinning process, bottom-layer models to generate brain functions, and its wide spectrum of applications.
  arXiv  Detail & Related papers  (2023-08-03T03:36:22Z)
• The Algonauts Project 2023 Challenge: UARK-UAlbany Team Solution [21.714597774964194]
  This work presents our solutions to the Algonauts Project 2023 Challenge. The primary objective of the challenge revolves around employing computational models to anticipate brain responses. We constructed an image-based brain encoder through a two-step training process to tackle this challenge.
  arXiv  Detail & Related papers  (2023-08-01T03:46:59Z)
• Mindstorms in Natural Language-Based Societies of Mind [110.05229611910478]
  Minsky's "society of mind" and Schmidhuber's "learning to think" inspire diverse societies of large multimodal neural networks (NNs) Recent implementations of NN-based societies of minds consist of large language models (LLMs) and other NN-based experts communicating through a natural language interface. In these natural language-based societies of mind (NLSOMs), new agents -- all communicating through the same universal symbolic language -- are easily added in a modular fashion.
  arXiv  Detail & Related papers  (2023-05-26T16:21:25Z)
• The Brain Tumor Segmentation (BraTS) Challenge: Local Synthesis of Healthy Brain Tissue via Inpainting [50.01582455004711]
  For brain tumor patients, the image acquisition time series typically starts with an already pathological scan. Many algorithms are designed to analyze healthy brains and provide no guarantee for images featuring lesions. Examples include, but are not limited to, algorithms for brain anatomy parcellation, tissue segmentation, and brain extraction. Here, the participants explore inpainting techniques to synthesize healthy brain scans from lesioned ones.
  arXiv  Detail & Related papers  (2023-05-15T20:17:03Z)
• A Neurodiversity-Inspired Solver for the Abstraction \& Reasoning Corpus (ARC) Using Visual Imagery and Program Synthesis [6.593059418464748]
  We propose a new AI approach to core knowledge that combines visual representations of core knowledge inspired by human mental imagery abilities. We demonstrate our system's performance on the very difficult Abstraction & Reasoning (ARC) challenge. We share experimental results from publicly available ARC items as well as from our 4th-place finish on the private test set during the 2022 global ARCathon challenge.
  arXiv  Detail & Related papers  (2023-02-18T21:30:44Z)
• The Algonauts Project 2023 Challenge: How the Human Brain Makes Sense of Natural Scenes [0.0]
  We introduce the 2023 installment of the Algonauts Project challenge: How the Human Brain Makes Sense of Natural Scenes. This installment prompts the fields of artificial and biological intelligence to come together towards building computational models of the visual brain. The challenge is open to all and makes results directly comparable and transparent through a public leaderboard automatically updated after each submission.
  arXiv  Detail & Related papers  (2023-01-09T08:27:36Z)
• Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs [77.88043871260466]
  We show that one of today's largest language models lacks this kind of social intelligence out-of-the box. We conclude that person-centric NLP approaches might be more effective towards neural Theory of Mind.
  arXiv  Detail & Related papers  (2022-10-24T14:58:58Z)
• IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 2022 [63.07251290802841]
  We propose IGLU: Interactive Grounded Language Understanding in a Collaborative Environment. The primary goal of the competition is to approach the problem of how to develop interactive embodied agents. This research challenge is naturally related, but not limited, to two fields of study that are highly relevant to the NeurIPS community.
  arXiv  Detail & Related papers  (2022-05-27T06:12:48Z)
• NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environment [71.11505407453072]
  We propose IGLU: Interactive Grounded Language Understanding in a Collaborative Environment. The primary goal of the competition is to approach the problem of how to build interactive agents that learn to solve a task while provided with grounded natural language instructions in a collaborative environment. This research challenge is naturally related, but not limited, to two fields of study that are highly relevant to the NeurIPS community: Natural Language Understanding and Generation (NLU/G) and Reinforcement Learning (RL)
  arXiv  Detail & Related papers  (2021-10-13T07:13:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.