The Algonauts Project 2021 Challenge: How the Human Brain Makes Sense of a World in Motion

• URL: http://arxiv.org/abs/2104.13714v1
• Date: Wed, 28 Apr 2021 11:38:31 GMT
• Title: The Algonauts Project 2021 Challenge: How the Human Brain Makes Sense of a World in Motion
• Authors: R.M. Cichy, K. Dwivedi, B. Lahner, A. Lascelles, P. Iamshchinina, M. Graumann, A. Andonian, N.A.R. Murty, K. Kay, G. Roig, A. Oliva
• Abstract summary: We release the 2021 edition of the Algonauts Project Challenge: How the Human Brain Makes Sense of a World in Motion. We provide whole-brain fMRI responses recorded while 10 human participants viewed a rich set of over 1,000 short video clips depicting everyday events. The goal of the challenge is to accurately predict brain responses to these video clips.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The sciences of natural and artificial intelligence are fundamentally connected. Brain-inspired human-engineered AI are now the standard for predicting human brain responses during vision, and conversely, the brain continues to inspire invention in AI. To promote even deeper connections between these fields, we here release the 2021 edition of the Algonauts Project Challenge: How the Human Brain Makes Sense of a World in Motion (http://algonauts.csail.mit.edu/). We provide whole-brain fMRI responses recorded while 10 human participants viewed a rich set of over 1,000 short video clips depicting everyday events. The goal of the challenge is to accurately predict brain responses to these video clips. The format of our challenge ensures rapid development, makes results directly comparable and transparent, and is open to all. In this way it facilitates interdisciplinary collaboration towards a common goal of understanding visual intelligence. The 2021 Algonauts Project is conducted in collaboration with the Cognitive Computational Neuroscience (CCN) conference.

Related papers

• MindAligner: Explicit Brain Functional Alignment for Cross-Subject Visual Decoding from Limited fMRI Data [64.92867794764247]
  MindAligner is a framework for cross-subject brain decoding from limited fMRI data. Brain Transfer Matrix (BTM) projects the brain signals of an arbitrary new subject to one of the known subjects. Brain Functional Alignment module is proposed to perform soft cross-subject brain alignment under different visual stimuli.
  arXiv  Detail & Related papers  (2025-02-07T16:01:59Z)
• BrainMAP: Learning Multiple Activation Pathways in Brain Networks [77.15180533984947]
  We introduce a novel framework BrainMAP to learn Multiple Activation Pathways in Brain networks. Our framework enables explanatory analyses of crucial brain regions involved in tasks.
  arXiv  Detail & Related papers  (2024-12-23T09:13:35Z)
• Decoding Linguistic Representations of Human Brain [21.090956290947275]
  We present a taxonomy of brain-to-language decoding of both textual and speech formats. This work integrates two types of research: neuroscience focusing on language understanding and deep learning-based brain decoding.
  arXiv  Detail & Related papers  (2024-07-30T07:55:44Z)
• AI for Mathematics: A Cognitive Science Perspective [86.02346372284292]
  Mathematics is one of the most powerful conceptual systems developed and used by the human species. Rapid progress in AI, particularly propelled by advances in large language models (LLMs), has sparked renewed, widespread interest in building such systems.
  arXiv  Detail & Related papers  (2023-10-19T02:00:31Z)
• The Algonauts Project 2023 Challenge: UARK-UAlbany Team Solution [21.714597774964194]
  This work presents our solutions to the Algonauts Project 2023 Challenge. The primary objective of the challenge revolves around employing computational models to anticipate brain responses. We constructed an image-based brain encoder through a two-step training process to tackle this challenge.
  arXiv  Detail & Related papers  (2023-08-01T03:46:59Z)
• Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey) [9.14580723964253]
  Can artificial intelligence unlock the secrets of the human brain? Is it possible to enhance AI by tapping into the power of brain recordings? Our survey focuses on human brain recording studies and cutting-edge cognitive neuroscience datasets.
  arXiv  Detail & Related papers  (2023-07-17T06:54:36Z)
• The Brain Tumor Segmentation (BraTS) Challenge: Local Synthesis of Healthy Brain Tissue via Inpainting [50.01582455004711]
  For brain tumor patients, the image acquisition time series typically starts with an already pathological scan. Many algorithms are designed to analyze healthy brains and provide no guarantee for images featuring lesions. Examples include, but are not limited to, algorithms for brain anatomy parcellation, tissue segmentation, and brain extraction. Here, the participants explore inpainting techniques to synthesize healthy brain scans from lesioned ones.
  arXiv  Detail & Related papers  (2023-05-15T20:17:03Z)
• A Neurodiversity-Inspired Solver for the Abstraction \& Reasoning Corpus (ARC) Using Visual Imagery and Program Synthesis [6.593059418464748]
  We propose a new AI approach to core knowledge that combines visual representations of core knowledge inspired by human mental imagery abilities. We demonstrate our system's performance on the very difficult Abstraction & Reasoning (ARC) challenge. We share experimental results from publicly available ARC items as well as from our 4th-place finish on the private test set during the 2022 global ARCathon challenge.
  arXiv  Detail & Related papers  (2023-02-18T21:30:44Z)
• The Algonauts Project 2023 Challenge: How the Human Brain Makes Sense of Natural Scenes [0.0]
  We introduce the 2023 installment of the Algonauts Project challenge: How the Human Brain Makes Sense of Natural Scenes. This installment prompts the fields of artificial and biological intelligence to come together towards building computational models of the visual brain. The challenge is open to all and makes results directly comparable and transparent through a public leaderboard automatically updated after each submission.
  arXiv  Detail & Related papers  (2023-01-09T08:27:36Z)
• Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs [77.88043871260466]
  We show that one of today's largest language models lacks this kind of social intelligence out-of-the box. We conclude that person-centric NLP approaches might be more effective towards neural Theory of Mind.
  arXiv  Detail & Related papers  (2022-10-24T14:58:58Z)
• IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 2022 [63.07251290802841]
  We propose IGLU: Interactive Grounded Language Understanding in a Collaborative Environment. The primary goal of the competition is to approach the problem of how to develop interactive embodied agents. This research challenge is naturally related, but not limited, to two fields of study that are highly relevant to the NeurIPS community.
  arXiv  Detail & Related papers  (2022-05-27T06:12:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.