Deep learning in a bilateral brain with hemispheric specialization

• URL: http://arxiv.org/abs/2209.06862v9
• Date: Wed, 10 Jul 2024 12:20:11 GMT
• Title: Deep learning in a bilateral brain with hemispheric specialization
• Abstract summary: We propose a bilateral artificial neural network that imitates lateralisation observed in nature. Our analysis found that the hemispheres represent complementary features that are exploited by a network head that implements a type of weighted attention. Results demonstrate the efficacy of bilateralism, contribute to the discussion of bilateralism in biological brains, and the principle may serve as an inductive bias for new AI systems.
• Score: 0.23301643766310376
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The brains of all bilaterally symmetric animals on Earth are divided into left and right hemispheres. The anatomy and functionality of the hemispheres have a large degree of overlap, but there are asymmetries, and they specialise in possesses different attributes. Other authors have used computational models to mimic hemispheric asymmetries with a focus on reproducing human data on semantic and visual processing tasks. We took a different approach and aimed to understand how dual hemispheres in a bilateral architecture interact to perform well in a given task. We propose a bilateral artificial neural network that imitates lateralisation observed in nature: that the left hemisphere specialises in local features and the right in global features. We used different training objectives to achieve the desired specialisation and tested it on an image classification task with two different CNN backbones: ResNet and VGG. Our analysis found that the hemispheres represent complementary features that are exploited by a network head that implements a type of weighted attention. The bilateral architecture outperformed a range of baselines of similar representational capacity that do not exploit differential specialisation, with the exception of a conventional ensemble of unilateral networks trained on dual training objectives for local and global features. The results demonstrate the efficacy of bilateralism, contribute to the discussion of bilateralism in biological brains, and the principle may serve as an inductive bias for new AI systems.

Related papers

• Joint Imaging-ROI Representation Learning via Cross-View Contrastive Alignment for Brain Disorder Classification [13.749675574071873]
  We propose a unified cross-view contrastive framework for joint imaging-ROI representation learning.<n>Our method learns subject-level global (imaging) and local (ROI-graph) embeddings and aligns them in a shared latent space.<n>Experiments on the ADHD-200 and ABIDE datasets demonstrate that joint learning consistently improves classification performance.
  arXiv  Detail & Related papers  (2026-03-10T22:14:53Z)
• A Unified Geometric Space Bridging AI Models and the Human Brain [24.54324712609098]
  Modern artificial neural networks now rival humans in language, perception, and reasoning.<n>It is still largely unknown whether these artificial systems organize information as the brain does.<n>Here we introduce a groundbreaking concept of Brain-like Space: a unified geometric space in which every AI model can be precisely situated.
  arXiv  Detail & Related papers  (2025-10-28T12:09:23Z)
• CodeBrain: Towards Decoupled Interpretability and Multi-Scale Architecture for EEG Foundation Model [52.466542039411515]
  EEG foundation models (EFMs) have emerged to address the scalability issues of task-specific models.<n>We present CodeBrain, a two-stage EFM designed to fill this gap.<n>In the first stage, we introduce the TFDual-Tokenizer, which decouples heterogeneous temporal and frequency EEG signals into discrete tokens.<n>In the second stage, we propose the multi-scale EEGSSM architecture, which combines structured global convolution with sliding window attention.
  arXiv  Detail & Related papers  (2025-06-10T17:20:39Z)
• Dual Expert Distillation Network for Generalized Zero-Shot Learning [14.583852776117647]
  Zero-shot learning has consistently yielded remarkable progress via nuanced one-to-one visual-attribute correlation. Existing studies resort to refining a uniform mapping function to align and correlate the sample regions and subattributes. This paper introduces a simple yet effective approach, dubbed Dual Expert Distillation Network (DEDN), where two experts are dedicated to coarse- and fine-grained visual-attribute modeling.
  arXiv  Detail & Related papers  (2024-04-25T05:59:42Z)
• Left/Right Brain, human motor control and the implications for robotics [0.5062312533373298]
  This research explores a bilateral neural network architecture as a control system for motor tasks. We aimed to achieve hemispheric specialisation similar to what is observed in humans across different tasks.
  arXiv  Detail & Related papers  (2024-01-25T10:29:07Z)
• A Dual-Stream Neural Network Explains the Functional Segregation of Dorsal and Ventral Visual Pathways in Human Brains [8.24969449883056]
  We develop a dual-stream vision model inspired by the human eyes and brain. At the input level, the model samples two complementary visual patterns. At the backend, the model processes the separate input patterns through two branches of convolutional neural networks.
  arXiv  Detail & Related papers  (2023-10-20T22:47:40Z)
• GIVL: Improving Geographical Inclusivity of Vision-Language Models with Pre-Training Methods [62.076647211744564]
  We propose GIVL, a Geographically Inclusive Vision-and-Language Pre-trained model. There are two attributes of geo-diverse visual concepts which can help to learn geo-diverse knowledge: 1) concepts under similar categories have unique knowledge and visual characteristics, 2) concepts with similar visual features may fall in completely different categories. Compared with similar-size models pre-trained with similar scale of data, GIVL achieves state-of-the-art (SOTA) and more balanced performance on geo-diverse V&L tasks.
  arXiv  Detail & Related papers  (2023-01-05T03:43:45Z)
• Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with Extremely Limited Labels [54.58539616385138]
  We introduce a novel semi-supervised 2D medical image segmentation framework termed Mine yOur owN Anatomy (MONA) First, prior work argues that every pixel equally matters to the model training; we observe empirically that this alone is unlikely to define meaningful anatomical features. Second, we construct a set of objectives that encourage the model to be capable of decomposing medical images into a collection of anatomical features.
  arXiv  Detail & Related papers  (2022-09-27T15:50:31Z)
• On the Importance of Asymmetry for Siamese Representation Learning [53.86929387179092]
  Siamese networks are conceptually symmetric with two parallel encoders. We study the importance of asymmetry by explicitly distinguishing the two encoders within the network. We find the improvements from asymmetric designs generalize well to longer training schedules, multiple other frameworks and newer backbones.
  arXiv  Detail & Related papers  (2022-04-01T17:57:24Z)
• Dynamic Inference with Neural Interpreters [72.90231306252007]
  We present Neural Interpreters, an architecture that factorizes inference in a self-attention network as a system of modules. inputs to the model are routed through a sequence of functions in a way that is end-to-end learned. We show that Neural Interpreters perform on par with the vision transformer using fewer parameters, while being transferrable to a new task in a sample efficient manner.
  arXiv  Detail & Related papers  (2021-10-12T23:22:45Z)
• Kinship Verification Based on Cross-Generation Feature Interaction Learning [53.62256887837659]
  Kinship verification from facial images has been recognized as an emerging yet challenging technique in computer vision applications. We propose a novel cross-generation feature interaction learning (CFIL) framework for robust kinship verification.
  arXiv  Detail & Related papers  (2021-09-07T01:50:50Z)
• Interpreting Face Inference Models using Hierarchical Network Dissection [10.852613235927958]
  Hierarchical Network Dissection is a pipeline to interpret the internal representation of face-centric inference models. Our pipeline is inspired by Network Dissection, a popular interpretability model for object-centric and scene-centric models.
  arXiv  Detail & Related papers  (2021-08-23T18:52:47Z)
• Generalisation in Neural Networks Does not Require Feature Overlap [3.162825695928202]
  We show that convolutional architectures avoid the limitation by applying them to two well known challenges. successful performance on the test set requires generalising to features that were not present in the training data. We discuss the role of symmetry in the two tasks and its connection to generalisation.
  arXiv  Detail & Related papers  (2021-07-04T09:23:49Z)
• A neural anisotropic view of underspecification in deep learning [60.119023683371736]
  We show that the way neural networks handle the underspecification of problems is highly dependent on the data representation. Our results highlight that understanding the architectural inductive bias in deep learning is fundamental to address the fairness, robustness, and generalization of these systems.
  arXiv  Detail & Related papers  (2021-04-29T14:31:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.