Left/Right Brain, human motor control and the implications for robotics

• URL: http://arxiv.org/abs/2401.14057v2
• Date: Wed, 10 Jul 2024 12:47:20 GMT
• Title: Left/Right Brain, human motor control and the implications for robotics
• Abstract summary: This research explores a bilateral neural network architecture as a control system for motor tasks. We aimed to achieve hemispheric specialisation similar to what is observed in humans across different tasks.
• Score: 0.5062312533373298
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Neural Network movement controllers promise a variety of advantages over conventional control methods, however, they are not widely adopted due to their inability to produce reliably precise movements. This research explores a bilateral neural network architecture as a control system for motor tasks. We aimed to achieve hemispheric specialisation similar to what is observed in humans across different tasks; the dominant system (usually the right hand, left hemisphere) excels at tasks involving coordination and efficiency of movement, and the non-dominant system performs better at tasks requiring positional stability. Specialisation was achieved by training the hemispheres with different loss functions tailored to the expected behaviour of the respective hemispheres. We compared bilateral models with and without specialised hemispheres, with and without inter-hemispheric connectivity (representing the biological Corpus Callosum), and unilateral models with and without specialisation. The models were trained and tested on two tasks common in the human motor control literature: the random reach task, suited to the dominant system, a model with better coordination, and the hold position task, suited to the non-dominant system, a model with more stable movement. Each system outperformed the non-preferred system in its preferred task. For both tasks, a bilateral model outperformed the non-preferred hand and was as good or better than the preferred hand. The results suggest that the hemispheres could collaborate on tasks or work independently to their strengths. This study provides ideas for how a biologically inspired bilateral architecture could be exploited for industrial motor control.

Related papers

• Dual Process Motion Planning [53.570848178455776]
  We introduce a dual-process architecture that combines the strengths of robust reasoning and learning.<n>Our framework integrates state-of-the-art symbolic solvers as a System-2'' component with experience-driven System-1'' modules.
  arXiv  Detail & Related papers  (2026-09-01T13:52:12Z)
• SMASH: Mastering Scalable Whole-Body Skills for Humanoid Ping-Pong with Egocentric Vision [53.709632118234936]
  Methodname is a modular system for agile humanoid table tennis.<n>It unifies scalable whole-body skill learning with onboard egocentric perception.<n>We demonstrate the first humanoid table-tennis system capable of consecutive strikes using onboard sensing alone.
  arXiv  Detail & Related papers  (2026-04-01T17:11:52Z)
• ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
  We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
  arXiv  Detail & Related papers  (2026-03-03T18:59:29Z)
• Agile asymmetric multi-legged locomotion: contact planning via geometric mechanics and spin model duality [15.47009589379934]
  We develop a principled framework for discovering new control structures in multi-legged locomotion.<n>We use geometric mechanics to reduce contact-rich locomotion planning to a graph optimization problem.<n>We identify an asymmetric locomotion strategy for a hexapod robot that achieves a forward speed of 0.61 body lengths per cycle.
  arXiv  Detail & Related papers  (2026-02-09T19:13:14Z)
• ManiGaussian++: General Robotic Bimanual Manipulation with Hierarchical Gaussian World Model [52.02220087880269]
  We propose an extension of ManiGaussian framework that improves bimanual manipulation by digesting multi-task scene dynamics through a hierarchical world model.<n>Our method significantly outperforms the current state-of-the-art bimanual manipulation techniques by an improvement of 20.2% in 10 simulated tasks, and 60% success rate on average in 9 challenging real-world tasks.
  arXiv  Detail & Related papers  (2025-06-24T17:59:06Z)
• Morphologically Symmetric Reinforcement Learning for Ambidextrous Bimanual Manipulation [7.9906178944789374]
  We introduce SYMDEX, a reinforcement learning framework for ambidextrous bi-manipulation.<n>By exploiting bilateral symmetry via equivariant neural networks, experience from one arm is inherently leveraged by the opposite arm.<n>Our approach strongly outperforms baselines on complex task in which the left and right hands perform different roles.
  arXiv  Detail & Related papers  (2025-05-08T14:29:00Z)
• Learning Bimanual Manipulation via Action Chunking and Inter-Arm Coordination with Transformers [4.119006369973485]
  We focus on coordination and efficiency between both arms, particularly synchronized actions. We propose a novel imitation learning architecture that predicts cooperative actions. Our model demonstrated a high success rate for comparison and suggested a suitable architecture for the policy learning of bimanual manipulation.
  arXiv  Detail & Related papers  (2025-03-18T05:20:34Z)
• Rethinking Bimanual Robotic Manipulation: Learning with Decoupled Interaction Framework [51.39847596489193]
  Bimanual robotic manipulation is an emerging and critical topic in the robotics community.<n>We propose a novel decoupled interaction framework that considers the characteristics of different tasks in bimanual manipulation.<n>Our framework achieves outstanding performance, with a 23.5% boost over the SOTA method.
  arXiv  Detail & Related papers  (2025-03-12T09:28:41Z)
• Disentangling Task Interference within Neurons: Model Merging in Alignment with Neuronal Mechanisms [9.230323472193918]
  We present the first study on the impact of neuronal alignment in model merging. We introduce NeuroMerging, a novel merging framework developed to mitigate task interference within neuronal subspaces.
  arXiv  Detail & Related papers  (2025-03-07T11:00:24Z)
• Hierarchical learning control for autonomous robots inspired by central nervous system [7.227887302864789]
  We propose a novel hierarchical learning control framework by mimicking the hierarchical structure of the central nervous system. The framework combines the active and passive control systems to improve both the flexibility and reliability of the control system. This study reveals the principle that governs the autonomous behavior in the central nervous system and demonstrates the effectiveness of the hierarchical control approach.
  arXiv  Detail & Related papers  (2024-08-07T03:24:59Z)
• Continual Learning from Simulated Interactions via Multitask Prospective Rehearsal for Bionic Limb Behavior Modeling [0.7922558880545526]
  We introduce a model for human behavior in the context of bionic prosthesis control. We propose a multitasking, continually adaptive model that anticipates and refines movements over time. We validate our model through experiments on real-world human gait datasets, including transtibial amputees.
  arXiv  Detail & Related papers  (2024-05-02T09:22:54Z)
• MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints [50.61346764110482]
  We integrate a musculoskeletal system with a learnable parametric hand model, MANO, to create MS-MANO. This model emulates the dynamics of muscles and tendons to drive the skeletal system, imposing physiologically realistic constraints on the resulting torque trajectories. We also propose a simulation-in-the-loop pose refinement framework, BioPR, that refines the initial estimated pose through a multi-layer perceptron network.
  arXiv  Detail & Related papers  (2024-04-16T02:18:18Z)
• Causal Graph ODE: Continuous Treatment Effect Modeling in Multi-agent Dynamical Systems [70.84976977950075]
  Real-world multi-agent systems are often dynamic and continuous, where the agents co-evolve and undergo changes in their trajectories and interactions over time. We propose a novel model that captures the continuous interaction among agents using a Graph Neural Network (GNN) as the ODE function. The key innovation of our model is to learn time-dependent representations of treatments and incorporate them into the ODE function, enabling precise predictions of potential outcomes.
  arXiv  Detail & Related papers  (2024-02-29T23:07:07Z)
• Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
  This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots. We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing. This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
  arXiv  Detail & Related papers  (2024-01-30T10:48:43Z)
• Neural Control: Concurrent System Identification and Control Learning with Neural ODE [13.727727205587804]
  We propose a neural ODE based method for controlling unknown dynamical systems, denoted as Neural Control (NC) Our model concurrently learns system dynamics as well as optimal controls that guides towards target states. Our experiments demonstrate the effectiveness of our model for learning optimal control of unknown dynamical systems.
  arXiv  Detail & Related papers  (2024-01-03T17:05:17Z)
• Hierarchical generative modelling for autonomous robots [8.023920215148486]
  We show how a humanoid robot can autonomously complete a complex task that requires a holistic use of locomotion, manipulation, and grasping. Specifically, we demonstrate the ability of a humanoid robot that can retrieve and transport a box, open and walk through a door to reach the destination, approach and kick a football, while showing robust performance in presence of body damage and ground irregularities.
  arXiv  Detail & Related papers  (2023-08-15T13:51:03Z)
• Persistent-Transient Duality: A Multi-mechanism Approach for Modeling Human-Object Interaction [58.67761673662716]
  Humans are highly adaptable, swiftly switching between different modes to handle different tasks, situations and contexts. In Human-object interaction (HOI) activities, these modes can be attributed to two mechanisms: (1) the large-scale consistent plan for the whole activity and (2) the small-scale children interactive actions that start and end along the timeline. This work proposes to model two concurrent mechanisms that jointly control human motion.
  arXiv  Detail & Related papers  (2023-07-24T12:21:33Z)
• Deep learning in a bilateral brain with hemispheric specialization [0.23301643766310376]
  We propose a bilateral artificial neural network that imitates lateralisation observed in nature. Our analysis found that the hemispheres represent complementary features that are exploited by a network head that implements a type of weighted attention. Results demonstrate the efficacy of bilateralism, contribute to the discussion of bilateralism in biological brains, and the principle may serve as an inductive bias for new AI systems.
  arXiv  Detail & Related papers  (2022-09-09T00:40:14Z)
• Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning [49.6928533575956]
  We use neural inference to mediate between the neural System 1 and the logical System 2. Results in robust story generation and grounded instruction-following show that this approach can increase the coherence and accuracy of neurally-based generations.
  arXiv  Detail & Related papers  (2021-07-06T17:59:49Z)
• Intrinsic Motivation for Encouraging Synergistic Behavior [55.10275467562764]
  We study the role of intrinsic motivation as an exploration bias for reinforcement learning in sparse-reward synergistic tasks. Our key idea is that a good guiding principle for intrinsic motivation in synergistic tasks is to take actions which affect the world in ways that would not be achieved if the agents were acting on their own.
  arXiv  Detail & Related papers  (2020-02-12T19:34:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.