Proprioceptive Learning with Soft Polyhedral Networks
- URL: http://arxiv.org/abs/2308.08538v1
- Date: Wed, 16 Aug 2023 17:53:40 GMT
- Title: Proprioceptive Learning with Soft Polyhedral Networks
- Authors: Xiaobo Liu, Xudong Han, Wei Hong, Fang Wan, Chaoyang Song
- Abstract summary: Proprioception is the "sixth sense" that detects limb postures with motor neurons.
Here, we present the Soft Polyhedral Network with an embedded vision for physical interactions.
This design enables passive adaptations to omni-directional interactions, visually captured by a miniature high-speed motion tracking system.
- Score: 17.368077066659556
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Proprioception is the "sixth sense" that detects limb postures with motor
neurons. It requires a natural integration between the musculoskeletal systems
and sensory receptors, which is challenging among modern robots that aim for
lightweight, adaptive, and sensitive designs at a low cost. Here, we present
the Soft Polyhedral Network with an embedded vision for physical interactions,
capable of adaptive kinesthesia and viscoelastic proprioception by learning
kinetic features. This design enables passive adaptations to omni-directional
interactions, visually captured by a miniature high-speed motion tracking
system embedded inside for proprioceptive learning. The results show that the
soft network can infer real-time 6D forces and torques with accuracies of
0.25/0.24/0.35 N and 0.025/0.034/0.006 Nm in dynamic interactions. We also
incorporate viscoelasticity in proprioception during static adaptation by
adding a creep and relaxation modifier to refine the predicted results. The
proposed soft network combines simplicity in design, omni-adaptation, and
proprioceptive sensing with high accuracy, making it a versatile solution for
robotics at a low cost with more than 1 million use cycles for tasks such as
sensitive and competitive grasping, and touch-based geometry reconstruction.
This study offers new insights into vision-based proprioception for soft robots
in adaptive grasping, soft manipulation, and human-robot interaction.
Related papers
- Single Neuromorphic Memristor closely Emulates Multiple Synaptic
Mechanisms for Energy Efficient Neural Networks [71.79257685917058]
We demonstrate memristive nano-devices based on SrTiO3 that inherently emulate all these synaptic functions.
These memristors operate in a non-filamentary, low conductance regime, which enables stable and energy efficient operation.
arXiv Detail & Related papers (2024-02-26T15:01:54Z) - Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing [16.570647733532173]
We introduce a system that leverages visual and tactile sensory inputs to enable dexterous in-hand manipulation.
Robot Synesthesia is a novel point cloud-based tactile representation inspired by human tactile-visual synesthesia.
arXiv Detail & Related papers (2023-12-04T12:35:43Z) - Learning with Chemical versus Electrical Synapses -- Does it Make a
Difference? [61.85704286298537]
Bio-inspired neural networks have the potential to advance our understanding of neural computation and improve the state-of-the-art of AI systems.
We conduct experiments with autonomous lane-keeping through a photorealistic autonomous driving simulator to evaluate their performance under diverse conditions.
arXiv Detail & Related papers (2023-11-21T13:07:20Z) - Tactile-Filter: Interactive Tactile Perception for Part Mating [54.46221808805662]
Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks.
vision-based tactile sensors are being widely used for various robotic perception and control tasks.
We present a method for interactive perception using vision-based tactile sensors for a part mating task.
arXiv Detail & Related papers (2023-03-10T16:27:37Z) - Neuromechanical Autoencoders: Learning to Couple Elastic and Neural
Network Nonlinearity [15.47367187516723]
We seek to develop machine learning analogs of.
mechanical intelligence.
We jointly learn the morphology of complex nonlinear elastic solids along with a.
deep neural network to control it.
arXiv Detail & Related papers (2023-01-31T19:04:28Z) - Elastic Tactile Simulation Towards Tactile-Visual Perception [58.44106915440858]
We propose Elastic Interaction of Particles (EIP) for tactile simulation.
EIP models the tactile sensor as a group of coordinated particles, and the elastic property is applied to regulate the deformation of particles during contact.
We further propose a tactile-visual perception network that enables information fusion between tactile data and visual images.
arXiv Detail & Related papers (2021-08-11T03:49:59Z) - Online Body Schema Adaptation through Cost-Sensitive Active Learning [63.84207660737483]
The work was implemented in a simulation environment, using the 7DoF arm of the iCub robot simulator.
A cost-sensitive active learning approach is used to select optimal joint configurations.
The results show cost-sensitive active learning has similar accuracy to the standard active learning approach, while reducing in about half the executed movement.
arXiv Detail & Related papers (2021-01-26T16:01:02Z) - Elastic Interaction of Particles for Robotic Tactile Simulation [43.933808122317274]
We propose Elastic Interaction of Particles (EIP), a novel framework for tactile emulation.
EIP models the tactile sensor as a group of coordinated particles, and the elastic theory is applied to regulate the deformation of particles during the contact process.
Experiments to verify the effectiveness of our method have been carried out on two applications.
arXiv Detail & Related papers (2020-11-23T16:37:00Z) - A Framework for Learning Invariant Physical Relations in Multimodal
Sensory Processing [0.0]
We design a novel neural network architecture capable of learning, in an unsupervised manner, relations among sensory cues.
We describe the core system functionality when learning arbitrary non-linear relations in low-dimensional sensory data.
We demonstrate this through a real-world learning problem, where, from standard RGB camera frames, the network learns the relations between physical quantities.
arXiv Detail & Related papers (2020-06-30T08:42:48Z) - OmniTact: A Multi-Directional High Resolution Touch Sensor [109.28703530853542]
Existing tactile sensors are either flat, have small sensitive fields or only provide low-resolution signals.
We introduce OmniTact, a multi-directional high-resolution tactile sensor.
We evaluate the capabilities of OmniTact on a challenging robotic control task.
arXiv Detail & Related papers (2020-03-16T01:31:29Z) - A Spiking Neural Network Emulating the Structure of the Oculomotor
System Requires No Learning to Control a Biomimetic Robotic Head [0.0]
A neuromorphic oculomotor controller is placed at the heart of our in-house biomimetic robotic head prototype.
The controller is unique in the sense that all data are encoded and processed by a spiking neural network (SNN)
We report the robot's target tracking ability, demonstrate that its eye kinematics are similar to those reported in human eye studies and show that a biologically-constrained learning can be used to further refine its performance.
arXiv Detail & Related papers (2020-02-18T13:03:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.