Scalable Open-Source Visuotactile Sensor for 6-Axis Contact Wrench Estimation in Tensegrity Robots
- URL: http://arxiv.org/abs/2607.15633v1
- Date: Fri, 17 Jul 2026 05:21:06 GMT
- Title: Scalable Open-Source Visuotactile Sensor for 6-Axis Contact Wrench Estimation in Tensegrity Robots
- Abstract summary: This paper presents a scalable, open-source visuotactile sensing system for tensegrity robots.<n>The proposed endcap sensor integrates an elastomeric shell, a 3D-printed thermoplastic polyurethane interface, and a rigid base housing an embedded camera and LED illumination ring.<n>A tactile-to-wrench neural network maps shear vector fields to six-dimensional force and torque measurements.
- Score: 6.030441869707218
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper presents a scalable, open-source visuotactile sensing system for tensegrity robots that enables six-axis wrench estimation and contact detection. The proposed endcap sensor integrates an elastomeric shell, a 3D-printed thermoplastic polyurethane (TPU) interface, and a rigid base housing an embedded camera and LED illumination ring. A novel gyroid-infill bonding technique is introduced to form a durable elastomer-TPU interface without adhesives, yielding a lightweight and modular design compatible with large-scale tensegrity structures. A tactile-to-wrench neural network maps shear vector fields to six-dimensional force and torque measurements. Experimental results demonstrate accurate and stable wrench estimation with a mean squared error (MSE) of 0.1531 on static validation data and out-of-domain generalization under dynamic motion. Furthermore, full-system integration on a 12 kg tensegrity robot confirms the sensor's ability to reliably identify ground contacts. The system substantially improves the practicality of tactile feedback for tensegrity robots, offering a low-cost, reproducible, and physically interpretable pathway toward contact-aware proprioception and state estimation. Open source files are available at \href{https://github.com/Jonathan-Twz/tensegrity-gelfoot}{github.com/Jonathan-Twz/tensegrity-gelfoot}
Related papers
- Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
arXiv Detail & Related papers (2026-08-25T07:25:27Z) - A Model-Based Decoupling Strategy for Proprioception and Contact Sensing in an Architected Soft Manipulator [49.225033144914214]
We present a model-based strategy that decouples proprioceptive and contact signals from fluidic pressure sensors embedded in a soft architected segment.<n>On a single ITH segment, this approach achieves proprioceptive shape estimation with a relative bending error of 0.11 +/- 0.02 and a contact detection rate of 97% across 178 trials.
arXiv Detail & Related papers (2026-07-17T03:03:19Z) - Heterogeneous Tactile Transformer [12.676986440348543]
Heterogeneous Tactile Transformer (HTT) is a framework that learns shared tactile representations across heterogeneous sensors.<n>Pretraining uses our novel Heterogeneous Paired Tactile dataset, containing 1.6M synchronized frames across four vision- and array-based tactile sensors.<n> HTT is shown to learn transferable representations that adapt to new tasks and previously unseen sensors.
arXiv Detail & Related papers (2026-06-29T08:24:38Z) - ARISTO Hand: Sensing-Driven Distal Hyperextension for Fine-Grained Manipulation [3.3685005431669732]
We present the ARISTO Hand, a tendon-driven robotic hand that integrates active distal hyperextension with a hybrid fingertip-sensing architecture.<n>Active hyperextension enables controlled fingertip engagement beyond the kinematic limits of standard flexion.<n>The rigid nail-mounted sensor provides reliable force measurements during edge contacts.
arXiv Detail & Related papers (2026-05-28T19:44:04Z) - Design and Validation of a Lightweight 1D CNN for Affective Touch Classification in Soft Plush Companions [59.49967357689445]
Soft, sensorized companions offer a physically safe and emotionally intuitive interface for socially assistive technologies.<n>This study presents a complete open-source dilated real-based framework for the development and validation of deep learning models for affective touch recognition in soft interactive companions.
arXiv Detail & Related papers (2026-04-16T10:20:05Z) - How to Train your Tactile Model: Tactile Perception with Multi-fingered Robot Hands [5.994865673189261]
TacViT is a novel tactile perception model based on Vision Transformers that generalizes on new sensor data.<n>This capability significantly reduces the need for data collection and retraining, accelerating the deployment of new sensors.<n>Our results highlight TacViTs potential to make tactile sensing more scalable and practical for real-world robotic applications.
arXiv Detail & Related papers (2026-04-01T11:15:27Z) - OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation [57.133721026727706]
We present textbfOmniViTac, a large-scale visuo-tactile-action dataset comprising $21,000+$ trajectories across $86$ tasks and $100+$ objects.<n>We propose textbf OmniVTA, a world-model-based visuo-tactile manipulation framework that integrates four tightly coupled modules.
arXiv Detail & Related papers (2026-03-19T17:52:42Z) - UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
arXiv Detail & Related papers (2026-02-01T11:03:01Z) - Proprioceptive External Torque Learning for Floating Base Robot and its
Applications to Humanoid Locomotion [17.384713355349476]
This paper introduces a method for learning external joint torque solely using proprioceptive sensors (encoders and IMUs) for a floating base robot.
Real robot experiments demonstrate that the network can estimate the external torque and contact wrench with significantly smaller errors.
The study also validates that the estimated contact wrench can be utilized for zero moment point (ZMP) feedback control.
arXiv Detail & Related papers (2023-09-08T05:33:56Z) - Elastic Tactile Simulation Towards Tactile-Visual Perception [58.44106915440858]
We propose Elastic Interaction of Particles (EIP) for tactile simulation.
EIP models the tactile sensor as a group of coordinated particles, and the elastic property is applied to regulate the deformation of particles during contact.
We further propose a tactile-visual perception network that enables information fusion between tactile data and visual images.
arXiv Detail & Related papers (2021-08-11T03:49:59Z) - OmniTact: A Multi-Directional High Resolution Touch Sensor [109.28703530853542]
Existing tactile sensors are either flat, have small sensitive fields or only provide low-resolution signals.
We introduce OmniTact, a multi-directional high-resolution tactile sensor.
We evaluate the capabilities of OmniTact on a challenging robotic control task.
arXiv Detail & Related papers (2020-03-16T01:31:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.