Acoustic Sensing for Universal Jamming Grippers
- URL: http://arxiv.org/abs/2603.00351v1
- Date: Fri, 27 Feb 2026 22:31:05 GMT
- Title: Acoustic Sensing for Universal Jamming Grippers
- Abstract summary: Sound propagates through the gripper and object, encoding object properties, which are then reconstructed via machine learning.<n>Our sensor achieves high spatial resolution in sensing object size (2.6 mm error) and orientation (0.6 deg error)<n>We validate the sensor in a realistic tactile object sorting task, achieving 53 minutes of uninterrupted grasping and sensing.
- Score: 42.48594146171026
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Universal jamming grippers excel at grasping unknown objects due to their compliant bodies. Traditional tactile sensors can compromise this compliance, reducing grasping performance. We present acoustic sensing as a form of morphological sensing, where the gripper's soft body itself becomes the sensor. A speaker and microphone are placed inside the gripper cavity, away from the deformable membrane, fully preserving compliance. Sound propagates through the gripper and object, encoding object properties, which are then reconstructed via machine learning. Our sensor achieves high spatial resolution in sensing object size (2.6 mm error) and orientation (0.6 deg error), remains robust to external noise levels of 80 dBA, and discriminates object materials (up to 100% accuracy) and 16 everyday objects (85.6% accuracy). We validate the sensor in a realistic tactile object sorting task, achieving 53 minutes of uninterrupted grasping and sensing, confirming the preserved grasping performance. Finally, we demonstrate that disentangled acoustic representations can be learned, improving robustness to irrelevant acoustic variations.
Related papers
- Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
arXiv Detail & Related papers (2026-08-25T07:25:27Z) - Talk2Sensors: 3D Visual Grounding in Autonomous Driving via Sensor-Adaptive Physical Cue Matching [66.91228384649921]
We introduce Talk2Sensors, the first multi-sensor 3D visual grounding dataset built upon camera, LiDAR, and 4D radar.<n>We propose TSFormer, a unified Transformer-based framework for language-guided 3D visual grounding in autonomous driving.
arXiv Detail & Related papers (2026-08-05T07:58:35Z) - Sen-Cap: Sensor-Flexible and Noise-Resilient Human Motion Capture via LiDAR-Camera Integration [50.18488308004802]
Sen-Cap is a 3D motion capture framework that integrates multi-modal data from LiDAR and camera.<n>Sen-Cap achieves state-of-the-art performance on major metrics on Human-M3 and FreeMotion.<n>This combination of flexibility and robustness opens new opportunities for motion capture in real-world scenarios.
arXiv Detail & Related papers (2026-08-03T14:16:18Z) - A Model-Based Decoupling Strategy for Proprioception and Contact Sensing in an Architected Soft Manipulator [49.225033144914214]
We present a model-based strategy that decouples proprioceptive and contact signals from fluidic pressure sensors embedded in a soft architected segment.<n>On a single ITH segment, this approach achieves proprioceptive shape estimation with a relative bending error of 0.11 +/- 0.02 and a contact detection rate of 97% across 178 trials.
arXiv Detail & Related papers (2026-07-17T03:03:19Z) - Egocentric Tactile and Proximity Sensors as Observation Priors for Humanoid Collision Avoidance [36.95729356118979]
We present a reinforcement learning framework for whole-body collision avoidance on a humanoid H1-2 robot.<n>We ablate the properties of sensors distributed across the upper body of the robot and find that raw proximity measurements can substitute for explicit object localization.
arXiv Detail & Related papers (2026-04-28T12:20:42Z) - Surface-based Manipulation Using Tunable Compliant Porous-Elastic Soft Sensing [3.109563406209924]
This work introduces the COmpliant Porous-Elastic Soft Sensing (COPESS) integrated with inductive sensors for adaptive object manipulation and localised sensing.<n>The design features a tunable lattice layer that simultaneously modulates mechanical compliance and sensing performance.
arXiv Detail & Related papers (2026-02-24T15:51:10Z) - Adding internal audio sensing to internal vision enables human-like in-hand fabric recognition with soft robotic fingertips [24.17784887837483]
In this work, we present a system that can sense both types of haptic information.<n>Inspired by movements humans make to evaluate fabrics, our robot actively encloses and rubs fabric samples between its two sensitive fingers.
arXiv Detail & Related papers (2026-02-13T13:23:52Z) - A thin and soft optical tactile sensor for highly sensitive object perception [0.28528456544424774]
We present a thin, compact, and soft optical tactile sensor featuring an alignment-free configuration.<n>The sensor operates by capturing deformation-induced changes in speckle patterns generated within a soft silicone material.<n>The experimental results show a root-mean-square error of 40 mN in the force measurement and a classification accuracy of 93.33% over nine classes of textured surfaces.
arXiv Detail & Related papers (2026-02-03T08:28:14Z) - Stretchable and High-Precision Optical Tactile Sensor for Trajectory Tracking of Parallel Mechanisms [6.327690818318062]
We develop a stretchable tactile sensor based on the proposed continuous spectral-filtering principle.<n>This proposed sensor enables a high-linear spatial response (0.996) even during stretching and bending, and high continuous spatial (7 m) and force (5 mN) resolutions.
arXiv Detail & Related papers (2025-12-24T02:13:16Z) - TranTac: Leveraging Transient Tactile Signals for Contact-Rich Robotic Manipulation [11.834021644402148]
Robotic manipulation tasks such as inserting a key into a lock or plugging a USB device into a port can fail when visual perception is insufficient to detect misalignment.<n>Here, we introduce TranTac, a data-efficient and low-cost tactile sensing and control framework.<n>Our customized sensing system can detect dynamic translational and torsional deformations at the micrometer scale.
arXiv Detail & Related papers (2025-09-20T06:25:59Z) - DGFusion: Depth-Guided Sensor Fusion for Robust Semantic Perception [57.77346327566903]
State-of-the-art sensor fusion approaches to semantic perception often treat sensor data uniformly across the spatial extent of the input.<n>We propose a novel depth-guided multimodal fusion method that upgrades condition-aware fusion by integrating depth information.<n>Our method achieves state-of-the-art panoptic and semantic segmentation performance on the challenging MUSES and DELIVER datasets.
arXiv Detail & Related papers (2025-09-11T20:03:00Z) - SensorLM: Learning the Language of Wearable Sensors [50.95988682423808]
We present SensorLM, a family of sensor-language foundation models that enable wearable sensor data understanding with natural language.<n>We introduce a hierarchical caption generation pipeline designed to capture statistical, structural, and semantic information from sensor data.<n>This approach enabled the curation of the largest sensor-language dataset to date, comprising over 59.7 million hours of data from more than 103,000 people.
arXiv Detail & Related papers (2025-06-10T17:13:09Z) - A Soft e-Textile Sensor for Enhanced Deep Learning-based Shape Sensing of Soft Continuum Robots [0.3495246564946556]
The safety and accuracy of robotic navigation hold paramount importance, especially in the realm of soft continuum robotics.
Traditional rigid sensors often fail to integrate well with the flexible nature of these robots, adding unwanted bulk and rigidity.
This study presents a new approach to shape sensing in soft continuum robots through the use of soft e-textile resistive sensors.
arXiv Detail & Related papers (2024-04-19T05:00:25Z) - Exponential sensitivity revival of noisy non-Hermitian quantum sensing with two-photon drives [3.031137751464259]
We analytically characterize and highlight the impact of loss and gain on the sensitivity revival and stability of non-Hermitian sensors.
Our paper opens a way to significantly enhance the sensitivity by proactively tuning the loss and gain.
arXiv Detail & Related papers (2023-03-29T10:17:19Z) - On the Importance of Accurate Geometry Data for Dense 3D Vision Tasks [61.74608497496841]
Training on inaccurate or corrupt data induces model bias and hampers generalisation capabilities.
This paper investigates the effect of sensor errors for the dense 3D vision tasks of depth estimation and reconstruction.
arXiv Detail & Related papers (2023-03-26T22:32:44Z) - Elastic Tactile Simulation Towards Tactile-Visual Perception [58.44106915440858]
We propose Elastic Interaction of Particles (EIP) for tactile simulation.
EIP models the tactile sensor as a group of coordinated particles, and the elastic property is applied to regulate the deformation of particles during contact.
We further propose a tactile-visual perception network that enables information fusion between tactile data and visual images.
arXiv Detail & Related papers (2021-08-11T03:49:59Z) - Real-time detection of uncalibrated sensors using Neural Networks [62.997667081978825]
An online machine-learning based uncalibration detector for temperature, humidity and pressure sensors was developed.
The solution integrates an Artificial Neural Network as main component which learns from the behavior of the sensors under calibrated conditions.
The obtained results show that the proposed solution is able to detect uncalibrations for deviation values of 0.25 degrees, 1% RH and 1.5 Pa, respectively.
arXiv Detail & Related papers (2021-02-02T15:44:39Z) - Monocular Depth Estimation for Soft Visuotactile Sensors [24.319343057803973]
We investigate the application of state-of-the-art monocular depth estimation to infer dense internal (tactile) depth maps directly from an internal single small IR imaging sensor.
We show that deep networks typically used for long-range depth estimation (1-100m) can be effectively trained for precise predictions at a much shorter range (1-100mm) inside a mostly textureless deformable fluid-filled sensor.
We propose a simple supervised learning process to train an object-agnostic network requiring less than 10 random poses in contact for less than 10 seconds for a small set of diverse objects.
arXiv Detail & Related papers (2021-01-05T17:51:11Z) - Scalable Tactile Sensing for an Omni-adaptive Soft Robot Finger [15.296478998148443]
We present an embedded sensing solution using optical fibers for an omni-adaptive soft robotic finger with exceptional adaptation in all directions.
The resultant integration is scalable as a versatile, low-cost, and moisture-proof solution for physically safe human-robot interaction.
arXiv Detail & Related papers (2020-02-29T21:18:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.