Related papers: Distributed Acoustic Localization Array Deployed Using a Soft Everting Vine Robot

Distributed Acoustic Localization Array Deployed Using a Soft Everting Vine Robot

URL: http://arxiv.org/abs/2607.20392v1
Date: Wed, 22 Jul 2026 17:26:08 GMT
Title: Distributed Acoustic Localization Array Deployed Using a Soft Everting Vine Robot
Abstract summary: We present a sound-based system for localizing disaster victims based on a distributed acoustic sensing architecture embedded along the body of a soft vine robot.<n>We conduct experiments measuring the accuracy of methods for a five-microphone array attached to the robot body.<n>We show that a sound source located with the array's near field can be localized with high accuracy after only three microphones have everted from the robot body.
Score: 0.9611722922501805
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Abstract: Soft robot exteroception is increasingly being explored for a variety of field applications. In this work, we present a sound-based system for localizing disaster victims in confined and unstructured environments, based on a distributed acoustic sensing architecture embedded along the body of a soft everting vine robot. We propose a dynamic Steered Response Power with Phase Transform framework that supports both far-field direction-of-arrival estimation and near-field three-dimensional source localization as the robot approaches the sound source. To better understand the design and control space related to localizing sound using a soft, shape-morphing robot body, we conduct experiments measuring the accuracy of these methods for a five-microphone array attached to the robot body using three placements relative to the outer membrane of the robot (inside the pressurized body, inside the inner tail, and outside the outer wall) and in four robot configurations (linear, double linear, circular, and sinusoidal). We measure the change in accuracy as the signal-to-noise ratio, the direction of approach, and the distance of the sound source from the center of the array change. Finally, we demonstrate a vine robot growing into an arbitrary shape while carrying microphones along its outer wall, and show that a sound source located with the array's near field can be localized with high accuracy after only three microphones have everted from the robot body. These results highlight the potential of distributed acoustic sensing for reliable victim localization using soft growing robots.

Related papers

Lifelong Localization in Dynamic Indoor Environments Combining Odometry with Sparse Distance Sampling [5.257115841810258]
We propose a robust lifelong localization framework in dynamic indoor environments.<n>We demonstrate how distance samples can be used to provide a robust prior on the robot's location.<n>We achieve a localization comparable to SLAM with merely a few (sixteen) distance samples, as opposed to the full LiDAR range.
arXiv Detail & Related papers (2026-07-20T11:46:57Z)
Embodied Human-Robot Interaction via Acoustics: A MARL Approach with AcoustoBots for Spatial Data Physicalization [32.62028759076795]
AcoustoBots is a mobile acoustophoretic data-physicalization platform.<n>TurtleBot3 robots carry upward-facing 8 x 8 ultrasonic phased arrays.<n>Each array levitates a particle whose height encodes a local urban scalar value, such as population density, noise, or traffic.
arXiv Detail & Related papers (2026-07-07T17:59:44Z)
Continuum Robot Localization using Distributed Time-of-Flight Sensors [14.753889983176194]
We present a technique for continuum robots that relies on small, low-resolution ToF sensors distributed along the length of the robot.<n>We achieve an average localization error of 2.5cm in position and 7.2 in rotation across all experimental conditions with a 53cm long robot.
arXiv Detail & Related papers (2026-02-06T21:42:37Z)
Audio-Based Tactile Human-Robot Interaction Recognition [0.0]
This study explores the use of microphones placed on a robot's body to detect tactile interactions via sounds produced when the hard shell of the robot is touched.<n>Two I2S microphones integrated with a Raspberry Pi 4 were positioned on the torso of a Pollen Robotics Reachy robot to capture audio signals.<n>A convolutional neural network was trained for touch classification on a dataset of 336 pre-processed samples.<n>The model shows high classification accuracy between touch types with distinct acoustic dominant frequencies.
arXiv Detail & Related papers (2025-12-06T23:19:22Z)
Real-Time Object Tracking with On-Device Deep Learning for Adaptive Beamforming in Dynamic Acoustic Environments [3.0718743078604067]
This work presents an embedded system that integrates deep learning-based tracking with beamforming to achieve precise sound source localization.<n>The system is well-suited for teleconferencing, smart home devices, and assistive technologies.
arXiv Detail & Related papers (2025-11-24T18:33:50Z)
Exploring 3D Human Pose Estimation and Forecasting from the Robot's Perspective: The HARPER Dataset [52.22758311559]
We introduce HARPER, a novel dataset for 3D body pose estimation and forecast in dyadic interactions between users and Spot. The key-novelty is the focus on the robot's perspective, i.e., on the data captured by the robot's sensors. The scenario underlying HARPER includes 15 actions, of which 10 involve physical contact between the robot and users.
arXiv Detail & Related papers (2024-03-21T14:53:50Z)
Sounding Bodies: Modeling 3D Spatial Sound of Humans Using Body Pose and Audio [50.39279046238891]
We present a model that can generate accurate 3D spatial audio for full human bodies. The system consumes, as input, audio signals from headset microphones and body pose. We show that our model can produce accurate body-induced sound fields when trained with a suitable loss.
arXiv Detail & Related papers (2023-11-01T16:40:35Z)
Neural Scene Representation for Locomotion on Structured Terrain [56.48607865960868]
We propose a learning-based method to reconstruct the local terrain for a mobile robot traversing urban environments. Using a stream of depth measurements from the onboard cameras and the robot's trajectory, the estimates the topography in the robot's vicinity. We propose a 3D reconstruction model that faithfully reconstructs the scene, despite the noisy measurements and large amounts of missing data coming from the blind spots of the camera arrangement.
arXiv Detail & Related papers (2022-06-16T10:45:17Z)
Few-Shot Audio-Visual Learning of Environment Acoustics [89.16560042178523]
Room impulse response (RIR) functions capture how the surrounding physical environment transforms the sounds heard by a listener. We explore how to infer RIRs based on a sparse set of images and echoes observed in the space. In experiments using a state-of-the-art audio-visual simulator for 3D environments, we demonstrate that our method successfully generates arbitrary RIRs.
arXiv Detail & Related papers (2022-06-08T16:38:24Z)
Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systems [92.26462290867963]
Kimera-Multi is the first multi-robot system that is robust and capable of identifying and rejecting incorrect inter and intra-robot loop closures. We demonstrate Kimera-Multi in photo-realistic simulations, SLAM benchmarking datasets, and challenging outdoor datasets collected using ground robots.
arXiv Detail & Related papers (2021-06-28T03:56:40Z)
Kimera-Multi: a System for Distributed Multi-Robot Metric-Semantic Simultaneous Localization and Mapping [57.173793973480656]
We present the first fully distributed multi-robot system for dense metric-semantic SLAM. Our system, dubbed Kimera-Multi, is implemented by a team of robots equipped with visual-inertial sensors. Kimera-Multi builds a 3D mesh model of the environment in real-time, where each face of the mesh is annotated with a semantic label.
arXiv Detail & Related papers (2020-11-08T21:38:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.