Highly Deformable Proprioceptive Membrane for Real-Time 3D Shape Reconstruction

• URL: http://arxiv.org/abs/2601.13574v1
• Date: Tue, 20 Jan 2026 03:59:21 GMT
• Title: Highly Deformable Proprioceptive Membrane for Real-Time 3D Shape Reconstruction
• Abstract summary: This work presents a soft, flexible, and stretchable proprioceptive silicone membrane based on optical waveguide sensing.<n>The membrane sensor integrates edge-mounted LEDs and centrally distributed photodiodes (PDs), interconnected via liquid-metal traces embedded within a multilayer elastomeric composite.<n>Real-time reconstruction of large-scale out-of-plane deformation is achieved at 90 Hz with an average reconstruction error of 1.3 mm, measured by Chamfer distance.
• Score: 10.772262307564574
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reconstructing the three-dimensional (3D) geometry of object surfaces is essential for robot perception, yet vision-based approaches are generally unreliable under low illumination or occlusion. This limitation motivates the design of a proprioceptive membrane that conforms to the surface of interest and infers 3D geometry by reconstructing its own deformation. Conventional shape-aware membranes typically rely on resistive, capacitive, or magneto-sensitive mechanisms. However, these methods often encounter challenges such as structural complexity, limited compliance during large-scale deformation, and susceptibility to electromagnetic interference. This work presents a soft, flexible, and stretchable proprioceptive silicone membrane based on optical waveguide sensing. The membrane sensor integrates edge-mounted LEDs and centrally distributed photodiodes (PDs), interconnected via liquid-metal traces embedded within a multilayer elastomeric composite. Rich deformation-dependent light intensity signals are decoded by a data-driven model to recover the membrane geometry as a 3D point cloud. On a customized 140 mm square membrane, real-time reconstruction of large-scale out-of-plane deformation is achieved at 90 Hz with an average reconstruction error of 1.3 mm, measured by Chamfer distance, while maintaining accuracy for indentations up to 25 mm. The proposed framework provides a scalable, robust, and low-profile solution for global shape perception in deformable robotic systems.

Related papers

• Toward Geometry-Scalable Whole-Body Touch for Humanoids: A 3D-Printed Conformal EIT Skin [66.36050076244905]
  Whole-body tactile sensing is a prerequisite for humanoids that operate in contact-rich human environments.<n>We present a conformal electrical tactile tomography skin fabricated through a geometry-adaptable additive-manufacturing workflow.
  arXiv  Detail & Related papers  (2026-08-03T11:33:30Z)
• Design and Fabrication of a Spin Coater with In-Situ Optical Measurement for Soft Thin Films [6.909383819598247]
  This work presents a low-cost, primarily 3D-printed benchtop spin coater with an integrated, minimally deforming optical thickness measurement system.<n>The system is designed to manufacture films between 50 and 300 microns thick with repeatability within 10 microns.
  arXiv  Detail & Related papers  (2026-06-13T02:55:27Z)
• A skin-like conformal sensor for real-time shape mapping [2.128937994248034]
  Real-time 3D shape sensing is essential for robust control and interpretation of deformable systems during motion.<n>Here, we introduce a scalable, skin-like sensor that reconstructs its continuous 3D deformation in real time from distributed strain measurements.<n>A 5-by-5 array with a 12 mm pitch achieves a mean surface reconstruction error of 0.62 mm with 0.1s latency across all tested scenarios.
  arXiv  Detail & Related papers  (2026-05-02T00:19:19Z)
• Zero Shot Deformation Reconstruction for Soft Robots Using a Flexible Sensor Array and Cage Based 3D Gaussian Modeling [13.363052557818968]
  zero-shot deformation reconstruction is defined as the ability to infer object-wide deformations on unseen soft robots without collecting deformation data or performing any retraining during deployment.<n>The proposed framework integrates a flexible piezoresistive sensor array with a geometry-aware, cage-based 3D Gaussian deformation model.<n>It achieves 0.67 IoU, 0.65 SSIM, and 3.48 mm Chamfer distance, demonstrating strong zero-shot generalization through explicit coupling of tactile sensing and structured geometric deformation.
  arXiv  Detail & Related papers  (2026-03-20T00:56:39Z)
• PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
  PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
  arXiv  Detail & Related papers  (2026-03-11T14:11:42Z)
• Cylindrical Mechanical Projector for Omnidirectional Fringe Projection Profilometry [0.07646713951724012]
  This paper proposes a novel 3D reconstruction method based on a cylindrical mechanical projector.<n>The proposed method consists of a rotational stage and a cylindrical pattern generator with ON/OFF slots at two distinct intervals.<n>By applying a multi-wavelength unwrapping algorithm and a quasi-calibration technique, the system achieves high-accuracy 3D reconstruction using only a single camera.
  arXiv  Detail & Related papers  (2026-03-11T06:20:09Z)
• Physics-informed Active Polarimetric 3D Imaging for Specular Surfaces [4.019683930752727]
  We propose a physics-informed deep learning framework for single-shot 3D imaging of complex specular surfaces.<n>The proposed method achieves accurate and robust normal estimation in single-shot with fast inference, enabling practical 3D imaging of complex specular surfaces.
  arXiv  Detail & Related papers  (2026-02-23T03:28:41Z)
• Coupled Physics-Gated Adaptation: Spatially Decoding Volumetric Photochemical Conversion in Complex 3D-Printed Objects [0.0]
  We introduce a new computer vision task: predicting dense, non-visual physical properties from 3D visual data.<n>We propose Coupled Physics-Gated Adaptation (C-PGA), a novel multimodal fusion architecture.<n>This approach offers a breakthrough in virtual chemical characterisation, eliminating the need for traditional post-print measurements.
  arXiv  Detail & Related papers  (2025-11-25T04:42:40Z)
• Physics-Informed Neural Networks for MIMO Beam Map and Environment Reconstruction [67.65578956523403]
  geometry-aware feature extraction from channel state information (CSI) emerges as a pivotal methodology to bridge physical-layer measurements with network intelligence.<n>This paper proposes to explore the received signal strength ( RSS) data, without explicit 3D environment knowledge, to jointly construct the radio beam map and environmental geometry.<n>A physics-informed deep learning framework that incorporates the reflective-zone-based geometry model is proposed to learn the blockage, reflection, and scattering components.
  arXiv  Detail & Related papers  (2025-10-24T08:17:14Z)
• Three-dimensional optical characterization of magnetostrictive deformation in magnomechanical systems [10.557574314855918]
  YIG spheres have been proven to be an ideal system for studying magnomechanically induced transparency, dynamical backaction, and rich nonlinear effects.<n>Here we propose an optical approach for detecting the magnetostrictive deformation of a YIG sphere in three dimensions (3Ds) with high precision.
  arXiv  Detail & Related papers  (2025-10-09T11:37:32Z)
• Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
  Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
  arXiv  Detail & Related papers  (2025-09-11T23:12:55Z)
• Digital generation of the 3-D pore architecture of isotropic membranes using 2-D cross-sectional scanning electron microscopy images [0.0]
  A major limitation of two-dimensional scanning electron microscopy in imaging porous membranes is its inability to resolve three-dimensional pore architecture and interconnectivity.<n>We develop an enhanced reconstruction algorithm that maintains essential statistical properties and accurately reproduces intricate pore morphologies.<n>The tool can be readily applied to isotropic porous membrane structures of any pore size, as long as those pores can be visualized by SEM.
  arXiv  Detail & Related papers  (2025-08-08T19:26:33Z)
• AniSDF: Fused-Granularity Neural Surfaces with Anisotropic Encoding for High-Fidelity 3D Reconstruction [55.69271635843385]
  We present AniSDF, a novel approach that learns fused-granularity neural surfaces with physics-based encoding for high-fidelity 3D reconstruction.<n>Our method boosts the quality of SDF-based methods by a great scale in both geometry reconstruction and novel-view synthesis.
  arXiv  Detail & Related papers  (2024-10-02T03:10:38Z)
• 3D Reconstruction of Curvilinear Structures with Stereo Matching DeepConvolutional Neural Networks [52.710012864395246]
  We propose a fully automated pipeline for both detection and matching of curvilinear structures in stereo pairs. We mainly focus on 3D reconstruction of dislocations from stereo pairs of TEM images.
  arXiv  Detail & Related papers  (2021-10-14T23:05:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.