Deformable Object Manipulation under Partial Observability via Real-Time Full-Shape Estimation

• URL: http://arxiv.org/abs/2609.10308v1
• Date: Wed, 09 Sep 2026 15:17:30 GMT
• Title: Deformable Object Manipulation under Partial Observability via Real-Time Full-Shape Estimation
• Abstract summary: cRVAE is a conditional recurrent variational autoencoder that estimates the full DO state from only partial corner-node observations.<n>The model is used as the forward model in a receding-horizon optimal control framework for collaborative DO manipulation.
• Score: 3.0399936132520566
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Manipulating deformable objects (DOs) is challenging due to their high-dimensional state space, underactuated dynamics, and partial observability. In this paper, we propose cRVAE, a lightweight conditional recurrent variational autoencoder that estimates the full DO state from only partial corner-node observations during inference. The resulting model is used as the forward model in a receding-horizon optimal control framework for obstacle-aware collaborative DO manipulation. In simulation on rope and fabric, cRVAE estimates the full DO state from the available corner-node measurements alone, matching the accuracy of a parameter-identified XPBD model. At inference it uses no physical parameters as model inputs and performs no online parameter identification. It also runs approximately 350 times faster on the rope and over 1500 times faster on the fabric per forward pass, keeping horizon-based planning within the 100 ms control budget where XPBD exceeds it already at short horizons. Full-shape estimation from corner sensing at in-loop speed is what makes the model deployable on hardware, which we demonstrate on a Unitree Go2 robot.

Related papers

• DAP-Pose: Deep Temporal Alignment and Physics-aware Cross-modal Sensor Fusion for Robust Pose Estimation [1.9537336589945413]
  DAP-Pose is a unified end-to-end model for robust multi-modal pose estimation.<n>BCF module captures semantic and geometric motion cues from visual, inertial, and measurements.<n>DTA module aligns asynchronous streams in latent space, enabling coherent motion modeling without strict hardware synchronization.
  arXiv  Detail & Related papers  (2026-07-26T17:00:53Z)
• Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing [73.88859384645264]
  Out-Of-Distribution (OOD) generalization to various racetracks utilizes Machine Learning (ML) to encode the mathematical relation between sensor data and vehicle actuation for end-to-end control.<n>This paper presents a DRL method that parameterizes nonlinear vehicle dynamics from the spectral distribution of depth measurements with a non-geometric, physics-informed reward, to infer vehicle time-optimal and overtaking racing controls with an Artificial Neural Network (ANN)<n>The policy outperforms human demonstrations by 12% in OOD tracks on proportionally scaled hardware, by maximizing the friction circle with tire dynamics that resemble an empirical Pacejka tire model.
  arXiv  Detail & Related papers  (2026-04-10T17:12:07Z)
• Real-Time Oriented Object Detection Transformer in Remote Sensing Images [36.48263676876599]
  We propose a real-time oriented object detection transformer, the first real-time end-to-end oriented object detector.<n>Specifically, angle distribution refinement is proposed to reformulate angle regression.<n>We also propose oriented contrastive denoising to stabilize training and analyze four noise modes.
  arXiv  Detail & Related papers  (2026-03-16T16:28:31Z)
• Bandwidth-adaptive Cloud-Assisted 360-Degree 3D Perception for Autonomous Vehicles [0.7557499794873328]
  Key challenge for autonomous driving is maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints.<n>We propose leveraging Vehicle-to-Everything (V2X) communication to partially offload processing to the cloud.<n>Our approach utilizes transformer-based models to fuse multi-camera sensor data into a comprehensive Bird's-Eye View (BEV) representation.
  arXiv  Detail & Related papers  (2026-02-27T10:12:02Z)
• LiQSS: Post-Transformer Linear Quantum-Inspired State-Space Tensor Networks for Real-Time 6G [85.58816960936069]
  Proactive and agentic control in Sixth-Generation (6G) Open Radio Access Networks (O-RAN) requires control-grade prediction under stringent Near-Time (Near-RT) latency and computational constraints.<n>This paper investigates a post-Transformer paradigm for efficient radio telemetry forecasting.<n>We propose a quantum-inspired state-space tensor network that replaces self-attention with stable structured state-space dynamics kernels.
  arXiv  Detail & Related papers  (2026-01-18T12:08:38Z)
• Adaptive Model-Predictive Control of a Soft Continuum Robot Using a Physics-Informed Neural Network Based on Cosserat Rod Theory [2.7114475063296455]
  This work introduces a real-time-capable nonlinear model-predictive control (MPC) framework for SCRs based on a domain-decoupled physics-informed neural network (DD-PINN)<n>In simulation, it demonstrates accurate tracking of dynamic trajectories and setpoint control with end-effector position errors below 3 mm.<n>In real-world experiments, the controller achieves similar accuracy and accelerations up to 3.55 m/s2.
  arXiv  Detail & Related papers  (2025-08-18T07:24:36Z)
• Event-Based Visual Odometry on Non-Holonomic Ground Vehicles [20.847519645153337]
  Event-based visual odometry is shown to be reliable and robust in challenging illumination scenarios. Our algorithm achieves accurate estimates of the vehicle's rotational velocity and thus results that are comparable to the delta rotations obtained by frame-based sensors under normal conditions.
  arXiv  Detail & Related papers  (2024-01-17T16:52:20Z)
• CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generation [54.68738348071891]
  We first generate over 650K cluttered scenes - orders of magnitude more than prior work - in diverse everyday environments. We render synthetic partial point clouds from this data and use it to train our CabiNet model architecture. CabiNet is a collision model that accepts object and scene point clouds, captured from a single-view depth observation.
  arXiv  Detail & Related papers  (2023-04-18T21:09:55Z)
• DeepIPC: Deeply Integrated Perception and Control for an Autonomous Vehicle in Real Environments [7.642646077340124]
  We introduce DeepIPC, a novel end-to-end model tailored for autonomous driving. DeepIPC seamlessly integrates perception and control tasks. Our evaluation demonstrates DeepIPC's superior performance in terms of drivability and multi-task efficiency.
  arXiv  Detail & Related papers  (2022-07-20T14:20:35Z)
• Lateral Ego-Vehicle Control without Supervision using Point Clouds [50.40632021583213]
  Existing vision based supervised approaches to lateral vehicle control are capable of directly mapping RGB images to the appropriate steering commands. This paper proposes a framework for training a more robust and scalable model for lateral vehicle control. Online experiments show that the performance of our method is superior to that of the supervised model.
  arXiv  Detail & Related papers  (2022-03-20T21:57:32Z)
• Layer Pruning on Demand with Intermediate CTC [50.509073206630994]
  We present a training and pruning method for ASR based on the connectionist temporal classification (CTC) We show that a Transformer-CTC model can be pruned in various depth on demand, improving real-time factor from 0.005 to 0.002 on GPU.
  arXiv  Detail & Related papers  (2021-06-17T02:40:18Z)
• InfoFocus: 3D Object Detection for Autonomous Driving with Dynamic Information Modeling [65.47126868838836]
  We propose a novel 3D object detection framework with dynamic information modeling. Coarse predictions are generated in the first stage via a voxel-based region proposal network. Experiments are conducted on the large-scale nuScenes 3D detection benchmark.
  arXiv  Detail & Related papers  (2020-07-16T18:27:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.