A Collision-Aware Cable Grasping Method in Cluttered Environment
- URL: http://arxiv.org/abs/2402.14498v2
- Date: Mon, 4 Mar 2024 12:56:23 GMT
- Title: A Collision-Aware Cable Grasping Method in Cluttered Environment
- Abstract summary: We introduce a Cable GraspConvolutional Neural Network designed to facilitate robust cable grasping in cluttered environments.
We generate an dataset that mimics the intricacies of cable pose and factoring in potential collisions between cables and robotic grippers.
We achieve commendable success rates of 92.3% for cables and 88.4% for unknown cables.
- Score: 12.17415219032655
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We introduce a Cable Grasping-Convolutional Neural Network designed to
facilitate robust cable grasping in cluttered environments. Utilizing physics
simulations, we generate an extensive dataset that mimics the intricacies of
cable grasping, factoring in potential collisions between cables and robotic
grippers. We employ the Approximate Convex Decomposition technique to dissect
the non-convex cable model, with grasp quality autonomously labeled based on
simulated grasping attempts. The CG-CNN is refined using this simulated dataset
and enhanced through domain randomization techniques. Subsequently, the trained
model predicts grasp quality, guiding the optimal grasp pose to the robot
controller for execution. Grasping efficacy is assessed across both synthetic
and real-world settings. Given our model implicit collision sensitivity, we
achieved commendable success rates of 92.3% for known cables and 88.4% for
unknown cables, surpassing contemporary state-of-the-art approaches.
Supplementary materials can be found at
https://leizhang-public.github.io/cg-cnn/ .
Related papers
- A Neural Network Based Teleoperation for Remote Controlled Vehicles [98.38733381483934]
Direct teleoperation of vehicles faces critical technical bottlenecks.<n> communication latency and the operator's inability to physically perceive unmodeled environmental disturbances.<n>We propose a tailored unilateral teleoperation framework.
arXiv Detail & Related papers (2026-08-11T01:51:08Z) - Robustness without Wrinkles: Parallel Simulation and Robust MPC for Certified Deformable Manipulation [3.88671418022057]
We present CORD-SLS, a real-time control method for safe deformable object manipulation, with a focus on ropes and cloth.<n>At its core is a GPU-parallel differentiable simulator with contact smoothing which enables efficient gradient-based planning.<n>We develop a real-time, GPU-parallel output-feedback robust model predictive control (MPC) algorithm that plans with this simulator.
arXiv Detail & Related papers (2026-06-12T07:10:56Z) - A Data Efficiency Study of Synthetic Fog for Object Detection Using the Clear2Fog Pipeline [13.221137493760699]
Object detection in adverse weather is critical for the safety of autonomous vehicles.<n>We propose Clear2Fog, an end-to-end, physics-based pipeline that simulates fog on clear-weather datasets.
arXiv Detail & Related papers (2026-05-12T18:01:00Z) - Sensorless State Estimation and Control for Agile Cable-Suspended Payload Transport by Quadrotors [0.0]
This work proposes a novel control and estimation approach for aerial manipulation of a cable-suspended load using Unmanned Aerial Vehicles (UAVs)<n>Results from real-robot experiments demonstrated that the explicit inclusion of load dynamics in the optimization problem significantly reduces trajectory-tracking errors and yields better overall performance compared to strategies based on incomplete models.
arXiv Detail & Related papers (2026-05-05T11:57:31Z) - Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing [73.88859384645264]
Out-Of-Distribution (OOD) generalization to various racetracks utilizes Machine Learning (ML) to encode the mathematical relation between sensor data and vehicle actuation for end-to-end control.<n>This paper presents a DRL method that parameterizes nonlinear vehicle dynamics from the spectral distribution of depth measurements with a non-geometric, physics-informed reward, to infer vehicle time-optimal and overtaking racing controls with an Artificial Neural Network (ANN)<n>The policy outperforms human demonstrations by 12% in OOD tracks on proportionally scaled hardware, by maximizing the friction circle with tire dynamics that resemble an empirical Pacejka tire model.
arXiv Detail & Related papers (2026-04-10T17:12:07Z) - State and Trajectory Estimation of Tensegrity Robots via Factor Graphs and Chebyshev Polynomials [1.1873304786619876]
Tensegrity robots offer compliance and adaptability, but their nonlinear, and underconstrained dynamics make state estimation challenging.<n>This paper proposes a two-stage approach for robust state or trajectory estimation of a cable-driven tensegrity robot.<n>For online state estimation, this work introduces a factor-graph-based method, which fuses measurements from an RGB-D camera with on-board cable length sensors.
arXiv Detail & Related papers (2026-04-09T12:38:47Z) - Alternating Gradient Flow Utility: A Unified Metric for Structural Pruning and Dynamic Routing in Deep Networks [52.153950303594684]
We propose a decoupled kinetic paradigm inspired by Alternating Gradient Flow (AGF)<n>AGF accurately captures the network's structural "kinetic utility"<n>We design a hybrid routing framework that decouples AGF-guided offline structural search from online execution via zero-cost physical priors.
arXiv Detail & Related papers (2026-03-12T18:19:21Z) - Improving Clinical Dataset Condensation with Mode Connectivity-based Trajectory Surrogates [15.665823714894605]
State-of-the-art datasets condensation (DC) enables the creation of privacy-preserving synthetic datasets that can match the utility of real patient records.<n>DC methods supervise synthetic data by aligning the training dynamics of models trained on real and those trained on synthetic data.<n>We address these limitations by replacing full SGD trajectories with smooth, low-loss parametric surrogates.<n>These mode-connected paths provide noise-free, low-curvature supervision signals that stabilise gradients, accelerate convergence, and eliminate the need for dense trajectory storage.
arXiv Detail & Related papers (2025-10-07T11:22:27Z) - A Kolmogorov-Arnold Network for Interpretable Cyberattack Detection in AGC Systems [1.5701326192371186]
This work proposes Kolmogorov-Arnold Networks (KAN) as an interpretable and accurate method for FDIA detection in AGC systems.<n>KAN models include a method for extracting symbolic equations, and are thus able to provide more interpretability than the majority of machine learning models.<n>Our findings confirm that the proposed KAN model achieves FDIA detection rates of up to 95.97% and 95.9% for the initial model and the symbolic formula, respectively.
arXiv Detail & Related papers (2025-09-05T17:18:17Z) - Private Training & Data Generation by Clustering Embeddings [74.00687214400021]
Differential privacy (DP) provides a robust framework for protecting individual data.<n>We introduce a novel principled method for DP synthetic image embedding generation.<n> Empirically, a simple two-layer neural network trained on synthetically generated embeddings achieves state-of-the-art (SOTA) classification accuracy.
arXiv Detail & Related papers (2025-06-20T00:17:14Z) - Certified Neural Approximations of Nonlinear Dynamics [51.01318247729693]
In safety-critical contexts, the use of neural approximations requires formal bounds on their closeness to the underlying system.<n>We propose a novel, adaptive, and parallelizable verification method based on certified first-order models.
arXiv Detail & Related papers (2025-05-21T13:22:20Z) - Channel Fingerprint Construction for Massive MIMO: A Deep Conditional Generative Approach [65.47969413708344]
We introduce the concept of CF twins and design a conditional generative diffusion model (CGDM)<n>We employ a variational inference technique to derive the evidence lower bound (ELBO) for the log-marginal distribution of the observed fine-grained CF conditioned on the coarse-grained CF.<n>We show that the proposed approach exhibits significant improvement in reconstruction performance compared to the baselines.
arXiv Detail & Related papers (2025-05-12T01:36:06Z) - Efficient Fault Detection in WSN Based on PCA-Optimized Deep Neural Network Slicing Trained with GOA [0.6827423171182154]
Traditional fault detection methods often struggle with optimizing deep neural networks (DNNs) for efficient performance.<n>This study proposes a novel hybrid method combining Principal Component Analysis (PCA) with a DNN optimized by the Grasshopper Optimization Algorithm (GOA) to address these limitations.<n>Our approach achieves a remarkable 99.72% classification accuracy, with exceptional precision and recall, outperforming conventional methods.
arXiv Detail & Related papers (2025-05-11T15:51:56Z) - Neural Fidelity Calibration for Informative Sim-to-Real Adaptation [10.117298045153564]
Deep reinforcement learning can seamlessly transfer agile locomotion and navigation skills from the simulator to real world.
However, bridging the sim-to-real gap with domain randomization or adversarial methods often demands expert physics knowledge to ensure policy robustness.
We propose Neural Fidelity (NFC), a novel framework that employs conditional score-based diffusion models to calibrate simulator physical coefficients and residual fidelity domains online during robot execution.
arXiv Detail & Related papers (2025-04-11T15:12:12Z) - Mitigating Traffic Oscillations in Mixed Traffic Flow with Scalable Deep Koopman Predictive Control [11.428076811557437]
Mitigating traffic oscillations in connected automated vehicles (CAVs) and human-driven vehicles (HDVs) is critical for enhancing traffic stability.<n>This study proposes an adaptive deep Koopman predictive control framework (AdapKoopPC) to address this issue.<n>The framework features a novel deep Koopman network, AdapKoopnet, which represents complex HDV car-following dynamics as a linear system in a high-dimensional space by adaptively learning from naturalistic data.
arXiv Detail & Related papers (2025-01-27T14:28:20Z) - Neural Conformal Control for Time Series Forecasting [54.96087475179419]
We introduce a neural network conformal prediction method for time series that enhances adaptivity in non-stationary environments.
Our approach acts as a neural controller designed to achieve desired target coverage, leveraging auxiliary multi-view data with neural network encoders.
We empirically demonstrate significant improvements in coverage and probabilistic accuracy, and find that our method is the only one that combines good calibration with consistency in prediction intervals.
arXiv Detail & Related papers (2024-12-24T03:56:25Z) - Hysteresis Compensation of Flexible Continuum Manipulator using RGBD Sensing and Temporal Convolutional Network [2.387821008001523]
Cable-driven manipulators face control difficulties due to from cabling effects such as friction, elongation, and coupling.
This paper proposes a data-driven approach based on Deep Neural Networks (DNN) to capture these nonlinear and previous states-dependent characteristics.
Applying this method in real surgical scenarios has the potential to enhance control precision and improve surgical performance.
arXiv Detail & Related papers (2024-02-17T16:20:59Z) - The Risk of Federated Learning to Skew Fine-Tuning Features and
Underperform Out-of-Distribution Robustness [50.52507648690234]
Federated learning has the risk of skewing fine-tuning features and compromising the robustness of the model.
We introduce three robustness indicators and conduct experiments across diverse robust datasets.
Our approach markedly enhances the robustness across diverse scenarios, encompassing various parameter-efficient fine-tuning methods.
arXiv Detail & Related papers (2024-01-25T09:18:51Z) - Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion [56.38386580040991]
Consistency Trajectory Model (CTM) is a generalization of Consistency Models (CM)
CTM enables the efficient combination of adversarial training and denoising score matching loss to enhance performance.
Unlike CM, CTM's access to the score function can streamline the adoption of established controllable/conditional generation methods.
arXiv Detail & Related papers (2023-10-01T05:07:17Z) - DTC: Deep Tracking Control [16.2850135844455]
We propose a hybrid control architecture that combines the advantages of both worlds to achieve greater robustness, foot-placement accuracy, and terrain generalization.
A deep neural network policy is trained in simulation, aiming to track the optimized footholds.
We demonstrate superior robustness in the presence of slippery or deformable ground when compared to model-based counterparts.
arXiv Detail & Related papers (2023-09-27T07:57:37Z) - Conformal Predictions Enhanced Expert-guided Meshing with Graph Neural
Networks [8.736819316856748]
This paper presents a machine learning-based scheme that utilize Graph Neural Networks (GNN) and expert guidance to automatically generate CFD meshes for aircraft models.
We introduce a new 3D segmentation algorithm that outperforms two state-of-the-art models, PointNet++ and PointMLP, for surface classification.
We also present a novel approach to project predictions from 3D mesh segmentation models to CAD surfaces using the conformal predictions method.
arXiv Detail & Related papers (2023-08-14T14:39:13Z) - Post-training Model Quantization Using GANs for Synthetic Data
Generation [57.40733249681334]
We investigate the use of synthetic data as a substitute for the calibration with real data for the quantization method.
We compare the performance of models quantized using data generated by StyleGAN2-ADA and our pre-trained DiStyleGAN, with quantization using real data and an alternative data generation method based on fractal images.
arXiv Detail & Related papers (2023-05-10T11:10:09Z) - Certified data-driven physics-informed greedy auto-encoder simulator [0.5249805590164902]
An auto-encoder and dynamics identification models are trained interactively to discover intrinsic and simple latent-space dynamics.
An adaptive greedy sampling algorithm integrated with a physics-informed error indicator is introduced to search for optimal training samples on the fly.
Numerical results demonstrate that the proposed method achieves parametric 121 to 2,658x speed-up with 1 to 5% relative errors for radial advection and 2D Burgers dynamical problems.
arXiv Detail & Related papers (2022-11-24T16:22:51Z) - Layer Pruning on Demand with Intermediate CTC [50.509073206630994]
We present a training and pruning method for ASR based on the connectionist temporal classification (CTC)
We show that a Transformer-CTC model can be pruned in various depth on demand, improving real-time factor from 0.005 to 0.002 on GPU.
arXiv Detail & Related papers (2021-06-17T02:40:18Z) - Probabilistic robust linear quadratic regulators with Gaussian processes [73.0364959221845]
Probabilistic models such as Gaussian processes (GPs) are powerful tools to learn unknown dynamical systems from data for subsequent use in control design.
We present a novel controller synthesis for linearized GP dynamics that yields robust controllers with respect to a probabilistic stability margin.
arXiv Detail & Related papers (2021-05-17T08:36:18Z) - Learning Control Barrier Functions from Expert Demonstrations [69.23675822701357]
We propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs)
We analyze an optimization-based approach to learning a CBF that enjoys provable safety guarantees under suitable Lipschitz assumptions on the underlying dynamical system.
To the best of our knowledge, these are the first results that learn provably safe control barrier functions from data.
arXiv Detail & Related papers (2020-04-07T12:29:06Z) - Efficiently Calibrating Cable-Driven Surgical Robots with RGBD Fiducial
Sensing and Recurrent Neural Networks [26.250886014613762]
We propose a novel approach to efficiently calibrate such robots by placing a 3D printed fiducial coordinate frames on the arm and end-effector that is tracked using RGBD sensing.
With the proposed method, data collection of 1800 samples takes 31 minutes and model training takes under 1 minute.
Results on a test set of reference trajectories suggest that the trained model can reduce the mean tracking error of the physical robot from 2.96 mm to 0.65 mm.
arXiv Detail & Related papers (2020-03-19T00:24:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.