DLOFTBs -- Fast Tracking of Deformable Linear Objects with B-splines

• URL: http://arxiv.org/abs/2302.13694v2
• Date: Thu, 11 May 2023 08:36:50 GMT
• Title: DLOFTBs -- Fast Tracking of Deformable Linear Objects with B-splines
• Authors: Piotr Kicki, Amadeusz Szymko, Krzysztof Walas
• Abstract summary: This paper proposes an algorithm for fast-tracking the shape of a DLO based on the masked image. Experiments show that our solution outperforms the State-of-the-Art approaches in DLO's shape reconstruction accuracy and algorithm running time.
• Score: 1.3836565669337055
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: While manipulating rigid objects is an extensively explored research topic, deformable linear object (DLO) manipulation seems significantly underdeveloped. A potential reason for this is the inherent difficulty in describing and observing the state of the DLO as its geometry changes during manipulation. This paper proposes an algorithm for fast-tracking the shape of a DLO based on the masked image. Having no prior knowledge about the tracked object, the proposed method finds a reliable representation of the shape of the tracked object within tens of milliseconds. This algorithm's main idea is to first skeletonize the DLO mask image, walk through the parts of the DLO skeleton, arrange the segments into an ordered path, and finally fit a B-spline into it. Experiments show that our solution outperforms the State-of-the-Art approaches in DLO's shape reconstruction accuracy and algorithm running time and can handle challenging scenarios such as severe occlusions, self-intersections, and multiple DLOs in a single image.

Related papers

• KnotDLO: Toward Interpretable Knot Tying [6.243146366966637]
  KnotDLO is a method for one-handed Deformable Linear Object (DLO) knot tying.<n> Grasp and target waypoints for future DLO states are planned from the current DLO shape.<n>In 16 trials of knot tying, KnotDLO achieves a 50% success rate in tying an overhand knot from previously unseen configurations.
  arXiv  Detail & Related papers  (2025-06-27T12:43:05Z)
• DLO-Splatting: Tracking Deformable Linear Objects Using 3D Gaussian Splatting [19.080636951502623]
  DLO-Splatting is an algorithm for estimating the 3D shape of Deformable Linear Objects (DLOs) from multi-view RGB images and gripper state information.<n>The algorithm uses a position-based dynamics model with shape smoothness and rigidity dampening corrections to predict the object shape.<n>Experiments demonstrate promising results in a knot tying scenario, which is challenging for existing vision-only methods.
  arXiv  Detail & Related papers  (2025-05-13T15:03:40Z)
• Enhanced OoD Detection through Cross-Modal Alignment of Multi-Modal Representations [2.992602379681373]
  We show that multi-modal fine-tuning can achieve notable OoDD performance. We propose a training objective that enhances cross-modal alignment by regularizing the distances between image and text embeddings of ID data.
  arXiv  Detail & Related papers  (2025-03-24T16:00:21Z)
• Realtime Robust Shape Estimation of Deformable Linear Object [5.63550507123537]
  We propose a robust method to estimate the shape of linear deformable objects in realtime using scattered and unordered key points. We demonstrate the robustness of the method when key points are partially occluded. The proposed method is also integrated into a simulation in Unity for tracking the shape of a cable with a length of 1m and a radius of 5mm.
  arXiv  Detail & Related papers  (2024-03-24T13:36:23Z)
• DexDLO: Learning Goal-Conditioned Dexterous Policy for Dynamic Manipulation of Deformable Linear Objects [7.72979328949568]
  We present DexDLO, a model-free framework that learns dexterous dynamic manipulation policies for deformable linear objects with a fixed-base dexterous hand. We show that our framework can efficiently learn five different DLO manipulation tasks with the same framework parameters.
  arXiv  Detail & Related papers  (2023-12-23T09:26:20Z)
• Robust 3D Tracking with Quality-Aware Shape Completion [67.9748164949519]
  We propose a synthetic target representation composed of dense and complete point clouds depicting the target shape precisely by shape completion for robust 3D tracking. Specifically, we design a voxelized 3D tracking framework with shape completion, in which we propose a quality-aware shape completion mechanism to alleviate the adverse effect of noisy historical predictions.
  arXiv  Detail & Related papers  (2023-12-17T04:50:24Z)
• Once Detected, Never Lost: Surpassing Human Performance in Offline LiDAR based 3D Object Detection [50.959453059206446]
  This paper aims for high-performance offline LiDAR-based 3D object detection. We first observe that experienced human annotators annotate objects from a track-centric perspective. We propose a high-performance offline detector in a track-centric perspective instead of the conventional object-centric perspective.
  arXiv  Detail & Related papers  (2023-04-24T17:59:05Z)
• SDFEst: Categorical Pose and Shape Estimation of Objects from RGB-D using Signed Distance Fields [5.71097144710995]
  We present a modular pipeline for pose and shape estimation of objects from RGB-D images. We integrate a generative shape model with a novel network to enable 6D pose and shape estimation from a single or multiple views. We demonstrate the benefits of our approach over state-of-the-art methods in several experiments on both synthetic and real data.
  arXiv  Detail & Related papers  (2022-07-11T13:53:50Z)
• Direct Dense Pose Estimation [138.56533828316833]
  Dense human pose estimation is the problem of learning dense correspondences between RGB images and the surfaces of human bodies. Prior dense pose estimation methods are all based on Mask R-CNN framework and operate in a top-down manner of first attempting to identify a bounding box for each person. We propose a novel alternative method for solving the dense pose estimation problem, called Direct Dense Pose (DDP)
  arXiv  Detail & Related papers  (2022-04-04T06:14:38Z)
• Disentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depth [37.021579239596164]
  Existing dynamic-object-focused methods only partially solved the mismatch problem at the training loss level. We propose a novel multi-frame monocular depth prediction method to solve these problems at both the prediction and supervision loss levels. Our method, called DynamicDepth, is a new framework trained via a self-supervised cycle consistent learning scheme.
  arXiv  Detail & Related papers  (2022-03-29T01:36:11Z)
• Implicit Motion Handling for Video Camouflaged Object Detection [60.98467179649398]
  We propose a new video camouflaged object detection (VCOD) framework. It can exploit both short-term and long-term temporal consistency to detect camouflaged objects from video frames.
  arXiv  Detail & Related papers  (2022-03-14T17:55:41Z)
• Progressive Self-Guided Loss for Salient Object Detection [102.35488902433896]
  We present a progressive self-guided loss function to facilitate deep learning-based salient object detection in images. Our framework takes advantage of adaptively aggregated multi-scale features to locate and detect salient objects effectively.
  arXiv  Detail & Related papers  (2021-01-07T07:33:38Z)
• DMLO: Deep Matching LiDAR Odometry [24.245702652854217]
  Deep Matching LiDAR Odometry (DMLO) is a novel learning-based framework which makes the feature matching method applicable to LiDAR odometry task. We show that our framework dramatically outperforms existing learning-based methods and comparable with the state-of-the-art geometry based approaches.
  arXiv  Detail & Related papers  (2020-04-08T03:52:49Z)
• DOPS: Learning to Detect 3D Objects and Predict their 3D Shapes [54.239416488865565]
  We propose a fast single-stage 3D object detection method for LIDAR data. The core novelty of our method is a fast, single-pass architecture that both detects objects in 3D and estimates their shapes. We find that our proposed method achieves state-of-the-art results by 5% on object detection in ScanNet scenes, and it gets top results by 3.4% in the Open dataset.
  arXiv  Detail & Related papers  (2020-04-02T17:48:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.