RoboSense At Edge: Detecting Slip, Crumple and Shape of the Object in Robotic Hand for Teleoprations

• URL: http://arxiv.org/abs/2311.07888v1
• Date: Tue, 14 Nov 2023 03:49:20 GMT
• Title: RoboSense At Edge: Detecting Slip, Crumple and Shape of the Object in Robotic Hand for Teleoprations
• Abstract summary: Slip and crumple detection is essential for performing robust manipulation tasks with a robotic hand (RH) like remote surgery. We propose a technique based on machine learning (ML) based techniques to detect the slip, and crumple as well as the shape of an object that is currently held in the robotic hand.
• Score: 1.1789204193530416
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Slip and crumple detection is essential for performing robust manipulation tasks with a robotic hand (RH) like remote surgery. It has been one of the challenging problems in the robotics manipulation community. In this work, we propose a technique based on machine learning (ML) based techniques to detect the slip, and crumple as well as the shape of an object that is currently held in the robotic hand. We proposed ML model will detect the slip, crumple, and shape using the force/torque exerted and the angular positions of the actuators present in the RH. The proposed model would be integrated into the loop of a robotic hand(RH) and haptic glove(HG). This would help us to reduce the latency in case of teleoperation

Related papers

• RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction [51.76737991200891]
  Human-to-robot (H2R) object handover is a fundamental capability for human-robot collaboration, yet progress is hindered by the scarcity of large-scale, human-centric datasets.<n>We introduce Hand2Bot, an RGB-D video dataset that provides rich contextual information such as body posture and facial expressions.<n>We propose PassGen, a generative pipeline that synthesizes realistic handover sequences while ensuring hand-object consistency.
  arXiv  Detail & Related papers  (2026-08-13T09:55:59Z)
• Active Contact Sensing for Robust Robot-to-Human Object Handover [22.323829143922676]
  We propose an active sensing approach for robust object handovers.<n>A firm grasp produces forces in multiple directions, while an accidental touch does not.<n>Our method achieved a 97.5% success rate -- over 30% higher than two common baselines.
  arXiv  Detail & Related papers  (2026-05-06T07:59:02Z)
• A Closed-Form Geometric Retargeting Solver for Upper Body Humanoid Robot Teleoperation [32.82085155744172]
  Methods for targeting human motion to robot arms are suboptimal and slow.<n>This paper reframes orientation alignment as an orientation problem.<n>Key idea is to align a robot arm to a human's upper and lower arm orientations, as identified from shoulder, elbow, and wrist (SEW) keypoints.<n> Experiments show that SEW-Mimic outperforms other methods in computation time and accuracy.
  arXiv  Detail & Related papers  (2026-02-02T04:44:55Z)
• Toward Human-Robot Teaming: Learning Handover Behaviors from 3D Scenes [28.930178662944446]
  We introduce a method for training HRT policies, focusing on human-to-robot handovers, solely from RGB images.<n>We generate robot demonstrations containing image-action pairs captured with a camera mounted on the robot gripper.<n>As a result, the simulated camera pose changes in the reconstructed scene can be directly translated into gripper pose changes.
  arXiv  Detail & Related papers  (2025-08-13T14:47:31Z)
• VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation [53.63540587160549]
  VidBot is a framework enabling zero-shot robotic manipulation using learned 3D affordance from in-the-wild monocular RGB-only human videos. VidBot paves the way for leveraging everyday human videos to make robot learning more scalable.
  arXiv  Detail & Related papers  (2025-03-10T10:04:58Z)
• Kinematically Constrained Human-like Bimanual Robot-to-Human Handovers [19.052211315080044]
  Bimanual handovers are crucial for transferring large, deformable or delicate objects. This paper proposes a framework for generating kinematically constrained human-like bimanual robot motions.
  arXiv  Detail & Related papers  (2024-02-22T13:19:02Z)
• Robotic Handling of Compliant Food Objects by Robust Learning from Demonstration [79.76009817889397]
  We propose a robust learning policy based on Learning from Demonstration (LfD) for robotic grasping of food compliant objects. We present an LfD learning policy that automatically removes inconsistent demonstrations, and estimates the teacher's intended policy. The proposed approach has a vast range of potential applications in the aforementioned industry sectors.
  arXiv  Detail & Related papers  (2023-09-22T13:30:26Z)
• Proprioceptive External Torque Learning for Floating Base Robot and its Applications to Humanoid Locomotion [17.384713355349476]
  This paper introduces a method for learning external joint torque solely using proprioceptive sensors (encoders and IMUs) for a floating base robot. Real robot experiments demonstrate that the network can estimate the external torque and contact wrench with significantly smaller errors. The study also validates that the estimated contact wrench can be utilized for zero moment point (ZMP) feedback control.
  arXiv  Detail & Related papers  (2023-09-08T05:33:56Z)
• Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations [66.47064743686953]
  Eye-in-hand cameras have shown promise in enabling greater sample efficiency and generalization in vision-based robotic manipulation. Videos of humans performing tasks, on the other hand, are much cheaper to collect since they eliminate the need for expertise in robotic teleoperation. In this work, we augment narrow robotic imitation datasets with broad unlabeled human video demonstrations to greatly enhance the generalization of eye-in-hand visuomotor policies.
  arXiv  Detail & Related papers  (2023-07-12T07:04:53Z)
• Deep Functional Predictive Control for Strawberry Cluster Manipulation using Tactile Prediction [6.365634303789478]
  This paper introduces a novel approach to address the problem of Physical Robot Interaction (PRI) during robot pushing tasks. The approach uses a data-driven forward model based on tactile predictions to inform the controller about potential future movements of the object being pushed.
  arXiv  Detail & Related papers  (2023-03-09T16:31:35Z)
• In-air Knotting of Rope using Dual-Arm Robot based on Deep Learning [8.365690203298966]
  We report the successful execution of in-air knotting of rope using a dual-arm two-finger robot based on deep learning. A manual description of appropriate robot motions corresponding to all object states is difficult to be prepared in advance. We constructed a model that instructed the robot to perform bowknots and overhand knots based on two deep neural networks trained using the data gathered from its sensorimotor.
  arXiv  Detail & Related papers  (2021-03-17T02:11:58Z)
• Careful with That! Observation of Human Movements to Estimate Objects Properties [106.925705883949]
  We focus on the features of human motor actions that communicate insights on the weight of an object. Our final goal is to enable a robot to autonomously infer the degree of care required in object handling.
  arXiv  Detail & Related papers  (2021-03-02T08:14:56Z)
• Where is my hand? Deep hand segmentation for visual self-recognition in humanoid robots [129.46920552019247]
  We propose the use of a Convolution Neural Network (CNN) to segment the robot hand from an image in an egocentric view. We fine-tuned the Mask-RCNN network for the specific task of segmenting the hand of the humanoid robot Vizzy.
  arXiv  Detail & Related papers  (2021-02-09T10:34:32Z)
• Object Detection and Pose Estimation from RGB and Depth Data for Real-time, Adaptive Robotic Grasping [0.0]
  We propose a system that performs real-time object detection and pose estimation, for the purpose of dynamic robot grasping. The proposed approach allows the robot to detect the object identity and its actual pose, and then adapt a canonical grasp in order to be used with the new pose. For training, the system defines a canonical grasp by capturing the relative pose of an object with respect to the gripper attached to the robot's wrist. During testing, once a new pose is detected, a canonical grasp for the object is identified and then dynamically adapted by adjusting the robot arm's joint angles.
  arXiv  Detail & Related papers  (2021-01-18T22:22:47Z)
• Human Grasp Classification for Reactive Human-to-Robot Handovers [50.91803283297065]
  We propose an approach for human-to-robot handovers in which the robot meets the human halfway. We collect a human grasp dataset which covers typical ways of holding objects with various hand shapes and poses. We present a planning and execution approach that takes the object from the human hand according to the detected grasp and hand position.
  arXiv  Detail & Related papers  (2020-03-12T19:58:03Z)
• Morphology-Agnostic Visual Robotic Control [76.44045983428701]
  MAVRIC is an approach that works with minimal prior knowledge of the robot's morphology. We demonstrate our method on visually-guided 3D point reaching, trajectory following, and robot-to-robot imitation.
  arXiv  Detail & Related papers  (2019-12-31T15:45:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.