Mirror Skin: In Situ Visualization of Robot Touch Intent on Robotic Skin
- URL: http://arxiv.org/abs/2512.11472v2
- Date: Tue, 16 Dec 2025 13:51:59 GMT
- Title: Mirror Skin: In Situ Visualization of Robot Touch Intent on Robotic Skin
- Abstract summary: We present Mirror Skin, a concept that utilizes high-resolution, mirror-like visual feedback on robotic skin.<n>By mapping in-situ visual representations of a human's body parts onto the corresponding robot's touch region, Mirror Skin communicates who shall initiate touch, where it will occur, and when it is imminent.
- Score: 12.837347036705316
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Effective communication of robotic touch intent is a key factor in promoting safe and predictable physical human-robot interaction (pHRI). While intent communication has been widely studied, existing approaches lack the spatial specificity and semantic depth necessary to convey robot touch actions. We present Mirror Skin, a cephalopod-inspired concept that utilizes high-resolution, mirror-like visual feedback on robotic skin. By mapping in-situ visual representations of a human's body parts onto the corresponding robot's touch region, Mirror Skin communicates who shall initiate touch, where it will occur, and when it is imminent. To inform the design of Mirror Skin, we conducted a structured design exploration with experts in virtual reality (VR), iteratively refining six key dimensions. A subsequent controlled user study demonstrated that Mirror Skin significantly enhances accuracy and reduces response times for interpreting touch intent. These findings highlight the potential of visual feedback on robotic skin to communicate human-robot touch interactions.
Related papers
- Initiation of Interaction Detection Framework using a Nonverbal Cue for Human-Robot Interaction [15.228284553815593]
This paper describes an initiation of interaction(IoI) detection framework based on audio and vision sensor fusion.<n>In the proposed framework, the robot has its own audio and vision sensors, and can employ external vision sensor for stable human detection and tracking.
arXiv Detail & Related papers (2026-05-11T07:07:01Z) - Design, Mapping, and Contact Anticipation with 3D-printed Whole-Body Tactile and Proximity Sensors [38.7633637336366]
GenTact-Prox is a fully 3D-printed artificial skin that integrates tactile and proximity sensing for contact detection and anticipation.<n>The skin achieved detection ranges of up to 18 cm during evaluation.
arXiv Detail & Related papers (2026-03-05T01:29:30Z) - XR$^3$: An Extended Reality Platform for Social-Physical Human-Robot Interaction [7.5509967369489965]
We present XR$3$, a co-located operator and a hidden dual-VR-headset platform for HRI research.<n>The robot's upper-body motion, head and gaze behavior, and facial expressions are mapped from the operator's tracked limbs and face signals.<n>We detail the system design and calibration, and demonstrate the platform in a touch-based Wizard-of-Oz study.
arXiv Detail & Related papers (2026-01-18T13:11:41Z) - Towards Immersive Human-X Interaction: A Real-Time Framework for Physically Plausible Motion Synthesis [51.95817740348585]
Human-X is a novel framework designed to enable immersive and physically plausible human interactions across diverse entities.<n>Our method jointly predicts actions and reactions in real-time using an auto-regressive reaction diffusion planner.<n>Our framework is validated in real-world applications, including virtual reality interface for human-robot interaction.
arXiv Detail & Related papers (2025-08-04T06:35:48Z) - Multi-face emotion detection for effective Human-Robot Interaction [0.0]
This research proposes a facial emotion detection interface integrated into a mobile humanoid robot.<n>Various deep neural network models for facial expression recognition were developed and evaluated.
arXiv Detail & Related papers (2025-01-13T11:12:47Z) - Improving Visual Perception of a Social Robot for Controlled and
In-the-wild Human-robot Interaction [10.260966795508569]
It is unclear how will the objective interaction performance and subjective user experience be influenced when a social robot adopts a deep-learning based visual perception model.
We employ state-of-the-art human perception and tracking models to improve the visual perception function of the Pepper robot.
arXiv Detail & Related papers (2024-03-04T06:47:06Z) - Tactile-Filter: Interactive Tactile Perception for Part Mating [54.46221808805662]
Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks.
vision-based tactile sensors are being widely used for various robotic perception and control tasks.
We present a method for interactive perception using vision-based tactile sensors for a part mating task.
arXiv Detail & Related papers (2023-03-10T16:27:37Z) - See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation [49.925499720323806]
We study how visual, auditory, and tactile perception can jointly help robots to solve complex manipulation tasks.
We build a robot system that can see with a camera, hear with a contact microphone, and feel with a vision-based tactile sensor.
arXiv Detail & Related papers (2022-12-07T18:55:53Z) - Data-driven emotional body language generation for social robotics [58.88028813371423]
In social robotics, endowing humanoid robots with the ability to generate bodily expressions of affect can improve human-robot interaction and collaboration.
We implement a deep learning data-driven framework that learns from a few hand-designed robotic bodily expressions.
The evaluation study found that the anthropomorphism and animacy of the generated expressions are not perceived differently from the hand-designed ones.
arXiv Detail & Related papers (2022-05-02T09:21:39Z) - From Movement Kinematics to Object Properties: Online Recognition of
Human Carefulness [112.28757246103099]
We show how a robot can infer online, from vision alone, whether or not the human partner is careful when moving an object.
We demonstrated that a humanoid robot could perform this inference with high accuracy (up to 81.3%) even with a low-resolution camera.
The prompt recognition of movement carefulness from observing the partner's action will allow robots to adapt their actions on the object to show the same degree of care as their human partners.
arXiv Detail & Related papers (2021-09-01T16:03:13Z) - Projection Mapping Implementation: Enabling Direct Externalization of
Perception Results and Action Intent to Improve Robot Explainability [62.03014078810652]
Existing research on non-verbal cues, e.g., eye gaze or arm movement, may not accurately present a robot's internal states.
Projecting the states directly onto a robot's operating environment has the advantages of being direct, accurate, and more salient.
arXiv Detail & Related papers (2020-10-05T18:16:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.