When the Inference Meets the Explicitness or Why Multimodality Can Make Us Forget About the Perfect Predictor

• URL: http://arxiv.org/abs/2602.18850v1
• Date: Sat, 21 Feb 2026 14:27:10 GMT
• Title: When the Inference Meets the Explicitness or Why Multimodality Can Make Us Forget About the Perfect Predictor
• Abstract summary: This work is analyzed the use of four different communication systems with a human-robot collaborative object transportation task as experimental testbed.<n>The systems were integrated into IVO, a custom mobile social robot equipped with force sensor to detect the force exchange between both agents and LiDAR to detect the environment.<n>75 volunteers perform a total of 255 executions divided into three groups, testing inference systems in the first round, communication systems in the second, and the combined strategies in the third.
• Score: 2.6212127510234797
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Although in the literature it is common to find predictors and inference systems that try to predict human intentions, the uncertainty of these models due to the randomness of human behavior has led some authors to start advocating the use of communication systems that explicitly elicit human intention. In this work, it is analyzed the use of four different communication systems with a human-robot collaborative object transportation task as experimental testbed: two intention predictors (one based on force prediction and another with an enhanced velocity prediction algorithm) and two explicit communication methods (a button interface and a voice-command recognition system). These systems were integrated into IVO, a custom mobile social robot equipped with force sensor to detect the force exchange between both agents and LiDAR to detect the environment. The collaborative task required transporting an object over a 5-7 meter distance with obstacles in the middle, demanding rapid decisions and precise physical coordination. 75 volunteers perform a total of 255 executions divided into three groups, testing inference systems in the first round, communication systems in the second, and the combined strategies in the third. The results show that, 1) once sufficient performance is achieved, the human no longer notices and positively assesses technical improvements; 2) the human prefers systems that are more natural to them even though they have higher failure rates; and 3) the preferred option is the right combination of both systems.

Related papers

• Uncertainty Mitigation and Intent Inference: A Dual-Mode Human-Machine Joint Planning System [16.75873002054227]
  We propose a unified human-robot joint planning system to tackle dual sources of uncertainty.<n>First, an uncertainty-mitigation joint planning module enables two-way conversations to resolve semantic ambiguity and object uncertainty.<n>Second, a real-time intent-aware collaboration module maintains a probabilistic belief over the human's latent task intent.
  arXiv  Detail & Related papers  (2026-03-08T21:43:30Z)
• An Approach to Combining Video and Speech with Large Language Models in Human-Robot Interaction [0.0]
  This work presents a novel HRI framework that combines advanced vision-language models, speech processing, and fuzzy logic.<n>The proposed system integrates Florence-2 for object detection, Llama 3.1 for natural language understanding, and Whisper for speech recognition.<n> Experimental evaluations conducted on consumer-grade hardware demonstrate a command execution accuracy of 75%.
  arXiv  Detail & Related papers  (2026-02-23T09:05:15Z)
• Social-Transmotion: Promptable Human Trajectory Prediction [65.80068316170613]
  Social-Transmotion is a generic Transformer-based model that exploits diverse and numerous visual cues to predict human behavior.<n>Our approach is validated on multiple datasets, including JTA, JRDB, Pedestrians and Cyclists in Road Traffic, and ETH-UCY.
  arXiv  Detail & Related papers  (2023-12-26T18:56:49Z)
• Real-time Addressee Estimation: Deployment of a Deep-Learning Model on the iCub Robot [52.277579221741746]
  Addressee Estimation is a skill essential for social robots to interact smoothly with humans. Inspired by human perceptual skills, a deep-learning model for Addressee Estimation is designed, trained, and deployed on an iCub robot. The study presents the procedure of such implementation and the performance of the model deployed in real-time human-robot interaction.
  arXiv  Detail & Related papers  (2023-11-09T13:01:21Z)
• HODN: Disentangling Human-Object Feature for HOI Detection [51.48164941412871]
  We propose a Human and Object Disentangling Network (HODN) to model the Human-Object Interaction (HOI) relationships explicitly. Considering that human features are more contributive to interaction, we propose a Human-Guide Linking method to make sure the interaction decoder focuses on the human-centric regions. Our proposed method achieves competitive performance on both the V-COCO and the HICO-Det Linking datasets.
  arXiv  Detail & Related papers  (2023-08-20T04:12:50Z)
• Qualitative Prediction of Multi-Agent Spatial Interactions [5.742409080817885]
  We present and benchmark three new approaches to model and predict multi-agent interactions in dense scenes. The proposed solutions take into account static and dynamic context to predict individual interactions. They exploit an input- and a temporal-attention mechanism, and are tested on medium and long-term time horizons.
  arXiv  Detail & Related papers  (2023-06-30T18:08:25Z)
• Cognitive Semantic Communication Systems Driven by Knowledge Graph: Principle, Implementation, and Performance Evaluation [74.38561925376996]
  Two cognitive semantic communication frameworks are proposed for the single-user and multiple-user communication scenarios. An effective semantic correction algorithm is proposed by mining the inference rule from the knowledge graph. For the multi-user cognitive semantic communication system, a message recovery algorithm is proposed to distinguish messages of different users.
  arXiv  Detail & Related papers  (2023-03-15T12:01:43Z)
• Simulation of robot swarms for learning communication-aware coordination [0.0]
  We train end-to-end Neural Networks that take as input local observations obtained from an omniscient centralised controller. Experiments are run in Enki, a high-performance open-source simulator for planar robots.
  arXiv  Detail & Related papers  (2023-02-25T17:17:40Z)
• Role of Human-AI Interaction in Selective Prediction [20.11364033416315]
  We study the impact of communicating different types of information to humans about the AI system's decision to defer. We show that it is possible to significantly boost human performance by informing the human of the decision to defer, but not revealing the prediction of the AI.
  arXiv  Detail & Related papers  (2021-12-13T16:03:13Z)
• Drivers' Manoeuvre Modelling and Prediction for Safe HRI [0.0]
  Theory of Mind has been broadly explored for robotics and recently for autonomous and semi-autonomous vehicles. We explored how to predict human intentions before an action is performed by combining data from human-motion, vehicle-state and human inputs.
  arXiv  Detail & Related papers  (2021-06-03T10:07:55Z)
• TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild [77.59069361196404]
  TRiPOD is a novel method for predicting body dynamics based on graph attentional networks. To incorporate a real-world challenge, we learn an indicator representing whether an estimated body joint is visible/invisible at each frame. Our evaluation shows that TRiPOD outperforms all prior work and state-of-the-art specifically designed for each of the trajectory and pose forecasting tasks.
  arXiv  Detail & Related papers  (2021-04-08T20:01:00Z)
• Human Haptic Gesture Interpretation for Robotic Systems [3.888848425698769]
  Physical human-robot interactions (pHRI) are less efficient and communicative than human-human interactions. A key reason is a lack of informative sense of touch in robotic systems. This work presents four proposed touch gesture classes that cover the majority of the gesture characteristics identified in the literature.
  arXiv  Detail & Related papers  (2020-12-03T14:33:57Z)
• Learning to Communicate and Correct Pose Errors [75.03747122616605]
  We study the setting proposed in V2VNet, where nearby self-driving vehicles jointly perform object detection and motion forecasting in a cooperative manner. We propose a novel neural reasoning framework that learns to communicate, to estimate potential errors, and to reach a consensus about those errors.
  arXiv  Detail & Related papers  (2020-11-10T18:19:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.