Towards Formalizing HRI Data Collection Processes

• URL: http://arxiv.org/abs/2203.08396v1
• Date: Wed, 16 Mar 2022 04:59:18 GMT
• Title: Towards Formalizing HRI Data Collection Processes
• Authors: Zhao Han and Tom Williams
• Abstract summary: We contribute a clearly defined process to collect data with three steps for machine learning modeling purposes. Specifically, we discuss our data collection goal and how we worked to encourage well-covered and abundant participant responses.
• Score: 4.090390588417062
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Within the human-robot interaction (HRI) community, many researchers have focused on the careful design of human-subjects studies. However, other parts of the community, e.g., the technical advances community, also need to do human-subjects studies to collect data to train their models, in ways that require user studies but without a strict experimental design. The design of such data collection is an underexplored area worthy of more attention. In this work, we contribute a clearly defined process to collect data with three steps for machine learning modeling purposes, grounded in recent literature, and detail an use of this process to facilitate the collection of a corpus of referring expressions. Specifically, we discuss our data collection goal and how we worked to encourage well-covered and abundant participant responses, through our design of the task environment, the task itself, and the study procedure. We hope this work would lead to more data collection formalism efforts in the HRI community and a fruitful discussion during the workshop.

Related papers

• DISCOVER: A Data-driven Interactive System for Comprehensive Observation, Visualization, and ExploRation of Human Behaviour [6.716560115378451]
  We introduce a modular, flexible, yet user-friendly software framework specifically developed to streamline computational-driven data exploration for human behavior analysis. Our primary objective is to democratize access to advanced computational methodologies, thereby enabling researchers across disciplines to engage in detailed behavioral analysis without the need for extensive technical proficiency.
  arXiv  Detail & Related papers  (2024-07-18T11:28:52Z)
• Data Augmentation in Human-Centric Vision [54.97327269866757]
  This survey presents a comprehensive analysis of data augmentation techniques in human-centric vision tasks. It delves into a wide range of research areas including person ReID, human parsing, human pose estimation, and pedestrian detection. Our work categorizes data augmentation methods into two main types: data generation and data perturbation.
  arXiv  Detail & Related papers  (2024-03-13T16:05:18Z)
• RHOBIN Challenge: Reconstruction of Human Object Interaction [83.07185402102253]
  First RHOBIN challenge: reconstruction of human-object interactions in conjunction with the RHOBIN workshop. Our challenge consists of three tracks of 3D reconstruction from monocular RGB images with a focus on dealing with challenging interaction scenarios. This paper describes the settings of our challenge and discusses the winning methods of each track in more detail.
  arXiv  Detail & Related papers  (2024-01-07T23:37:07Z)
• Towards Multi-User Activity Recognition through Facilitated Training Data and Deep Learning for Human-Robot Collaboration Applications [2.3274633659223545]
  This study proposes an alternative way of gathering data regarding multi-user activity, by collecting data related to single users and merging them in post-processing. It is possible to make use of data collected in this way for pair HRC settings and get similar performances compared to using training data regarding groups of users recorded under the same settings.
  arXiv  Detail & Related papers  (2023-02-11T19:27:07Z)
• StyleGAN-Human: A Data-Centric Odyssey of Human Generation [96.7080874757475]
  This work takes a data-centric perspective and investigates multiple critical aspects in "data engineering" We collect and annotate a large-scale human image dataset with over 230K samples capturing diverse poses and textures. We rigorously investigate three essential factors in data engineering for StyleGAN-based human generation, namely data size, data distribution, and data alignment.
  arXiv  Detail & Related papers  (2022-04-25T17:55:08Z)
• Human-Robot Collaboration and Machine Learning: A Systematic Review of Recent Research [69.48907856390834]
  Human-robot collaboration (HRC) is the approach that explores the interaction between a human and a robot. This paper proposes a thorough literature review of the use of machine learning techniques in the context of HRC.
  arXiv  Detail & Related papers  (2021-10-14T15:14:33Z)
• RPT: Toward Transferable Model on Heterogeneous Researcher Data via Pre-Training [19.987304448524043]
  We propose a multi-task self-supervised learning-based researcher data pre-training model named RPT. We divide the researchers' data into semantic document sets and community graph. We propose three self-supervised learning objectives to train the whole model.
  arXiv  Detail & Related papers  (2021-10-08T03:42:09Z)
• A Survey of Human-in-the-loop for Machine Learning [7.056132067948671]
  Human-in-the-loop aims to train an accurate prediction model with minimum cost by integrating human knowledge and experience. This survey intends to provide a high-level summarization for human-in-the-loop and motivates interested readers to consider approaches for designing effective human-in-the-loop solutions.
  arXiv  Detail & Related papers  (2021-08-02T14:42:28Z)
• The Lab vs The Crowd: An Investigation into Data Quality for Neural Dialogue Models [0.0]
  We compare the performance of dialogue models for the same interaction task but collected in two settings: in the lab vs. crowd-sourced. We find that fewer lab dialogues are needed to reach similar accuracy, less than half the amount of lab data as crowd-sourced data.
  arXiv  Detail & Related papers  (2020-12-07T17:02:00Z)
• Batch Exploration with Examples for Scalable Robotic Reinforcement Learning [63.552788688544254]
  Batch Exploration with Examples (BEE) explores relevant regions of the state-space guided by a modest number of human provided images of important states. BEE is able to tackle challenging vision-based manipulation tasks both in simulation and on a real Franka robot.
  arXiv  Detail & Related papers  (2020-10-22T17:49:25Z)
• Human Trajectory Forecasting in Crowds: A Deep Learning Perspective [89.4600982169]
  We present an in-depth analysis of existing deep learning-based methods for modelling social interactions. We propose two knowledge-based data-driven methods to effectively capture these social interactions. We develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
  arXiv  Detail & Related papers  (2020-07-07T17:19:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.