Predicting Human Strategies in Simulated Search and Rescue Task

• URL: http://arxiv.org/abs/2011.07656v2
• Date: Thu, 19 Nov 2020 23:26:39 GMT
• Title: Predicting Human Strategies in Simulated Search and Rescue Task
• Authors: Vidhi Jain, Rohit Jena, Huao Li, Tejus Gupta, Dana Hughes, Michael Lewis, Katia Sycara
• Abstract summary: In a search and rescue scenario, rescuers may have different knowledge of the environment and strategies for exploration. We build models of the rescuers based on their trajectory observations to predict their strategies. We show results in terms of prediction accuracy of our computational approaches as compared with that of human observers.
• Score: 2.801609183344662
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In a search and rescue scenario, rescuers may have different knowledge of the environment and strategies for exploration. Understanding what is inside a rescuer's mind will enable an observer agent to proactively assist them with critical information that can help them perform their task efficiently. To this end, we propose to build models of the rescuers based on their trajectory observations to predict their strategies. In our efforts to model the rescuer's mind, we begin with a simple simulated search and rescue task in Minecraft with human participants. We formulate neural sequence models to predict the triage strategy and the next location of the rescuer. As the neural networks are data-driven, we design a diverse set of artificial "faux human" agents for training, to test them with limited human rescuer trajectory data. To evaluate the agents, we compare it to an evidence accumulation method that explicitly incorporates all available background knowledge and provides an intended upper bound for the expected performance. Further, we perform experiments where the observer/predictor is human. We show results in terms of prediction accuracy of our computational approaches as compared with that of human observers.

Related papers

• ForesightNav: Learning Scene Imagination for Efficient Exploration [57.49417653636244]
  We propose ForesightNav, a novel exploration strategy inspired by human imagination and reasoning. Our approach equips robotic agents with the capability to predict contextual information, such as occupancy and semantic details, for unexplored regions. We validate our imagination-based approach using the Structured3D dataset, demonstrating accurate occupancy prediction and superior performance in anticipating unseen scene geometry.
  arXiv  Detail & Related papers  (2025-04-22T17:38:38Z)
• Predictive Probability Density Mapping for Search and Rescue Using An Agent-Based Approach with Sparse Data [0.294944680995069]
  We introduce an agent-based model designed to replicate diverse psychological profiles of lost persons. The model allows these agents to navigate real-world landscapes while making decisions autonomously. This work introduces a flexible agent that can be employed in search and rescue operations, offering adaptability across various geographical locations.
  arXiv  Detail & Related papers  (2024-12-17T20:37:26Z)
• CoNav: A Benchmark for Human-Centered Collaborative Navigation [66.6268966718022]
  We propose a collaborative navigation (CoNav) benchmark. Our CoNav tackles the critical challenge of constructing a 3D navigation environment with realistic and diverse human activities. We propose an intention-aware agent for reasoning both long-term and short-term human intention.
  arXiv  Detail & Related papers  (2024-06-04T15:44:25Z)
• Humanoid Locomotion as Next Token Prediction [84.21335675130021]
  Our model is a causal transformer trained via autoregressive prediction of sensorimotor trajectories. We show that our model enables a full-sized humanoid to walk in San Francisco zero-shot. Our model can transfer to the real world even when trained on only 27 hours of walking data, and can generalize commands not seen during training like walking backward.
  arXiv  Detail & Related papers  (2024-02-29T18:57:37Z)
• Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Prediction [45.77348842004666]
  Motion Pattern Priors Memory Network is a memory-based method to uncover latent motion patterns in human behavior. We introduce an addressing mechanism to retrieve the matched pattern and the potential target distributions for each prediction from the memory bank. Experiments validate the effectiveness of our approach, achieving state-of-the-art trajectory prediction accuracy.
  arXiv  Detail & Related papers  (2024-01-05T17:39:52Z)
• Learning to Explore Informative Trajectories and Samples for Embodied Perception [24.006056116516618]
  Generalizing perception models to unseen embodied tasks is insufficiently studied. We build a 3D semantic distribution map to train the exploration policy self-supervised. With the explored informative trajectories, we propose to select hard samples on trajectories based on the semantic distribution uncertainty. Experiments show that the perception model fine-tuned with our method outperforms the baselines trained with other exploration policies.
  arXiv  Detail & Related papers  (2023-03-20T08:20:04Z)
• Behavioral Cloning via Search in Video PreTraining Latent Space [0.13999481573773073]
  We formulate our control problem as a search problem over a dataset of experts' demonstrations. We perform a proximity search over the BASALT MineRL-dataset in the latent representation of a Video PreTraining model. The agent copies the actions from the expert trajectory as long as the distance between the state representations of the agent and the selected expert trajectory from the dataset do not diverge.
  arXiv  Detail & Related papers  (2022-12-27T00:20:37Z)
• Using Features at Multiple Temporal and Spatial Resolutions to Predict Human Behavior in Real Time [2.955419572714387]
  We present an approach for integrating high and low-resolution spatial and temporal information to predict human behavior in real time. Our model composes neural networks for high and low-resolution feature extraction with a neural network for behavior prediction, with all three networks trained simultaneously.
  arXiv  Detail & Related papers  (2022-11-12T18:41:33Z)
• Probabilistic Human Motion Prediction via A Bayesian Neural Network [71.16277790708529]
  We propose a probabilistic model for human motion prediction in this paper. Our model could generate several future motions when given an observed motion sequence. We extensively validate our approach on a large scale benchmark dataset Human3.6m.
  arXiv  Detail & Related papers  (2021-07-14T09:05:33Z)
• Deep Interpretable Models of Theory of Mind For Human-Agent Teaming [0.7734726150561086]
  We develop an interpretable modular neural framework for modeling the intentions of other observed entities. We demonstrate the efficacy of our approach with experiments on data from human participants on a search and rescue task in Minecraft.
  arXiv  Detail & Related papers  (2021-04-07T06:18:58Z)
• Self-Supervision by Prediction for Object Discovery in Videos [62.87145010885044]
  In this paper, we use the prediction task as self-supervision and build a novel object-centric model for image sequence representation. Our framework can be trained without the help of any manual annotation or pretrained network. Initial experiments confirm that the proposed pipeline is a promising step towards object-centric video prediction.
  arXiv  Detail & Related papers  (2021-03-09T19:14:33Z)
• Parrot: Data-Driven Behavioral Priors for Reinforcement Learning [79.32403825036792]
  We propose a method for pre-training behavioral priors that can capture complex input-output relationships observed in successful trials. We show how this learned prior can be used for rapidly learning new tasks without impeding the RL agent's ability to try out novel behaviors.
  arXiv  Detail & Related papers  (2020-11-19T18:47:40Z)
• CONSAC: Robust Multi-Model Fitting by Conditional Sample Consensus [62.86856923633923]
  We present a robust estimator for fitting multiple parametric models of the same form to noisy measurements. In contrast to previous works, which resorted to hand-crafted search strategies for multiple model detection, we learn the search strategy from data. For self-supervised learning of the search, we evaluate the proposed algorithm on multi-homography estimation and demonstrate an accuracy that is superior to state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-01-08T17:37:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.