From SLAM to Situational Awareness: Challenges and Survey
- URL: http://arxiv.org/abs/2110.00273v5
- Date: Thu, 27 Apr 2023 16:14:24 GMT
- Title: From SLAM to Situational Awareness: Challenges and Survey
- Authors: Hriday Bavle, Jose Luis Sanchez-Lopez, Claudio Cimarelli, Ali Tourani,
Holger Voos
- Abstract summary: The capability of a mobile robot to efficiently and safely perform complex missions is limited by its knowledge of the environment.
Advanced reasoning, decision-making, and execution skills enable an intelligent agent to act autonomously in unknown environments.
This paper investigates each aspect of Situational Awareness, surveying the state-of-the-art robotics algorithms that cover them.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The capability of a mobile robot to efficiently and safely perform complex
missions is limited by its knowledge of the environment, namely the situation.
Advanced reasoning, decision-making, and execution skills enable an intelligent
agent to act autonomously in unknown environments. Situational Awareness (SA)
is a fundamental capability of humans that has been deeply studied in various
fields, such as psychology, military, aerospace, and education. Nevertheless,
it has yet to be considered in robotics, which has focused on single
compartmentalized concepts such as sensing, spatial perception, sensor fusion,
state estimation, and Simultaneous Localization and Mapping (SLAM). Hence, the
present research aims to connect the broad multidisciplinary existing knowledge
to pave the way for a complete SA system for mobile robotics that we deem
paramount for autonomy. To this aim, we define the principal components to
structure a robotic SA and their area of competence. Accordingly, this paper
investigates each aspect of SA, surveying the state-of-the-art robotics
algorithms that cover them, and discusses their current limitations.
Remarkably, essential aspects of SA are still immature since the current
algorithmic development restricts their performance to only specific
environments. Nevertheless, Artificial Intelligence (AI), particularly Deep
Learning (DL), has brought new methods to bridge the gap that maintains these
fields apart from the deployment to real-world scenarios. Furthermore, an
opportunity has been discovered to interconnect the vastly fragmented space of
robotic comprehension algorithms through the mechanism of Situational Graph
(S-Graph), a generalization of the well-known scene graph. Therefore, we
finally shape our vision for the future of robotic Situational Awareness by
discussing interesting recent research directions.
Related papers
- Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI [129.08019405056262]
Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial Intelligence (AGI)
MLMs andWMs have attracted significant attention due to their remarkable perception, interaction, and reasoning capabilities.
In this survey, we give a comprehensive exploration of the latest advancements in Embodied AI.
arXiv Detail & Related papers (2024-07-09T14:14:47Z) - A Survey on Robotics with Foundation Models: toward Embodied AI [30.999414445286757]
Recent advances in computer vision, natural language processing, and multi-modality learning have shown that the foundation models have superhuman capabilities for specific tasks.
This survey aims to provide a comprehensive and up-to-date overview of foundation models in robotics, focusing on autonomous manipulation and encompassing high-level planning and low-level control.
arXiv Detail & Related papers (2024-02-04T07:55:01Z) - On the Emergence of Symmetrical Reality [51.21203247240322]
We introduce the symmetrical reality framework, which offers a unified representation encompassing various forms of physical-virtual amalgamations.
We propose an instance of an AI-driven active assistance service that illustrates the potential applications of symmetrical reality.
arXiv Detail & Related papers (2024-01-26T16:09:39Z) - Selected Trends in Artificial Intelligence for Space Applications [69.3474006357492]
This chapter focuses on differentiable intelligence and on-board machine learning.
We discuss a few selected projects originating from the European Space Agency's (ESA) Advanced Concepts Team (ACT)
arXiv Detail & Related papers (2022-12-10T07:49:50Z) - Discovering Unsupervised Behaviours from Full-State Trajectories [1.827510863075184]
We propose an analysis of Autonomous Robots Realising their Abilities; a Quality-Diversity algorithm that autonomously finds behavioural characterisations.
We evaluate this approach on a simulated robotic environment, where the robot has to autonomously discover its abilities from its full-state trajectories.
More specifically, the analysed approach autonomously finds policies that make the robot move to diverse positions, but also utilise its legs in diverse ways, and even perform half-rolls.
arXiv Detail & Related papers (2022-11-22T16:57:52Z) - Autonomous Aerial Robot for High-Speed Search and Intercept Applications [86.72321289033562]
A fully-autonomous aerial robot for high-speed object grasping has been proposed.
As an additional sub-task, our system is able to autonomously pierce balloons located in poles close to the surface.
Our approach has been validated in a challenging international competition and has shown outstanding results.
arXiv Detail & Related papers (2021-12-10T11:49:51Z) - From Machine Learning to Robotics: Challenges and Opportunities for
Embodied Intelligence [113.06484656032978]
Article argues that embodied intelligence is a key driver for the advancement of machine learning technology.
We highlight challenges and opportunities specific to embodied intelligence.
We propose research directions which may significantly advance the state-of-the-art in robot learning.
arXiv Detail & Related papers (2021-10-28T16:04:01Z) - Low Dimensional State Representation Learning with Robotics Priors in
Continuous Action Spaces [8.692025477306212]
Reinforcement learning algorithms have proven to be capable of solving complicated robotics tasks in an end-to-end fashion.
We propose a framework combining the learning of a low-dimensional state representation, from high-dimensional observations coming from the robot's raw sensory readings, with the learning of the optimal policy.
arXiv Detail & Related papers (2021-07-04T15:42:01Z) - REAL-X -- Robot open-Ended Autonomous Learning Architectures: Achieving
Truly End-to-End Sensorimotor Autonomous Learning Systems [0.0]
We study the challenges posed by the previously proposed benchmark REAL competition'
We present a set of REAL-X' robot architectures that are able to solve different versions of the benchmark.
arXiv Detail & Related papers (2020-11-27T18:12:06Z) - SAPIEN: A SimulAted Part-based Interactive ENvironment [77.4739790629284]
SAPIEN is a realistic and physics-rich simulated environment that hosts a large-scale set for articulated objects.
We evaluate state-of-the-art vision algorithms for part detection and motion attribute recognition as well as demonstrate robotic interaction tasks.
arXiv Detail & Related papers (2020-03-19T00:11:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.