Drones that Think on their Feet: Sudden Landing Decisions with Embodied AI

• URL: http://arxiv.org/abs/2510.00167v1
• Date: Tue, 30 Sep 2025 18:39:36 GMT
• Title: Drones that Think on their Feet: Sudden Landing Decisions with Embodied AI
• Authors: Diego Ortiz Barbosa, Mohit Agrawal, Yash Malegaonkar, Luis Burbano, Axel Andersson, György Dán, Henrik Sandberg, Alvaro A. Cardenas,
• Abstract summary: We show how embodied AI can provide commonsense reasoning to assess context and generate appropriate actions in real time.<n>We demonstrate this capability in a simulated urban benchmark in the Unreal Engine.<n>Our results show that embodied AI makes possible a new class of adaptive recovery and decision-making pipelines.
• Score: 14.561963049138326
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous drones must often respond to sudden events, such as alarms, faults, or unexpected changes in their environment, that require immediate and adaptive decision-making. Traditional approaches rely on safety engineers hand-coding large sets of recovery rules, but this strategy cannot anticipate the vast range of real-world contingencies and quickly becomes incomplete. Recent advances in embodied AI, powered by large visual language models, provide commonsense reasoning to assess context and generate appropriate actions in real time. We demonstrate this capability in a simulated urban benchmark in the Unreal Engine, where drones dynamically interpret their surroundings and decide on sudden maneuvers for safe landings. Our results show that embodied AI makes possible a new class of adaptive recovery and decision-making pipelines that were previously infeasible to design by hand, advancing resilience and safety in autonomous aerial systems.

Related papers

• A Future Capabilities Agent for Tactical Air Traffic Control [0.0]
  Agent Mallard is a rules-based tactical agent for control in systemised airspace.<n>The architecture is intended to combine model-based safety assessment, interpretable decision logic, and tractable computational performance.
  arXiv  Detail & Related papers  (2026-01-07T14:19:46Z)
• Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles [47.25901323750217]
  The generation of safety-critical scenarios in simulation has become increasingly crucial for safety evaluation in autonomous vehicles prior to road deployment in society.<n>We propose ScenGE, a framework that can generate plentiful safety-critical scenarios by reasoning novel adversarial cases and then amplifying them with complex traffic flows.<n>We validate our framework through real-world vehicle tests and human evaluation, confirming that the generated scenarios are both plausible and critical.
  arXiv  Detail & Related papers  (2025-08-20T08:36:57Z)
• Socially-Aware Autonomous Driving: Inferring Yielding Intentions for Safer Interactions [7.735477839355801]
  We propose a social intention estimation algorithm rooted in Directed Acyclic Graph (DAG) and a decision-making framework employing Deep Reinforcement Learning (DRL) algorithms.<n>To evaluate the method's performance, the proposed framework can be tested and applied in a lane-changing scenario within a simulated environment.
  arXiv  Detail & Related papers  (2025-04-28T17:24:04Z)
• Lander.AI: Adaptive Landing Behavior Agent for Expertise in 3D Dynamic Platform Landings [2.5022287664959446]
  This study introduces an advanced Deep Reinforcement Learning (DRL) agent, Lander:AI, designed to navigate and land on platforms in the presence of windy conditions. Lander:AI is rigorously trained within the gym-pybullet-drone simulation, an environment that mirrors real-world complexities, including wind turbulence. The experimental results showcased Lander:AI's high-precision landing and its ability to adapt to moving platforms, even under wind-induced disturbances.
  arXiv  Detail & Related papers  (2024-03-11T10:20:44Z)
• A GP-based Robust Motion Planning Framework for Agile Autonomous Robot Navigation and Recovery in Unknown Environments [6.859965454961918]
  We propose a model for proactively detecting the risk of future motion planning failure. When the risk exceeds a certain threshold, a recovery behavior is triggered. Our framework is capable of both predicting planner failures and recovering the robot to states where planner success is likely.
  arXiv  Detail & Related papers  (2024-02-02T18:27:21Z)
• HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments [93.94020724735199]
  HAZARD consists of three unexpected disaster scenarios, including fire, flood, and wind. This benchmark enables us to evaluate autonomous agents' decision-making capabilities across various pipelines.
  arXiv  Detail & Related papers  (2024-01-23T18:59:43Z)
• SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries [94.84458417662407]
  We introduce SAFE-SIM, a controllable closed-loop safety-critical simulation framework. Our approach yields two distinct advantages: 1) generating realistic long-tail safety-critical scenarios that closely reflect real-world conditions, and 2) providing controllable adversarial behavior for more comprehensive and interactive evaluations. We validate our framework empirically using the nuScenes and nuPlan datasets across multiple planners, demonstrating improvements in both realism and controllability.
  arXiv  Detail & Related papers  (2023-12-31T04:14:43Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing [52.50284630866713]
  Existing systems often require hand-engineered components for state estimation, planning, and control. This paper tackles the vision-based autonomous-drone-racing problem by learning deep sensorimotor policies.
  arXiv  Detail & Related papers  (2022-10-26T19:03:17Z)
• Visual-based Safe Landing for UAVs in Populated Areas: Real-time Validation in Virtual Environments [0.0]
  We propose a framework for real-time safe and thorough evaluation of vision-based autonomous landing in populated scenarios. We propose to use the Unreal graphics engine coupled with the AirSim plugin for drone's simulation. We study two different criteria for selecting the "best" SLZ, and evaluate them during autonomous landing of a virtual drone in different scenarios.
  arXiv  Detail & Related papers  (2022-03-25T17:22:24Z)
• Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving [104.32241082170044]
  We study a new task, safety-aware motion prediction with unseen vehicles for autonomous driving. Unlike the existing trajectory prediction task for seen vehicles, we aim at predicting an occupancy map. Our approach is the first one that can predict the existence of unseen vehicles in most cases.
  arXiv  Detail & Related papers  (2021-09-03T13:33:33Z)
• Deep Structured Reactive Planning [94.92994828905984]
  We propose a novel data-driven, reactive planning objective for self-driving vehicles. We show that our model outperforms a non-reactive variant in successfully completing highly complex maneuvers.
  arXiv  Detail & Related papers  (2021-01-18T01:43:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.