Risk Assessment for Autonomous Landing in Urban Environments using Semantic Segmentation

• URL: http://arxiv.org/abs/2410.12988v1
• Date: Wed, 16 Oct 2024 19:34:03 GMT
• Title: Risk Assessment for Autonomous Landing in Urban Environments using Semantic Segmentation
• Abstract summary: We propose employing the SegFormer, a state-of-the-art visual transformer network, for semantic segmentation of urban environments. The proposed strategy is validated through several case studies. We believe will help unleash the full potential of UAVs on civil applications within urban areas.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we address the vision-based autonomous landing problem in complex urban environments using deep neural networks for semantic segmentation and risk assessment. We propose employing the SegFormer, a state-of-the-art visual transformer network, for the semantic segmentation of complex, unstructured urban environments. This approach yields valuable information that can be utilized in smart autonomous landing missions, particularly in emergency landing scenarios resulting from system failures or human errors. The assessment is done in real-time flight, when images of an RGB camera at the Unmanned Aerial Vehicle (UAV) are segmented with the SegFormer into the most common classes found in urban environments. These classes are then mapped into a level of risk, considering in general, potential material damage, damaging the drone itself and endanger people. The proposed strategy is validated through several case studies, demonstrating the huge potential of semantic segmentation-based strategies to determining the safest landing areas for autonomous emergency landing, which we believe will help unleash the full potential of UAVs on civil applications within urban areas.

Related papers

• SafeLand: Safe Autonomous Landing in Unknown Environments with Bayesian Semantic Mapping [41.90149506430796]
  We introduce SafeLand, a vision-based system for safe autonomous landing (SAL)<n>Our approach constructs an online semantic ground map via deep learning-based semantic segmentation, optimized for embedded deployment.<n>We extensively evaluate our method in 200 simulations and 60 end-to-end field tests across industrial, urban, and rural environments at altitudes up to 100m.
  arXiv  Detail & Related papers  (2026-03-18T07:11:54Z)
• A Multi-Robot Platform for Robotic Triage Combining Onboard Sensing and Foundation Models [51.02314427799649]
  The system employs a coordinated air-ground team of unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs)<n>The UAV identify and provide overhead views of casualties, while UGVs equipped with specialized sensors measure vital signs and detect and localize physical injuries.
  arXiv  Detail & Related papers  (2025-12-09T16:05:22Z)
• AerialMind: Towards Referring Multi-Object Tracking in UAV Scenarios [64.51320327698231]
  We introduce AerialMind, the first large-scale RMOT benchmark in UAV scenarios.<n>We develop an innovative semi-automated collaborative agent-based labeling assistant framework.<n>We also propose HawkEyeTrack, a novel method that collaboratively enhances vision-language representation learning.
  arXiv  Detail & Related papers  (2025-11-26T04:44:27Z)
• WarNav: An Autonomous Driving Benchmark for Segmentation of Navigable Zones in War Scenes [4.932414280306692]
  WarNav is a novel real-world dataset constructed from images of the open-source DATTALION repository.<n>This dataset addresses a critical gap between conventional urban driving resources and the unique operational scenarios encountered by unmanned systems in hazardous and damaged war-zones.
  arXiv  Detail & Related papers  (2025-11-19T13:32:26Z)
• Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles [47.25901323750217]
  The generation of safety-critical scenarios in simulation has become increasingly crucial for safety evaluation in autonomous vehicles prior to road deployment in society.<n>We propose ScenGE, a framework that can generate plentiful safety-critical scenarios by reasoning novel adversarial cases and then amplifying them with complex traffic flows.<n>We validate our framework through real-world vehicle tests and human evaluation, confirming that the generated scenarios are both plausible and critical.
  arXiv  Detail & Related papers  (2025-08-20T08:36:57Z)
• Reinforcement Learning for Decision-Level Interception Prioritization in Drone Swarm Defense [56.47577824219207]
  We present a case study demonstrating the practical advantages of reinforcement learning in addressing this challenge.<n>We introduce a high-fidelity simulation environment that captures realistic operational constraints.<n>Agent learns to coordinate multiple effectors for optimal interception prioritization.<n>We evaluate the learned policy against a handcrafted rule-based baseline across hundreds of simulated attack scenarios.
  arXiv  Detail & Related papers  (2025-08-01T13:55:39Z)
• Towards Perception-based Collision Avoidance for UAVs when Guiding the Visually Impaired [5.242869847419834]
  We present a perception-based path planning system for local planning around the neighborhood of the visually impaired.<n>We propose a multi DNN based framework for obstacle avoidance of the UAV as well as the VIP.<n>Our evaluations conducted on a drone human system in a university campus environment verifies the feasibility of our algorithms.
  arXiv  Detail & Related papers  (2025-06-17T09:08:30Z)
• Vision-Based Risk Aware Emergency Landing for UAVs in Complex Urban Environments [0.46873264197900916]
  We propose a risk-aware approach that harnesses semantic segmentation to continuously evaluate potential hazards in the drone's field of view.<n>Our method adaptively identifies a stable Safe Landing Zone (SLZ) despite moving critical obstacles.<n>A control system then guides the UAV toward this low-risk region, employing altitude-dependent safety thresholds and temporal landing point stabilization.
  arXiv  Detail & Related papers  (2025-05-26T18:16:21Z)
• Investigating Robotaxi Crash Severity with Geographical Random Forest and the Urban Environment [5.023563968303034]
  This paper quantitatively investigates the crash severity of Autonomous Vehicles (AVs) with spatially localized machine learning and macroscopic measures of the urban built environment.<n>Land use was the most important predictor, compared to intersections, building footprints, public transit stops, and Points Of Interest (POIs)<n> AV crashes were more likely to result in low-severity incidents in city center areas with greater diversity and commercial activities, than in residential neighborhoods.
  arXiv  Detail & Related papers  (2025-05-10T21:47:01Z)
• Black-Box Adversarial Attack on Vision Language Models for Autonomous Driving [65.61999354218628]
  We take the first step toward designing black-box adversarial attacks specifically targeting vision-language models (VLMs) in autonomous driving systems. We propose Cascading Adversarial Disruption (CAD), which targets low-level reasoning breakdown by generating and injecting semantics. We present Risky Scene Induction, which addresses dynamic adaptation by leveraging a surrogate VLM to understand and construct high-level risky scenarios.
  arXiv  Detail & Related papers  (2025-01-23T11:10:02Z)
• StreetSurfGS: Scalable Urban Street Surface Reconstruction with Planar-based Gaussian Splatting [85.67616000086232]
  StreetSurfGS is first method to employ Gaussian Splatting specifically tailored for scalable urban street scene surface reconstruction. StreetSurfGS utilizes a planar-based octree representation and segmented training to reduce memory costs, accommodate unique camera characteristics, and ensure scalability. To address sparse views and multi-scale challenges, we use a dual-step matching strategy that leverages adjacent and long-term information.
  arXiv  Detail & Related papers  (2024-10-06T04:21:59Z)
• Cross-View Geolocalization and Disaster Mapping with Street-View and VHR Satellite Imagery: A Case Study of Hurricane IAN [9.128051274958356]
  We propose a novel disaster mapping framework, namely CVDisaster, to simultaneously address geolocalization and damage perception estimation. CVDisaster consists of two cross-view models, where CVDisaster-Geoloc refers to a cross-view geolocalization model. We show that CVDisaster can achieve highly competitive performance (over 80% for geolocalization and 75% for damage perception estimation) with even limited fine-tuning efforts.
  arXiv  Detail & Related papers  (2024-08-13T09:37:26Z)
• MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility [52.0930915607703]
  Recent advances in Robotics and Embodied AI make public urban spaces no longer exclusive to humans. Micromobility enabled by AI for short-distance travel in public urban spaces plays a crucial component in the future transportation system. We present MetaUrban, a compositional simulation platform for the AI-driven urban micromobility research.
  arXiv  Detail & Related papers  (2024-07-11T17:56:49Z)
• Enhancing Safety for Autonomous Agents in Partly Concealed Urban Traffic Environments Through Representation-Based Shielding [2.9685635948300004]
  We propose a novel state representation for Reinforcement Learning (RL) agents centered around the information perceivable by an autonomous agent. Our findings pave the way for more robust and reliable autonomous navigation strategies.
  arXiv  Detail & Related papers  (2024-07-05T08:34:49Z)
• Learning to Assess Danger from Movies for Cooperative Escape Planning in Hazardous Environments [4.042350304426974]
  It is difficult to replicate such scenarios in the real world, which is necessary for training and testing purposes. Current systems are not fully able to take advantage of the rich multi-modal data available in such hazardous environments. We propose to harness the enormous amount of visual content available in the form of movies and TV shows, and develop a dataset that can represent hazardous environments encountered in the real world.
  arXiv  Detail & Related papers  (2022-07-27T21:07:15Z)
• Visual-based Safe Landing for UAVs in Populated Areas: Real-time Validation in Virtual Environments [0.0]
  We propose a framework for real-time safe and thorough evaluation of vision-based autonomous landing in populated scenarios. We propose to use the Unreal graphics engine coupled with the AirSim plugin for drone's simulation. We study two different criteria for selecting the "best" SLZ, and evaluate them during autonomous landing of a virtual drone in different scenarios.
  arXiv  Detail & Related papers  (2022-03-25T17:22:24Z)
• ADAPT: An Open-Source sUAS Payload for Real-Time Disaster Prediction and Response with AI [55.41644538483948]
  Small unmanned aircraft systems (sUAS) are becoming prominent components of many humanitarian assistance and disaster response operations. We have developed the free and open-source ADAPT multi-mission payload for deploying real-time AI and computer vision onboard a sUAS. We demonstrate the example mission of real-time, in-flight ice segmentation to monitor river ice state and provide timely predictions of catastrophic flooding events.
  arXiv  Detail & Related papers  (2022-01-25T14:51:19Z)
• Explainable, automated urban interventions to improve pedestrian and vehicle safety [0.8620335948752805]
  This paper combines public data sources, large-scale street imagery and computer vision techniques to approach pedestrian and vehicle safety. The steps involved in this pipeline include the adaptation and training of a Residual Convolutional Neural Network to determine a hazard index for each given urban scene. The outcome of this computational approach is a fine-grained map of hazard levels across a city, and an identify interventions that might simultaneously improve pedestrian and vehicle safety.
  arXiv  Detail & Related papers  (2021-10-22T09:17:39Z)
• A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments [68.31522961125589]
  We propose a framework for a team of UAVs to cooperatively explore and find a target in complex GPS-denied environments with obstacles. The team of UAVs autonomously navigates, explores, detects, and finds the target in a cluttered environment with a known map. Results indicate that the proposed multi-UAV system has improvements in terms of time-cost, the proportion of search area surveyed, as well as successful rates for search and rescue missions.
  arXiv  Detail & Related papers  (2021-07-19T12:54:04Z)
• AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles [76.46575807165729]
  We propose AdvSim, an adversarial framework to generate safety-critical scenarios for any LiDAR-based autonomy system. By simulating directly from sensor data, we obtain adversarial scenarios that are safety-critical for the full autonomy stack.
  arXiv  Detail & Related papers  (2021-01-16T23:23:12Z)
• Learning to Move with Affordance Maps [57.198806691838364]
  The ability to autonomously explore and navigate a physical space is a fundamental requirement for virtually any mobile autonomous agent. Traditional SLAM-based approaches for exploration and navigation largely focus on leveraging scene geometry. We show that learned affordance maps can be used to augment traditional approaches for both exploration and navigation, providing significant improvements in performance.
  arXiv  Detail & Related papers  (2020-01-08T04:05:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.