ADAPT: An Open-Source sUAS Payload for Real-Time Disaster Prediction and
Response with AI
- URL: http://arxiv.org/abs/2201.10366v1
- Date: Tue, 25 Jan 2022 14:51:19 GMT
- Title: ADAPT: An Open-Source sUAS Payload for Real-Time Disaster Prediction and
Response with AI
- Authors: Daniel Davila, Joseph VanPelt, Alexander Lynch, Adam Romlein, Peter
Webley, Matthew S. Brown
- Abstract summary: Small unmanned aircraft systems (sUAS) are becoming prominent components of many humanitarian assistance and disaster response operations.
We have developed the free and open-source ADAPT multi-mission payload for deploying real-time AI and computer vision onboard a sUAS.
We demonstrate the example mission of real-time, in-flight ice segmentation to monitor river ice state and provide timely predictions of catastrophic flooding events.
- Score: 55.41644538483948
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Small unmanned aircraft systems (sUAS) are becoming prominent components of
many humanitarian assistance and disaster response (HADR) operations. Pairing
sUAS with onboard artificial intelligence (AI) substantially extends their
utility in covering larger areas with fewer support personnel. A variety of
missions, such as search and rescue, assessing structural damage, and
monitoring forest fires, floods, and chemical spills, can be supported simply
by deploying the appropriate AI models. However, adoption by
resource-constrained groups, such as local municipalities, regulatory agencies,
and researchers, has been hampered by the lack of a cost-effective,
readily-accessible baseline platform that can be adapted to their unique
missions. To fill this gap, we have developed the free and open-source ADAPT
multi-mission payload for deploying real-time AI and computer vision onboard a
sUAS during local and beyond-line-of-site missions. We have emphasized a
modular design with low-cost, readily-available components, open-source
software, and thorough documentation (https://kitware.github.io/adapt/). The
system integrates an inertial navigation system, high-resolution color camera,
computer, and wireless downlink to process imagery and broadcast georegistered
analytics back to a ground station. Our goal is to make it easy for the HADR
community to build their own copies of the ADAPT payload and leverage the
thousands of hours of engineering we have devoted to developing and testing. In
this paper, we detail the development and testing of the ADAPT payload. We
demonstrate the example mission of real-time, in-flight ice segmentation to
monitor river ice state and provide timely predictions of catastrophic flooding
events. We deploy a novel active learning workflow to annotate river ice
imagery, train a real-time deep neural network for ice segmentation, and
demonstrate operation in the field.
Related papers
- Orbital AI-based Autonomous Refuelling Solution [6.776059370975249]
This paper documents the development of a proposed AI-based navigation algorithm intending to mature the use of on-board visible wavelength cameras as a main sensor for docking and on-orbit servicing (OOS)
Multiple convolutional neural network backbone architectures are benchmarked on synthetically generated data of docking manoeuvres with the International Space Station (ISS)
The integration of the solution with a physical prototype of the refuelling mechanism is validated in laboratory using a robotic arm to simulate a berthing procedure.
arXiv Detail & Related papers (2023-09-20T21:25:52Z) - Efficient Real-time Smoke Filtration with 3D LiDAR for Search and Rescue
with Autonomous Heterogeneous Robotic Systems [56.838297900091426]
Smoke and dust affect the performance of any mobile robotic platform due to their reliance on onboard perception systems.
This paper proposes a novel modular computation filtration pipeline based on intensity and spatial information.
arXiv Detail & Related papers (2023-08-14T16:48:57Z) - Aerial View Goal Localization with Reinforcement Learning [6.165163123577484]
We present a framework that emulates a search-and-rescue (SAR)-like setup without requiring access to actual UAVs.
In this framework, an agent operates on top of an aerial image (proxy for a search area) and is tasked with localizing a goal that is described in terms of visual cues.
We propose AiRLoc, a reinforcement learning (RL)-based model that decouples exploration (searching for distant goals) and exploitation (localizing nearby goals)
arXiv Detail & Related papers (2022-09-08T10:27:53Z) - AirDet: Few-Shot Detection without Fine-tuning for Autonomous
Exploration [16.032316550612336]
We present AirDet, which is free of fine-tuning by learning class relation with support images.
AirDet achieves comparable or even better results than the exhaustively finetuned methods, reaching up to 40-60% improvements on the baseline.
We present evaluation results on real-world exploration tests from the DARPA Subterranean Challenge.
arXiv Detail & Related papers (2021-12-03T06:41:07Z) - Rethinking Drone-Based Search and Rescue with Aerial Person Detection [79.76669658740902]
The visual inspection of aerial drone footage is an integral part of land search and rescue (SAR) operations today.
We propose a novel deep learning algorithm to automate this aerial person detection (APD) task.
We present the novel Aerial Inspection RetinaNet (AIR) algorithm as the combination of these contributions.
arXiv Detail & Related papers (2021-11-17T21:48:31Z) - A Multi-UAV System for Exploration and Target Finding in Cluttered and
GPS-Denied Environments [68.31522961125589]
We propose a framework for a team of UAVs to cooperatively explore and find a target in complex GPS-denied environments with obstacles.
The team of UAVs autonomously navigates, explores, detects, and finds the target in a cluttered environment with a known map.
Results indicate that the proposed multi-UAV system has improvements in terms of time-cost, the proportion of search area surveyed, as well as successful rates for search and rescue missions.
arXiv Detail & Related papers (2021-07-19T12:54:04Z) - EmergencyNet: Efficient Aerial Image Classification for Drone-Based
Emergency Monitoring Using Atrous Convolutional Feature Fusion [8.634988828030245]
This article focuses on the efficient aerial image classification from on-board a UAV for emergency response/monitoring applications.
A dedicated Aerial Image Database for Emergency Response applications is introduced and a comparative analysis of existing approaches is performed.
A lightweight convolutional neural network architecture is proposed, referred to as EmergencyNet, based on atrous convolutions to process multiresolution features.
arXiv Detail & Related papers (2021-04-28T20:24:10Z) - Efficient UAV Trajectory-Planning using Economic Reinforcement Learning [65.91405908268662]
We introduce REPlanner, a novel reinforcement learning algorithm inspired by economic transactions to distribute tasks between UAVs.
We formulate the path planning problem as a multi-agent economic game, where agents can cooperate and compete for resources.
As the system computes task distributions via UAV cooperation, it is highly resilient to any change in the swarm size.
arXiv Detail & Related papers (2021-03-03T20:54:19Z) - Artificial Intelligence for UAV-enabled Wireless Networks: A Survey [72.10851256475742]
Unmanned aerial vehicles (UAVs) are considered as one of the promising technologies for the next-generation wireless communication networks.
Artificial intelligence (AI) is growing rapidly nowadays and has been very successful.
We provide a comprehensive overview of some potential applications of AI in UAV-based networks.
arXiv Detail & Related papers (2020-09-24T07:11:31Z) - AutoSOS: Towards Multi-UAV Systems Supporting Maritime Search and Rescue
with Lightweight AI and Edge Computing [27.15999421608932]
This paper presents the research directions of the AutoSOS project, where we work in the development of an autonomous multi-robot search and rescue assistance platform.
The platform is meant to perform reconnaissance missions for initial assessment of the environment using novel adaptive deep learning algorithms.
When drones find potential objects, they will send their sensor data to the vessel to verity the findings with increased accuracy.
arXiv Detail & Related papers (2020-05-07T12:22:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.