A Requirements-Driven Platform for Validating Field Operations of Small
Uncrewed Aerial Vehicles
- URL: http://arxiv.org/abs/2307.00194v1
- Date: Sat, 1 Jul 2023 02:03:49 GMT
- Title: A Requirements-Driven Platform for Validating Field Operations of Small
Uncrewed Aerial Vehicles
- Authors: Ankit Agrawal, Bohan Zhang, Yashaswini Shivalingaiah, Michael
Vierhauser, Jane Cleland-Huang
- Abstract summary: DroneReqValidator (DRV) allows sUAS developers to define the operating context, configure multi-sUAS mission requirements, specify safety properties, and deploy their own custom sUAS applications in a high-fidelity 3D environment.
The DRV Monitoring system collects runtime data from sUAS and the environment, analyzes compliance with safety properties, and captures violations.
- Score: 48.67061953896227
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Flight-time failures of small Uncrewed Aerial Systems (sUAS) can have a
severe impact on people or the environment. Therefore, sUAS applications must
be thoroughly evaluated and tested to ensure their adherence to specified
requirements, and safe behavior under real-world conditions, such as poor
weather, wireless interference, and satellite failure. However, current
simulation environments for autonomous vehicles, including sUAS, provide
limited support for validating their behavior in diverse environmental contexts
and moreover, lack a test harness to facilitate structured testing based on
system-level requirements. We address these shortcomings by eliciting and
specifying requirements for an sUAS testing and simulation platform, and
developing and deploying it. The constructed platform, DroneReqValidator (DRV),
allows sUAS developers to define the operating context, configure multi-sUAS
mission requirements, specify safety properties, and deploy their own custom
sUAS applications in a high-fidelity 3D environment. The DRV Monitoring system
collects runtime data from sUAS and the environment, analyzes compliance with
safety properties, and captures violations. We report on two case studies in
which we used our platform prior to real-world sUAS deployments, in order to
evaluate sUAS mission behavior in various environmental contexts. Furthermore,
we conducted a study with developers and found that DRV simplifies the process
of specifying requirements-driven test scenarios and analyzing acceptance test
results
Related papers
- Scenario-Based Field Testing of Drone Missions [6.219782508946943]
This paper identifies requirements for field testing of drone missions.
It introduces the Field Testing Scenario Management (FiTS) approach for adaptive field testing guidance.
FiTS shall leverage concepts from scenario-based requirements engineering and Behavior-Driven Development to define structured and reusable test scenarios.
arXiv Detail & Related papers (2024-07-11T10:12:13Z) - Coupled Requirements-driven Testing of CPS: From Simulation To Reality [5.7736484832934325]
Failures in safety-critical Cyber-Physical Systems (CPS) can lead to severe incidents impacting physical infrastructure or even harming humans.
Current simulation and field testing practices, particularly in the domain of small Unmanned Aerial Systems (sUAS), are ad-hoc and lack a thorough, structured testing process.
We have developed an initial framework for validating CPS, specifically focusing on sUAS and robotic applications.
arXiv Detail & Related papers (2024-03-24T20:32:12Z) - HAZARD Challenge: Embodied Decision Making in Dynamically Changing
Environments [93.94020724735199]
HAZARD consists of three unexpected disaster scenarios, including fire, flood, and wind.
This benchmark enables us to evaluate autonomous agents' decision-making capabilities across various pipelines.
arXiv Detail & Related papers (2024-01-23T18:59:43Z) - EnvGuard: Guaranteeing Environment-Centric Safety and Security
Properties in Web of Things [5.523305571662793]
Web of Things (WoT) technology promotes diverse WoT applications to automatically sense and regulate the environment.
Existing work on violation identification primarily focuses on the analysis of automated applications.
We introduce EnvGuard, an environment-centric approach for property customizing, violation identification and resolution execution in WoT environment.
arXiv Detail & Related papers (2023-12-06T09:15:52Z) - DARTH: Holistic Test-time Adaptation for Multiple Object Tracking [87.72019733473562]
Multiple object tracking (MOT) is a fundamental component of perception systems for autonomous driving.
Despite the urge of safety in driving systems, no solution to the MOT adaptation problem to domain shift in test-time conditions has ever been proposed.
We introduce DARTH, a holistic test-time adaptation framework for MOT.
arXiv Detail & Related papers (2023-10-03T10:10:42Z) - DroneReqValidator: Facilitating High Fidelity Simulation Testing for
Uncrewed Aerial Systems Developers [8.290044674335473]
sUAS developers aim to validate the reliability and safety of their applications through simulation testing.
The dynamic nature of the real-world environment causes unique software faults that may only be revealed through field testing.
DroneReqValidator (DRV) offers a comprehensive small Unmanned Aerial Vehicle (sUAV) simulation ecosystem.
arXiv Detail & Related papers (2023-07-31T22:13:57Z) - Cycle and Semantic Consistent Adversarial Domain Adaptation for Reducing
Simulation-to-Real Domain Shift in LiDAR Bird's Eye View [110.83289076967895]
We present a BEV domain adaptation method based on CycleGAN that uses prior semantic classification in order to preserve the information of small objects of interest during the domain adaptation process.
The quality of the generated BEVs has been evaluated using a state-of-the-art 3D object detection framework at KITTI 3D Object Detection Benchmark.
arXiv Detail & Related papers (2021-04-22T12:47:37Z) - Data Driven Testing of Cyber Physical Systems [12.93632948681342]
We propose an approach to automatically generate fault-revealing test cases for CPS.
Data collected from an application managing a smart building have been used to learn models of the environment.
arXiv Detail & Related papers (2021-02-23T04:55:10Z) - Emergent Complexity and Zero-shot Transfer via Unsupervised Environment
Design [121.73425076217471]
We propose Unsupervised Environment Design (UED), where developers provide environments with unknown parameters, and these parameters are used to automatically produce a distribution over valid, solvable environments.
We call our technique Protagonist Antagonist Induced Regret Environment Design (PAIRED)
Our experiments demonstrate that PAIRED produces a natural curriculum of increasingly complex environments, and PAIRED agents achieve higher zero-shot transfer performance when tested in highly novel environments.
arXiv Detail & Related papers (2020-12-03T17:37:01Z) - Rearrangement: A Challenge for Embodied AI [229.8891614821016]
We describe a framework for research and evaluation in Embodied AI.
Our proposal is based on a canonical task: Rearrangement.
We present experimental testbeds of rearrangement scenarios in four different simulation environments.
arXiv Detail & Related papers (2020-11-03T19:42:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.