Runway Sign Classifier: A DAL C Certifiable Machine Learning System
- URL: http://arxiv.org/abs/2310.06506v1
- Date: Tue, 10 Oct 2023 10:26:30 GMT
- Title: Runway Sign Classifier: A DAL C Certifiable Machine Learning System
- Authors: Konstantin Dmitriev, Johann Schumann, Islam Bostanov, Mostafa
Abdelhamid and Florian Holzapfel
- Abstract summary: We present a case study of an airborne system utilizing a Deep Neural Network (DNN) for airport sign detection and classification.
To achieve DAL C, we employ an established architectural mitigation technique involving two redundant and dissimilar DNNs.
This work is intended to illustrate how the certification challenges of ML-based systems can be addressed for medium criticality airborne applications.
- Score: 4.012351415340318
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In recent years, the remarkable progress of Machine Learning (ML)
technologies within the domain of Artificial Intelligence (AI) systems has
presented unprecedented opportunities for the aviation industry, paving the way
for further advancements in automation, including the potential for single
pilot or fully autonomous operation of large commercial airplanes. However, ML
technology faces major incompatibilities with existing airborne certification
standards, such as ML model traceability and explainability issues or the
inadequacy of traditional coverage metrics. Certification of ML-based airborne
systems using current standards is problematic due to these challenges. This
paper presents a case study of an airborne system utilizing a Deep Neural
Network (DNN) for airport sign detection and classification. Building upon our
previous work, which demonstrates compliance with Design Assurance Level (DAL)
D, we upgrade the system to meet the more stringent requirements of Design
Assurance Level C. To achieve DAL C, we employ an established architectural
mitigation technique involving two redundant and dissimilar Deep Neural
Networks. The application of novel ML-specific data management techniques
further enhances this approach. This work is intended to illustrate how the
certification challenges of ML-based systems can be addressed for medium
criticality airborne applications.
Related papers
- A Machine Learning-Driven Wireless System for Structural Health Monitoring [0.0]
The paper presents a wireless system integrated with a machine learning (ML) model for structural health monitoring (SHM) of carbon fiber reinforced polymer (CFRP) structures.
The system collects data via carbon nanotube (CNT) sensors embedded within CFRP coupons, wirelessly transmitting these data to a central server for processing.
A deep neural network (DNN) model predicts mechanical properties and can be extended to forecast structural failures, facilitating proactive maintenance and enhancing safety.
arXiv Detail & Related papers (2024-09-17T08:08:38Z) - Recent Advances on Machine Learning for Computational Fluid Dynamics: A Survey [51.87875066383221]
This paper introduces fundamental concepts, traditional methods, and benchmark datasets, then examine the various roles Machine Learning plays in improving CFD.
We highlight real-world applications of ML for CFD in critical scientific and engineering disciplines, including aerodynamics, combustion, atmosphere & ocean science, biology fluid, plasma, symbolic regression, and reduced order modeling.
We draw the conclusion that ML is poised to significantly transform CFD research by enhancing simulation accuracy, reducing computational time, and enabling more complex analyses of fluid dynamics.
arXiv Detail & Related papers (2024-08-22T07:33:11Z) - Benchmarking Automated Machine Learning Methods for Price Forecasting
Applications [58.720142291102135]
We show the possibility of substituting manually created ML pipelines with automated machine learning (AutoML) solutions.
Based on the CRISP-DM process, we split the manual ML pipeline into a machine learning and non-machine learning part.
We show in a case study for the industrial use case of price forecasting, that domain knowledge combined with AutoML can weaken the dependence on ML experts.
arXiv Detail & Related papers (2023-04-28T10:27:38Z) - Toward Certification of Machine-Learning Systems for Low Criticality
Airborne Applications [0.0]
Possible airborne applications of machine learning (ML) include safety-critical functions.
Current certification standards for the aviation industry were developed prior to the ML renaissance.
There are some fundamental incompatibilities between traditional design assurance approaches and certain aspects of ML-based systems.
arXiv Detail & Related papers (2022-09-28T10:13:28Z) - How to Certify Machine Learning Based Safety-critical Systems? A
Systematic Literature Review [7.704424642395104]
This paper aims to elucidate challenges related to the certification of ML-based safety-critical systems.
In total, we identified 229 papers covering topics considered to be the main pillars of ML certification.
arXiv Detail & Related papers (2021-07-26T09:03:22Z) - Certification of embedded systems based on Machine Learning: A survey [0.0]
Advances in machine learning (ML) open the way to innovating functions in the avionic domain.
Current certification standards and practices do not support this new development paradigm.
This article provides an overview of the main challenges raised by the use ML in the demonstration of compliance with regulation requirements.
arXiv Detail & Related papers (2021-06-14T08:12:05Z) - White Paper Machine Learning in Certified Systems [70.24215483154184]
DEEL Project set-up the ML Certification 3 Workgroup (WG) set-up by the Institut de Recherche Technologique Saint Exup'ery de Toulouse (IRT)
arXiv Detail & Related papers (2021-03-18T21:14:30Z) - Technology Readiness Levels for Machine Learning Systems [107.56979560568232]
Development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end.
We have developed a proven systems engineering approach for machine learning development and deployment.
Our "Machine Learning Technology Readiness Levels" framework defines a principled process to ensure robust, reliable, and responsible systems.
arXiv Detail & Related papers (2021-01-11T15:54:48Z) - Transfer Learning without Knowing: Reprogramming Black-box Machine
Learning Models with Scarce Data and Limited Resources [78.72922528736011]
We propose a novel approach, black-box adversarial reprogramming (BAR), that repurposes a well-trained black-box machine learning model.
Using zeroth order optimization and multi-label mapping techniques, BAR can reprogram a black-box ML model solely based on its input-output responses.
BAR outperforms state-of-the-art methods and yields comparable performance to the vanilla adversarial reprogramming method.
arXiv Detail & Related papers (2020-07-17T01:52:34Z) - Technology Readiness Levels for AI & ML [79.22051549519989]
Development of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end.
Engineering systems follow well-defined processes and testing standards to streamline development for high-quality, reliable results.
We propose a proven systems engineering approach for machine learning development and deployment.
arXiv Detail & Related papers (2020-06-21T17:14:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.