Toward Certification of Machine-Learning Systems for Low Criticality
Airborne Applications
- URL: http://arxiv.org/abs/2209.13975v1
- Date: Wed, 28 Sep 2022 10:13:28 GMT
- Title: Toward Certification of Machine-Learning Systems for Low Criticality
Airborne Applications
- Authors: K. Dmitriev, J. Schumann and F. Holzapfel
- Abstract summary: Possible airborne applications of machine learning (ML) include safety-critical functions.
Current certification standards for the aviation industry were developed prior to the ML renaissance.
There are some fundamental incompatibilities between traditional design assurance approaches and certain aspects of ML-based systems.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The exceptional progress in the field of machine learning (ML) in recent
years has attracted a lot of interest in using this technology in aviation.
Possible airborne applications of ML include safety-critical functions, which
must be developed in compliance with rigorous certification standards of the
aviation industry. Current certification standards for the aviation industry
were developed prior to the ML renaissance without taking specifics of ML
technology into account. There are some fundamental incompatibilities between
traditional design assurance approaches and certain aspects of ML-based
systems. In this paper, we analyze the current airborne certification standards
and show that all objectives of the standards can be achieved for a
low-criticality ML-based system if certain assumptions about ML development
workflow are applied.
Related papers
- Runway Sign Classifier: A DAL C Certifiable Machine Learning System [4.012351415340318]
We present a case study of an airborne system utilizing a Deep Neural Network (DNN) for airport sign detection and classification.
To achieve DAL C, we employ an established architectural mitigation technique involving two redundant and dissimilar DNNs.
This work is intended to illustrate how the certification challenges of ML-based systems can be addressed for medium criticality airborne applications.
arXiv Detail & Related papers (2023-10-10T10:26:30Z) - Vulnerability of Machine Learning Approaches Applied in IoT-based Smart Grid: A Review [51.31851488650698]
Machine learning (ML) sees an increasing prevalence of being used in the internet-of-things (IoT)-based smart grid.
adversarial distortion injected into the power signal will greatly affect the system's normal control and operation.
It is imperative to conduct vulnerability assessment for MLsgAPPs applied in the context of safety-critical power systems.
arXiv Detail & Related papers (2023-08-30T03:29:26Z) - Rethinking Certification for Trustworthy Machine Learning-Based
Applications [3.886429361348165]
Machine Learning (ML) is increasingly used to implement advanced applications with non-deterministic behavior.
Existing certification schemes are not immediately applicable to non-deterministic applications built on ML models.
This article analyzes the challenges and deficiencies of current certification schemes, discusses open research issues, and proposes a first certification scheme for ML-based applications.
arXiv Detail & Related papers (2023-05-26T11:06:28Z) - Benchmarking Automated Machine Learning Methods for Price Forecasting
Applications [58.720142291102135]
We show the possibility of substituting manually created ML pipelines with automated machine learning (AutoML) solutions.
Based on the CRISP-DM process, we split the manual ML pipeline into a machine learning and non-machine learning part.
We show in a case study for the industrial use case of price forecasting, that domain knowledge combined with AutoML can weaken the dependence on ML experts.
arXiv Detail & Related papers (2023-04-28T10:27:38Z) - Improving aircraft performance using machine learning: a review [57.82442188072833]
This review covers the new developments in machine learning (ML) that are impacting the multi-disciplinary area of aerospace engineering.
We review the state of the art, gathering the advantages and challenges of ML methods across different aerospace disciplines.
arXiv Detail & Related papers (2022-10-20T07:16:53Z) - How to Certify Machine Learning Based Safety-critical Systems? A
Systematic Literature Review [7.704424642395104]
This paper aims to elucidate challenges related to the certification of ML-based safety-critical systems.
In total, we identified 229 papers covering topics considered to be the main pillars of ML certification.
arXiv Detail & Related papers (2021-07-26T09:03:22Z) - Certification of embedded systems based on Machine Learning: A survey [0.0]
Advances in machine learning (ML) open the way to innovating functions in the avionic domain.
Current certification standards and practices do not support this new development paradigm.
This article provides an overview of the main challenges raised by the use ML in the demonstration of compliance with regulation requirements.
arXiv Detail & Related papers (2021-06-14T08:12:05Z) - White Paper Machine Learning in Certified Systems [70.24215483154184]
DEEL Project set-up the ML Certification 3 Workgroup (WG) set-up by the Institut de Recherche Technologique Saint Exup'ery de Toulouse (IRT)
arXiv Detail & Related papers (2021-03-18T21:14:30Z) - Technology Readiness Levels for Machine Learning Systems [107.56979560568232]
Development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end.
We have developed a proven systems engineering approach for machine learning development and deployment.
Our "Machine Learning Technology Readiness Levels" framework defines a principled process to ensure robust, reliable, and responsible systems.
arXiv Detail & Related papers (2021-01-11T15:54:48Z) - Towards a Robust and Trustworthy Machine Learning System Development [0.09236074230806578]
We present our recent survey on the state-of-the-art ML trustworthiness and technologies from a security engineering perspective.
We then push our studies forward above and beyond a survey by describing a metamodel we created that represents the body of knowledge in a standard and visualized way for ML practitioners.
We propose future research directions motivated by our findings to advance the development of robust and trustworthy ML systems.
arXiv Detail & Related papers (2021-01-08T14:43:58Z) - Technology Readiness Levels for AI & ML [79.22051549519989]
Development of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end.
Engineering systems follow well-defined processes and testing standards to streamline development for high-quality, reliable results.
We propose a proven systems engineering approach for machine learning development and deployment.
arXiv Detail & Related papers (2020-06-21T17:14:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.