Autoencoding Features for Aviation Machine Learning Problems
- URL: http://arxiv.org/abs/2011.01464v2
- Date: Sat, 7 Nov 2020 17:15:17 GMT
- Title: Autoencoding Features for Aviation Machine Learning Problems
- Authors: Liya Wang, Panta Lucic, Keith Campbell, Craig Wanke
- Abstract summary: This research explored an unsupervised learning method, autoencoder, to extract effective features for aviation machine learning problems.
The research results show that the autoencoder can not only automatically extract effective features for the flight track data, but also efficiently deep clean data, thereby reducing the workload of data scientists.
The developed applications and techniques are shared with the whole aviation community to improve effectiveness of ongoing and future machine learning studies.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The current practice of manually processing features for high-dimensional and
heterogeneous aviation data is labor-intensive, does not scale well to new
problems, and is prone to information loss, affecting the effectiveness and
maintainability of machine learning (ML) procedures. This research explored an
unsupervised learning method, autoencoder, to extract effective features for
aviation machine learning problems. The study explored variants of autoencoders
with the aim of forcing the learned representations of the input to assume
useful properties. A flight track anomaly detection autoencoder was developed
to demonstrate the versatility of the technique. The research results show that
the autoencoder can not only automatically extract effective features for the
flight track data, but also efficiently deep clean data, thereby reducing the
workload of data scientists. Moreover, the research leveraged transfer learning
to efficiently train models for multiple airports. Transfer learning can reduce
model training times from days to hours, as well as improving model
performance. The developed applications and techniques are shared with the
whole aviation community to improve effectiveness of ongoing and future machine
learning studies.
Related papers
- Improving Radiography Machine Learning Workflows via Metadata Management for Training Data Selection [0.0]
In the physical sciences, there is an ever-increasing pool of metadata that is generated by the scientific research cycle.
Tracking this metadata can reduce redundant work, improve, and aid in the feature and training dataset engineering process.
We present a tool for machine learning metadata management in dynamic radiography.
arXiv Detail & Related papers (2024-08-22T18:01:21Z) - Demonstration-Guided Reinforcement Learning with Efficient Exploration
for Task Automation of Surgical Robot [54.80144694888735]
We introduce Demonstration-guided EXploration (DEX), an efficient reinforcement learning algorithm.
Our method estimates expert-like behaviors with higher values to facilitate productive interactions.
Experiments on $10$ surgical manipulation tasks from SurRoL, a comprehensive surgical simulation platform, demonstrate significant improvements.
arXiv Detail & Related papers (2023-02-20T05:38:54Z) - Automatic Data Augmentation via Invariance-Constrained Learning [94.27081585149836]
Underlying data structures are often exploited to improve the solution of learning tasks.
Data augmentation induces these symmetries during training by applying multiple transformations to the input data.
This work tackles these issues by automatically adapting the data augmentation while solving the learning task.
arXiv Detail & Related papers (2022-09-29T18:11:01Z) - Advancing Reacting Flow Simulations with Data-Driven Models [50.9598607067535]
Key to effective use of machine learning tools in multi-physics problems is to couple them to physical and computer models.
The present chapter reviews some of the open opportunities for the application of data-driven reduced-order modeling of combustion systems.
arXiv Detail & Related papers (2022-09-05T16:48:34Z) - Anomaly Detection for Unmanned Aerial Vehicle Sensor Data Using a
Stacked Recurrent Autoencoder Method with Dynamic Thresholding [0.3441021278275805]
This paper proposes a system incorporating a Long Short-Term Memory (LSTM) Deep Learning Autoencoder based method with a novel dynamic thresholding algorithm and weighted loss function for anomaly detection of a UAV dataset.
The dynamic thresholding and weighted loss functions showed promising improvements to the standard static thresholding method, both in accuracy-related performance metrics and in speed of true fault detection.
arXiv Detail & Related papers (2022-03-09T14:16:14Z) - Efficient Robotic Manipulation Through Offline-to-Online Reinforcement
Learning and Goal-Aware State Information [5.604859261995801]
We propose a unified offline-to-online RL framework that resolves the transition performance drop issue.
We introduce goal-aware state information to the RL agent, which can greatly reduce task complexity and accelerate policy learning.
Our framework achieves great training efficiency and performance compared with the state-of-the-art methods in multiple robotic manipulation tasks.
arXiv Detail & Related papers (2021-10-21T05:34:25Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - Automated Machine Learning Techniques for Data Streams [91.3755431537592]
This paper surveys the state-of-the-art open-source AutoML tools, applies them to data collected from streams, and measures how their performance changes over time.
The results show that off-the-shelf AutoML tools can provide satisfactory results but in the presence of concept drift, detection or adaptation techniques have to be applied to maintain the predictive accuracy over time.
arXiv Detail & Related papers (2021-06-14T11:42:46Z) - Transfer Learning without Knowing: Reprogramming Black-box Machine
Learning Models with Scarce Data and Limited Resources [78.72922528736011]
We propose a novel approach, black-box adversarial reprogramming (BAR), that repurposes a well-trained black-box machine learning model.
Using zeroth order optimization and multi-label mapping techniques, BAR can reprogram a black-box ML model solely based on its input-output responses.
BAR outperforms state-of-the-art methods and yields comparable performance to the vanilla adversarial reprogramming method.
arXiv Detail & Related papers (2020-07-17T01:52:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.