Iterative Encoding-Decoding VAEs Anomaly Detection in NOAA's DART Time Series: A Machine Learning Approach for Enhancing Data Integrity for NASA's GRACE-FO Verification and Validation

• URL: http://arxiv.org/abs/2412.16375v1
• Date: Fri, 20 Dec 2024 22:19:11 GMT
• Title: Iterative Encoding-Decoding VAEs Anomaly Detection in NOAA's DART Time Series: A Machine Learning Approach for Enhancing Data Integrity for NASA's GRACE-FO Verification and Validation
• Authors: Kevin Lee,
• Abstract summary: This paper introduces an Iterative ational-Decoding Variencoders (Iterative ational-Decoding VAEs) model to improve the quality of DART time series. Iterative ational-Decoding VAEs progressively remove anomalies while preserving the data's latent structure. This data processing method tsunami detection underpins future climate modeling with improved interpretability and reliability.
• Score: 3.4265828682659705
• License:
• Abstract: NOAA's Deep-ocean Assessment and Reporting of Tsunamis (DART) data are critical for NASA-JPL's tsunami detection, real-time operations, and oceanographic research. However, these time-series data often contain spikes, steps, and drifts that degrade data quality and obscure essential oceanographic features. To address these anomalies, the work introduces an Iterative Encoding-Decoding Variational Autoencoders (Iterative Encoding-Decoding VAEs) model to improve the quality of DART time series. Unlike traditional filtering and thresholding methods that risk distorting inherent signal characteristics, Iterative Encoding-Decoding VAEs progressively remove anomalies while preserving the data's latent structure. A hybrid thresholding approach further retains genuine oceanographic features near boundaries. Applied to complex DART datasets, this approach yields reconstructions that better maintain key oceanic properties compared to classical statistical techniques, offering improved robustness against spike removal and subtle step changes. The resulting high-quality data supports critical verification and validation efforts for the GRACE-FO mission at NASA-JPL, where accurate surface measurements are essential to modeling Earth's gravitational field and global water dynamics. Ultimately, this data processing method enhances tsunami detection and underpins future climate modeling with improved interpretability and reliability.

Related papers

• Deep Learning for Sea Surface Temperature Reconstruction under Cloud Occlusion [33.025831091005784]
  Large-scale Sea Surface Temperature (SST) monitoring relies on satellite infrared radiation detection. Cloud cover presents a major challenge, creating extensive observational gaps. We employ deep neural networks to reconstruct cloud-covered portions of satellite imagery.
  arXiv  Detail & Related papers  (2024-12-04T15:49:49Z)
• AeroGen: Enhancing Remote Sensing Object Detection with Diffusion-Driven Data Generation [38.89367726721828]
  Remote sensing image object detection (RSIOD) aims to identify and locate specific objects within satellite or aerial imagery. There is a scarcity of labeled data in current RSIOD datasets, which significantly limits the performance of current detection algorithms. This paper proposes a layout-controllable diffusion generative model (i.e. AeroGen) tailored for RSIOD.
  arXiv  Detail & Related papers  (2024-11-23T09:04:33Z)
• Underwater Object Detection in the Era of Artificial Intelligence: Current, Challenge, and Future [119.88454942558485]
  Underwater object detection (UOD) aims to identify and localise objects in underwater images or videos. In recent years, artificial intelligence (AI) based methods, especially deep learning methods, have shown promising performance in UOD.
  arXiv  Detail & Related papers  (2024-10-08T00:25:33Z)
• An Attention-Based Algorithm for Gravity Adaptation Zone Calibration [2.919933798918053]
  This paper proposes an attention-enhanced algorithm for gravity adaptation zone calibration. It addresses the problems of multicollinearity and redundancy inherent in traditional feature selection methods. It significantly improves calibration accuracy and robustness.
  arXiv  Detail & Related papers  (2024-10-06T12:03:13Z)
• Flood Data Analysis on SpaceNet 8 Using Apache Sedona [4.802565443109335]
  SpaceNet8 offers a unique opportunity to leverage cutting-edge artificial intelligence technologies to assess flood hazards. We introduce a novel approach that addresses the challenges associated with inaccuracies in flood damage detection. After these enhancements, our indicators show a notable improvement, with precision up by 5%, F1 score by 2.6%, and IoU by 4.5%.
  arXiv  Detail & Related papers  (2024-04-28T16:29:22Z)
• Innovative Horizons in Aerial Imagery: LSKNet Meets DiffusionDet for Advanced Object Detection [55.2480439325792]
  We present an in-depth evaluation of an object detection model that integrates the LSKNet backbone with the DiffusionDet head. The proposed model achieves a mean average precision (MAP) of approximately 45.7%, which is a significant improvement. This advancement underscores the effectiveness of the proposed modifications and sets a new benchmark in aerial image analysis.
  arXiv  Detail & Related papers  (2023-11-21T19:49:13Z)
• Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
  This paper seeks transferable prior knowledge from detector-friendly images. It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps. Our method with higher speeds and less parameters still performs better than transformer-based detectors.
  arXiv  Detail & Related papers  (2023-08-24T12:32:46Z)
• GAMMA: Generative Augmentation for Attentive Marine Debris Detection [0.0]
  We propose an efficient and generative augmentation approach to solve the inadequacy concern of underwater debris data for visual detection. We use cycleGAN as a data augmentation technique to convert openly available, abundant data of terrestrial plastic to underwater-style images. We also propose a novel architecture for underwater debris detection using an attention mechanism.
  arXiv  Detail & Related papers  (2022-12-07T16:30:51Z)
• DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly detection in air transportation [68.8204255655161]
  We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE) It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase. Results show that the DAE achieves better results in both accuracy and speed of detection.
  arXiv  Detail & Related papers  (2021-09-08T14:07:55Z)
• Semantic Perturbations with Normalizing Flows for Improved Generalization [62.998818375912506]
  We show that perturbations in the latent space can be used to define fully unsupervised data augmentations. We find that our latent adversarial perturbations adaptive to the classifier throughout its training are most effective.
  arXiv  Detail & Related papers  (2021-08-18T03:20:00Z)
• Anomaly Detection Based on Selection and Weighting in Latent Space [73.01328671569759]
  We propose a novel selection-and-weighting-based anomaly detection framework called SWAD. Experiments on both benchmark and real-world datasets have shown the effectiveness and superiority of SWAD.
  arXiv  Detail & Related papers  (2021-03-08T10:56:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.