AWT -- Clustering Meteorological Time Series Using an Aggregated Wavelet
Tree
- URL: http://arxiv.org/abs/2212.06642v1
- Date: Tue, 13 Dec 2022 15:25:29 GMT
- Title: AWT -- Clustering Meteorological Time Series Using an Aggregated Wavelet
Tree
- Authors: Christina Pacher, Irene Schicker, Rosmarie deWit, Katerina
Hlavackova-Schindler, Claudia Plant
- Abstract summary: AWT is a clustering algorithm for time series data that also performs implicit outlier detection during the clustering.
We apply AWT to crowd sourced 2-m temperature data with an hourly resolution from the city of Vienna to detect outliers.
It is shown that both the outlier detection and the implicit mapping to land-use characteristic is possible with AWT.
- Score: 9.470649284657483
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Both clustering and outlier detection play an important role for
meteorological measurements. We present the AWT algorithm, a clustering
algorithm for time series data that also performs implicit outlier detection
during the clustering. AWT integrates ideas of several well-known K-Means
clustering algorithms. It chooses the number of clusters automatically based on
a user-defined threshold parameter, and it can be used for heterogeneous
meteorological input data as well as for data sets that exceed the available
memory size. We apply AWT to crowd sourced 2-m temperature data with an hourly
resolution from the city of Vienna to detect outliers and to investigate if the
final clusters show general similarities and similarities with urban land-use
characteristics. It is shown that both the outlier detection and the implicit
mapping to land-use characteristic is possible with AWT which opens new
possible fields of application, specifically in the rapidly evolving field of
urban climate and urban weather.
Related papers
- Generating Fine-Grained Causality in Climate Time Series Data for Forecasting and Anomaly Detection [67.40407388422514]
We design a conceptual fine-grained causal model named TBN Granger Causality.
Second, we propose an end-to-end deep generative model called TacSas, which discovers TBN Granger Causality in a generative manner.
We test TacSas on climate benchmark ERA5 for climate forecasting and the extreme weather benchmark of NOAA for extreme weather alerts.
arXiv Detail & Related papers (2024-08-08T06:47:21Z) - PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection [51.20479454379662]
We propose a.
Federated Anomaly Detection framework named PeFAD with the increasing privacy concerns.
We conduct extensive evaluations on four real datasets, where PeFAD outperforms existing state-of-the-art baselines by up to 28.74%.
arXiv Detail & Related papers (2024-06-04T13:51:08Z) - Observation-Guided Meteorological Field Downscaling at Station Scale: A
Benchmark and a New Method [66.80344502790231]
We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset.
Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors.
Our proposed method outperforms other specially designed baseline models on multiple surface variables.
arXiv Detail & Related papers (2024-01-22T14:02:56Z) - Anomaly Clustering: Grouping Images into Coherent Clusters of Anomaly
Types [60.45942774425782]
We introduce anomaly clustering, whose goal is to group data into coherent clusters of anomaly types.
This is different from anomaly detection, whose goal is to divide anomalies from normal data.
We present a simple yet effective clustering framework using a patch-based pretrained deep embeddings and off-the-shelf clustering methods.
arXiv Detail & Related papers (2021-12-21T23:11:33Z) - Cluster-and-Conquer: A Framework For Time-Series Forecasting [94.63501563413725]
We propose a three-stage framework for forecasting high-dimensional time-series data.
Our framework is highly general, allowing for any time-series forecasting and clustering method to be used in each step.
When instantiated with simple linear autoregressive models, we are able to achieve state-of-the-art results on several benchmark datasets.
arXiv Detail & Related papers (2021-10-26T20:41:19Z) - SOMTimeS: Self Organizing Maps for Time Series Clustering and its
Application to Serious Illness Conversations [3.2689702143620147]
We present a new DTW-based clustering method called SOMTimeS (a Self-Organizing Map for TIME Series)
It scales better and runs faster than other DTW-based clustering algorithms, and has similar performance accuracy.
We applied SOMtimeS to natural language conversation data collected as part of a large healthcare cohort study.
arXiv Detail & Related papers (2021-08-26T00:18:25Z) - Clustering acoustic emission data streams with sequentially appearing
clusters using mixture models [6.166295570030645]
We develop a new clustering method to handle the specificities of unlabeled acoustic emission (AE) data.
The method, called GMMSEQ, is experimentally validated to characterize the loosening phenomenon in bolted structure under vibrations.
In view of developing an open acoustic emission initiative, the datasets and the codes are made available to reproduce the research of this paper.
arXiv Detail & Related papers (2021-08-25T13:01:06Z) - Clustering of Time Series Data with Prior Geographical Information [0.26651200086513094]
We propose a spatial-temporal clustering model, where time series data based on spatial and temporal contexts.
The proposed model Spatial-DEC (S-DEC) use prior geographical information in building latent feature representations.
The results show that the proposed Spatial-DEC can find more desired-temporal clusters.
arXiv Detail & Related papers (2021-07-03T00:19:17Z) - (k, l)-Medians Clustering of Trajectories Using Continuous Dynamic Time
Warping [57.316437798033974]
In this work we consider the problem of center-based clustering of trajectories.
We propose the usage of a continuous version of DTW as distance measure, which we call continuous dynamic time warping (CDTW)
We show a practical way to compute a center from a set of trajectories and subsequently iteratively improve it.
arXiv Detail & Related papers (2020-12-01T13:17:27Z) - Autoencoder-based time series clustering with energy applications [0.0]
Time series clustering is a challenging task due to the specific nature of the data.
In this paper we investigate the combination of a convolutional autoencoder and a k-medoids algorithm to perfom time series clustering.
arXiv Detail & Related papers (2020-02-10T10:04:29Z) - Coarse-Grain Cluster Analysis of Tensors with Application to Climate
Biome Identification [0.27998963147546146]
We use the discrete wavelet transform to analyze the effects of coarse-graining on clustering tensor data.
We are particularly interested in understanding how scale effects clustering of the Earth's climate system.
arXiv Detail & Related papers (2020-01-22T00:28:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.