Exogenous Data in Forecasting: FARM -- A New Measure for Relevance
Evaluation
- URL: http://arxiv.org/abs/2304.11028v2
- Date: Mon, 24 Apr 2023 05:19:36 GMT
- Title: Exogenous Data in Forecasting: FARM -- A New Measure for Relevance
Evaluation
- Authors: Ram\'on Christen and Luca Mazzola and Alexander Denzler and Edy
Portmann
- Abstract summary: We introduce a new approach named FARM - Forward Relevance Aligned Metric.
Our forward method relies on an angular measure that compares changes in subsequent data points to align time-warped series.
As a first validation step, we present the application of our FARM approach to synthetic but representative signals.
- Score: 62.997667081978825
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Evaluating the relevance of an exogenous data series is the first step in
improving the prediction capabilities of a forecast algorithm. Inspired by
existing metrics for time series similarity, we introduce a new approach named
FARM - Forward Aligned Relevance Metric. Our forward method relies on an
angular measure that compares changes in subsequent data points to align
time-warped series in an efficient way. The proposed algorithm combines local
and global measures to provide a balanced relevance metric. This results in
considering also partial, intermediate matches as relevant indicators for
exogenous data series significance. As a first validation step, we present the
application of our FARM approach to synthetic but representative signals. While
demonstrating the improved capabilities with respect to existing approaches, we
also discuss existing constraints and limitations of our idea.
Related papers
- Efficient Learning of POMDPs with Known Observation Model in Average-Reward Setting [56.92178753201331]
We propose the Observation-Aware Spectral (OAS) estimation technique, which enables the POMDP parameters to be learned from samples collected using a belief-based policy.
We show the consistency of the OAS procedure, and we prove a regret guarantee of order $mathcalO(sqrtT log(T)$ for the proposed OAS-UCRL algorithm.
arXiv Detail & Related papers (2024-10-02T08:46:34Z) - Consensus-Adaptive RANSAC [104.87576373187426]
We propose a new RANSAC framework that learns to explore the parameter space by considering the residuals seen so far via a novel attention layer.
The attention mechanism operates on a batch of point-to-model residuals, and updates a per-point estimation state to take into account the consensus found through a lightweight one-step transformer.
arXiv Detail & Related papers (2023-07-26T08:25:46Z) - Predictive change point detection for heterogeneous data [1.1720726814454114]
"Predict and Compare" is a change point detection framework assisted by a predictive machine learning model.
It outperforms online CPD routines in terms of false positive rate and out-of-control average run length.
The power of the method is demonstrated in a tribological case study.
arXiv Detail & Related papers (2023-05-11T07:59:18Z) - Joint Metrics Matter: A Better Standard for Trajectory Forecasting [67.1375677218281]
Multi-modal trajectory forecasting methods evaluate using single-agent metrics (marginal metrics)
Only focusing on marginal metrics can lead to unnatural predictions, such as colliding trajectories or diverging trajectories for people who are clearly walking together as a group.
We present the first comprehensive evaluation of state-of-the-art trajectory forecasting methods with respect to multi-agent metrics (joint metrics): JADE, JFDE, and collision rate.
arXiv Detail & Related papers (2023-05-10T16:27:55Z) - Conceptually Diverse Base Model Selection for Meta-Learners in Concept
Drifting Data Streams [3.0938904602244355]
We present a novel approach for estimating the conceptual similarity of base models, which is calculated using the Principal Angles (PAs) between their underlying subspaces.
We evaluate these methods against thresholding using common ensemble pruning metrics, namely predictive performance and Mutual Information (MI) in the context of online Transfer Learning (TL)
Our results show that conceptual similarity thresholding has a reduced computational overhead, and yet yields comparable predictive performance to thresholding using predictive performance and MI.
arXiv Detail & Related papers (2021-11-29T13:18:53Z) - Applying Regression Conformal Prediction with Nearest Neighbors to time
series data [0.0]
This paper presents a way of constructingreliable prediction intervals by using conformal predictors in the context of time series data.
We use the nearest neighbors method based on the fast parameters tuning technique in the nearest neighbors (FPTO-WNN) approach as the underlying algorithm.
arXiv Detail & Related papers (2021-10-25T15:11:32Z) - Riemannian classification of EEG signals with missing values [67.90148548467762]
This paper proposes two strategies to handle missing data for the classification of electroencephalograms.
The first approach estimates the covariance from imputed data with the $k$-nearest neighbors algorithm; the second relies on the observed data by leveraging the observed-data likelihood within an expectation-maximization algorithm.
As results show, the proposed strategies perform better than the classification based on observed data and allow to keep a high accuracy even when the missing data ratio increases.
arXiv Detail & Related papers (2021-10-19T14:24:50Z) - MINIMALIST: Mutual INformatIon Maximization for Amortized Likelihood
Inference from Sampled Trajectories [61.3299263929289]
Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice.
One class of methods uses data simulated with different parameters to infer an amortized estimator for the likelihood-to-evidence ratio.
We show that this approach can be formulated in terms of mutual information between model parameters and simulated data.
arXiv Detail & Related papers (2021-06-03T12:59:16Z) - Sequential Estimation of Nonparametric Correlation using Hermite Series
Estimators [0.0]
We describe a new Hermite series based sequential estimator for the Spearman's rank correlation coefficient.
To treat the non-stationary setting, we introduce a novel, exponentially weighted estimator for the Spearman's rank correlation.
arXiv Detail & Related papers (2020-12-11T12:43:19Z) - Methods of ranking for aggregated fuzzy numbers from interval-valued
data [0.0]
This paper primarily presents two methods of ranking aggregated fuzzy numbers from intervals using the Interval Agreement Approach (IAA)
The shortcomings of previous measures, along with the improvements of the proposed methods, are illustrated using both a synthetic and real-world application.
arXiv Detail & Related papers (2020-12-03T02:56:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.