When is Early Classification of Time Series Meaningful?
- URL: http://arxiv.org/abs/2102.11487v1
- Date: Tue, 23 Feb 2021 04:42:05 GMT
- Title: When is Early Classification of Time Series Meaningful?
- Authors: Renjie Wu, Audrey Der, Eamonn J. Keogh
- Abstract summary: We ask if we can classify a time series subsequence with sufficient accuracy and confidence after seeing only some prefix of a target pattern.
The idea is that the earlier classification would allow us to take immediate action, in a domain in which some practical interventions are possible.
In spite of the fact that there are dozens of papers on early classification of time series, it is not clear that any of them could ever work in a real-world setting.
- Score: 11.234740889286215
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Since its introduction two decades ago, there has been increasing interest in
the problem of early classification of time series. This problem generalizes
classic time series classification to ask if we can classify a time series
subsequence with sufficient accuracy and confidence after seeing only some
prefix of a target pattern. The idea is that the earlier classification would
allow us to take immediate action, in a domain in which some practical
interventions are possible. For example, that intervention might be sounding an
alarm or applying the brakes in an automobile. In this work, we make a
surprising claim. In spite of the fact that there are dozens of papers on early
classification of time series, it is not clear that any of them could ever work
in a real-world setting. The problem is not with the algorithms per se but with
the vague and underspecified problem description. Essentially all algorithms
make implicit and unwarranted assumptions about the problem that will ensure
that they will be plagued by false positives and false negatives even if their
results suggested that they could obtain near-perfect results. We will explain
our findings with novel insights and experiments and offer recommendations to
the community.
Related papers
- Regularization-Based Methods for Ordinal Quantification [49.606912965922504]
We study the ordinal case, i.e., the case in which a total order is defined on the set of n>2 classes.
We propose a novel class of regularized OQ algorithms, which outperforms existing algorithms in our experiments.
arXiv Detail & Related papers (2023-10-13T16:04:06Z) - CARLA: Self-supervised Contrastive Representation Learning for Time Series Anomaly Detection [53.83593870825628]
One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios.
Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an unsupervised manner.
We introduce a novel end-to-end self-supervised ContrAstive Representation Learning approach for time series anomaly detection.
arXiv Detail & Related papers (2023-08-18T04:45:56Z) - Early Classifying Multimodal Sequences [86.80932013694684]
Trading wait time for decision certainty leads to early classification problems.
We show our new method yields experimental AUC advantages of up to 8.7%.
arXiv Detail & Related papers (2023-05-02T01:57:34Z) - A Policy for Early Sequence Classification [86.80932013694684]
We introduce a novel method to classify a sequence as soon as possible without waiting for the last element.
Our method achieves an average AUC increase of 11.8% over multiple experiments.
arXiv Detail & Related papers (2023-04-07T03:38:54Z) - Stop&Hop: Early Classification of Irregular Time Series [16.84487620364245]
We study early classification of irregular time series, a new setting for early classifiers that opens doors to more real-world problems.
Our solution, Stop&Hop, uses a continuous-time recurrent network to model ongoing irregular time series in real time.
We demonstrate that Stop&Hop consistently makes earlier and more-accurate predictions than state-of-the-art alternatives adapted to this new problem.
arXiv Detail & Related papers (2022-08-21T03:41:19Z) - Incentivizing Combinatorial Bandit Exploration [87.08827496301839]
Consider a bandit algorithm that recommends actions to self-interested users in a recommendation system.
Users are free to choose other actions and need to be incentivized to follow the algorithm's recommendations.
While the users prefer to exploit, the algorithm can incentivize them to explore by leveraging the information collected from the previous users.
arXiv Detail & Related papers (2022-06-01T13:46:25Z) - ECOTS: Early Classification in Open Time Series [0.0]
We show how to adapt any technique for learning to the Early Classification in Open Time Series (ECOTS)
We illustrate our methodology by transforming two state-of-the-art algorithms for the ECOTS scenario and report numerical experiments on a real dataset for predictive maintenance.
arXiv Detail & Related papers (2022-04-01T12:34:26Z) - Early Classification of Time Series is Meaningful [0.028675177318965035]
We answer in detail the main issues and misunderstandings raised by the authors of the preprint.
We propose directions to further expand the fields of application of early classification of time series.
arXiv Detail & Related papers (2021-04-27T15:16:21Z) - Instance-based Counterfactual Explanations for Time Series
Classification [11.215352918313577]
We advance a novel model-agnostic, case-based technique that generates counterfactual explanations for time series classifiers.
We show that Native Guide generates plausible, proximal, sparse and diverse explanations that are better than those produced by key benchmark counterfactual methods.
arXiv Detail & Related papers (2020-09-28T10:52:48Z) - Ambiguity in Sequential Data: Predicting Uncertain Futures with
Recurrent Models [110.82452096672182]
We propose an extension of the Multiple Hypothesis Prediction (MHP) model to handle ambiguous predictions with sequential data.
We also introduce a novel metric for ambiguous problems, which is better suited to account for uncertainties.
arXiv Detail & Related papers (2020-03-10T09:15:42Z) - Complexity Measures and Features for Times Series classification [0.0]
We propose a set of characteristics capable of extracting information on the structure of the time series to face time series classification problems.
The experimental results of our proposal show no statistically significant differences from the second and third best models of the state-of-the-art.
arXiv Detail & Related papers (2020-02-27T11:08:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.