Scalable Classifier-Agnostic Channel Selection for MTSC

• URL: http://arxiv.org/abs/2206.09274v1
• Date: Sat, 18 Jun 2022 19:57:46 GMT
• Title: Scalable Classifier-Agnostic Channel Selection for MTSC
• Authors: Bhaskar Dhariyal, Thach Le Nguyen, Georgiana Ifrim
• Abstract summary: Current time series classification algorithms need hundreds of compute hours to complete training and prediction. We propose and evaluate two methods for channel selection. Channel selection is applied as a pre-processing step before training state-of-the-art MTSC algorithms.
• Score: 7.94957965474334
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Accuracy is a key focus of current work in time series classification. However, speed and data reduction in many applications is equally important, especially when the data scale and storage requirements increase rapidly. Current MTSC algorithms need hundreds of compute hours to complete training and prediction. This is due to the nature of multivariate time series data, which grows with the number of time series, their length and the number of channels. In many applications, not all the channels are useful for the classification task; hence we require methods that can efficiently select useful channels and thus save computational resources. We propose and evaluate two methods for channel selection. Our techniques work by representing each class by a prototype time series and performing channel selection based on the prototype distance between classes. The main hypothesis is that useful channels enable better separation between classes; hence, channels with the higher distance between class prototypes are more useful. On the UEA Multivariate Time Series Classification (MTSC) benchmark, we show that these techniques achieve significant data reduction and classifier speedup for similar levels of classification accuracy. Channel selection is applied as a pre-processing step before training state-of-the-art MTSC algorithms and saves about 70\% of computation time and data storage, with preserved accuracy. Furthermore, our methods enable even efficient classifiers, such as ROCKET, to achieve better accuracy than using no channel selection or forward channel selection. To further study the impact of our techniques, we present experiments on classifying synthetic multivariate time series datasets with more than 100 channels, as well as a real-world case study on a dataset with 50 channels. Our channel selection methods lead to significant data reduction with preserved or improved accuracy.

Related papers

• Towards Free Data Selection with General-Purpose Models [71.92151210413374]
  A desirable data selection algorithm can efficiently choose the most informative samples to maximize the utility of limited annotation budgets. Current approaches, represented by active learning methods, typically follow a cumbersome pipeline that iterates the time-consuming model training and batch data selection repeatedly. FreeSel bypasses the heavy batch selection process, achieving a significant improvement in efficiency and being 530x faster than existing active learning methods.
  arXiv  Detail & Related papers  (2023-09-29T15:50:14Z)
• Evaluating Explanation Methods for Multivariate Time Series Classification [4.817429789586127]
  The main focus of this paper is on analysing and evaluating explanation methods tailored to Multivariate Time Series Classification (MTSC) We focus on saliency-based explanation methods that can point out the most relevant channels and time series points for the classification decision. We study these methods on 3 synthetic datasets and 2 real-world datasets and provide a quantitative and qualitative analysis of the explanations provided.
  arXiv  Detail & Related papers  (2023-08-29T11:24:12Z)
• Multi-view self-supervised learning for multivariate variable-channel time series [1.094320514634939]
  We propose learning one encoder to operate on all input channels individually. We then use a message passing neural network to extract a single representation across channels. We show that our method, combined with the TS2Vec loss, outperforms all other methods in most settings.
  arXiv  Detail & Related papers  (2023-07-13T19:03:06Z)
• Multivariate Time Series Classification: A Deep Learning Approach [1.0742675209112622]
  This paper investigates different methods and various neural network architectures applicable in the time series classification domain. Data is obtained from a fleet of gas sensors that measure and track quantities such as oxygen and sound. With the help of this data, we can detect events such as occupancy in a specific environment.
  arXiv  Detail & Related papers  (2023-07-05T12:50:48Z)
• Multivariate Time Series Early Classification Across Channel and Time Dimensions [3.5786621294068373]
  We propose a more flexible early classification pipeline that offers a more granular consideration of input channels. Our method can enhance the early classification paradigm by achieving improved accuracy for equal input utilization.
  arXiv  Detail & Related papers  (2023-06-26T11:30:33Z)
• An Efficient Machine Learning-based Channel Prediction Technique for OFDM Sub-Bands [0.0]
  We propose an efficient machine learning (ML)-based technique for channel prediction in OFDM sub-bands. The novelty of the proposed approach lies in the training of channel fading samples used to estimate future channel behaviour in selective fading.
  arXiv  Detail & Related papers  (2023-05-31T09:41:27Z)
• TempNet: Temporal Attention Towards the Detection of Animal Behaviour in Videos [63.85815474157357]
  We propose an efficient computer vision- and deep learning-based method for the detection of biological behaviours in videos. TempNet uses an encoder bridge and residual blocks to maintain model performance with a two-staged, spatial, then temporal, encoder. We demonstrate its application to the detection of sablefish (Anoplopoma fimbria) startle events.
  arXiv  Detail & Related papers  (2022-11-17T23:55:12Z)
• Compactness Score: A Fast Filter Method for Unsupervised Feature Selection [66.84571085643928]
  We propose a fast unsupervised feature selection method, named as, Compactness Score (CSUFS) to select desired features. Our proposed algorithm seems to be more accurate and efficient compared with existing algorithms.
  arXiv  Detail & Related papers  (2022-01-31T13:01:37Z)
• Improving Calibration for Long-Tailed Recognition [68.32848696795519]
  We propose two methods to improve calibration and performance in such scenarios. For dataset bias due to different samplers, we propose shifted batch normalization. Our proposed methods set new records on multiple popular long-tailed recognition benchmark datasets.
  arXiv  Detail & Related papers  (2021-04-01T13:55:21Z)
• Channel-wise Knowledge Distillation for Dense Prediction [73.99057249472735]
  We propose to align features channel-wise between the student and teacher networks. We consistently achieve superior performance on three benchmarks with various network structures.
  arXiv  Detail & Related papers  (2020-11-26T12:00:38Z)
• DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detection [98.43451011898212]
  In multiuser multiple-input multiple-output (MIMO) setups, where multiple symbols are simultaneously transmitted, accurate symbol detection is challenging. We propose a data-driven implementation of the iterative soft interference cancellation (SIC) algorithm which we refer to as DeepSIC. DeepSIC learns to carry out joint detection from a limited set of training samples without requiring the channel to be linear.
  arXiv  Detail & Related papers  (2020-02-08T18:31:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.