XAI for time-series classification leveraging image highlight methods

• URL: http://arxiv.org/abs/2311.17110v1
• Date: Tue, 28 Nov 2023 10:59:18 GMT
• Title: XAI for time-series classification leveraging image highlight methods
• Authors: Georgios Makridis, Georgios Fatouros, Vasileios Koukos, Dimitrios Kotios, Dimosthenis Kyriazis, Ioannis Soldatos
• Abstract summary: We present a Deep Neural Network (DNN) in a teacher-student architecture (distillation model) that offers interpretability in time-series classification tasks.
• Score: 0.0699049312989311
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Although much work has been done on explainability in the computer vision and natural language processing (NLP) fields, there is still much work to be done to explain methods applied to time series as time series by nature can not be understood at first sight. In this paper, we present a Deep Neural Network (DNN) in a teacher-student architecture (distillation model) that offers interpretability in time-series classification tasks. The explainability of our approach is based on transforming the time series to 2D plots and applying image highlight methods (such as LIME and GradCam), making the predictions interpretable. At the same time, the proposed approach offers increased accuracy competing with the baseline model with the trade-off of increasing the training time.

Related papers

• Graph Neural Alchemist: An innovative fully modular architecture for time series-to-graph classification [0.0]
  This paper introduces a novel Graph Neural Network (GNN) architecture for time series classification. By representing time series as visibility graphs, it is possible to encode both temporal dependencies inherent to time series data. Our architecture is fully modular, enabling flexible experimentation with different models.
  arXiv  Detail & Related papers  (2024-10-12T00:03:40Z)
• Multi-Patch Prediction: Adapting LLMs for Time Series Representation Learning [22.28251586213348]
  aLLM4TS is an innovative framework that adapts Large Language Models (LLMs) for time-series representation learning. A distinctive element of our framework is the patch-wise decoding layer, which departs from previous methods reliant on sequence-level decoding.
  arXiv  Detail & Related papers  (2024-02-07T13:51:26Z)
• RTQ: Rethinking Video-language Understanding Based on Image-text Model [55.278942477715084]
  Video-language understanding presents unique challenges due to the inclusion of highly complex semantic details. We propose a novel framework called RTQ, which addresses these challenges simultaneously. Our model demonstrates outstanding performance even in the absence of video-language pre-training.
  arXiv  Detail & Related papers  (2023-12-01T04:51:01Z)
• Self-Distilled Representation Learning for Time Series [45.51976109748732]
  Self-supervised learning for time-series data holds potential similar to that recently unleashed in Natural Language Processing and Computer Vision. We propose a conceptually simple yet powerful non-contrastive approach, based on the data2vec self-distillation framework. We demonstrate the competitiveness of our approach for classification and forecasting as downstream tasks, comparing with state-of-the-art self-supervised learning methods on the UCR and UEA archives as well as the ETT and Electricity datasets.
  arXiv  Detail & Related papers  (2023-11-19T14:34:01Z)
• On the Consistency and Robustness of Saliency Explanations for Time Series Classification [4.062872727927056]
  Saliency maps have been applied to interpret time series windows as images. This paper extensively analyzes the consistency and robustness of saliency maps for time series features and temporal attribution.
  arXiv  Detail & Related papers  (2023-09-04T09:08:22Z)
• TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders [55.00904795497786]
  We propose TimeMAE, a novel self-supervised paradigm for learning transferrable time series representations based on transformer networks. The TimeMAE learns enriched contextual representations of time series with a bidirectional encoding scheme. To solve the discrepancy issue incurred by newly injected masked embeddings, we design a decoupled autoencoder architecture.
  arXiv  Detail & Related papers  (2023-03-01T08:33:16Z)
• Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring [82.84513669453744]
  Image-text pretrained models, e.g., CLIP, have shown impressive general multi-modal knowledge learned from large-scale image-text data pairs. We revisit temporal modeling in the context of image-to-video knowledge transferring. We present a simple and effective temporal modeling mechanism extending CLIP model to diverse video tasks.
  arXiv  Detail & Related papers  (2023-01-26T14:12:02Z)
• Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing [53.89917396428747]
  Self-supervised learning in vision-language processing exploits semantic alignment between imaging and text modalities. We explicitly account for prior images and reports when available during both training and fine-tuning. Our approach, named BioViL-T, uses a CNN-Transformer hybrid multi-image encoder trained jointly with a text model.
  arXiv  Detail & Related papers  (2023-01-11T16:35:33Z)
• Ripple: Concept-Based Interpretation for Raw Time Series Models in Education [5.374524134699487]
  Time series is the most prevalent form of input data for educational prediction tasks. We propose an approach that utilizes irregular multivariate time series modeling with graph neural networks to achieve comparable or better accuracy. We analyze these advances in the education domain, addressing the task of early student performance prediction.
  arXiv  Detail & Related papers  (2022-12-02T12:26:00Z)
• mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections [104.14624185375897]
  mPLUG is a new vision-language foundation model for both cross-modal understanding and generation. It achieves state-of-the-art results on a wide range of vision-language downstream tasks, such as image captioning, image-text retrieval, visual grounding and visual question answering.
  arXiv  Detail & Related papers  (2022-05-24T11:52:06Z)
• Learning Temporal Dynamics from Cycles in Narrated Video [85.89096034281694]
  We propose a self-supervised solution to the problem of learning to model how the world changes as time elapses. Our model learns modality-agnostic functions to predict forward and backward in time, which must undo each other when composed. We apply the learned dynamics model without further training to various tasks, such as predicting future action and temporally ordering sets of images.
  arXiv  Detail & Related papers  (2021-01-07T02:41:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.