Handling Variable-Dimensional Time Series with Graph Neural Networks

• URL: http://arxiv.org/abs/2007.00411v5
• Date: Mon, 20 Jul 2020 06:42:21 GMT
• Title: Handling Variable-Dimensional Time Series with Graph Neural Networks
• Authors: Vibhor Gupta, Jyoti Narwariya, Pankaj Malhotra, Lovekesh Vig, Gautam Shroff
• Abstract summary: Internet of Things (IoT) technology involves capturing data from multiple sensors resulting in multi-sensor time series. Existing neural networks based approaches for such multi-sensor time series modeling assume fixed input dimension or number of sensors. We consider training neural network models from such multi-sensor time series, where the time series have varying input dimensionality owing to availability or installation of a different subset of sensors at each source of time series.
• Score: 20.788813485815698
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Several applications of Internet of Things (IoT) technology involve capturing data from multiple sensors resulting in multi-sensor time series. Existing neural networks based approaches for such multi-sensor or multivariate time series modeling assume fixed input dimension or number of sensors. Such approaches can struggle in the practical setting where different instances of the same device or equipment such as mobiles, wearables, engines, etc. come with different combinations of installed sensors. We consider training neural network models from such multi-sensor time series, where the time series have varying input dimensionality owing to availability or installation of a different subset of sensors at each source of time series. We propose a novel neural network architecture suitable for zero-shot transfer learning allowing robust inference for multivariate time series with previously unseen combination of available dimensions or sensors at test time. Such a combinatorial generalization is achieved by conditioning the layers of a core neural network-based time series model with a "conditioning vector" that carries information of the available combination of sensors for each time series. This conditioning vector is obtained by summarizing the set of learned "sensor embedding vectors" corresponding to the available sensors in a time series via a graph neural network. We evaluate the proposed approach on publicly available activity recognition and equipment prognostics datasets, and show that the proposed approach allows for better generalization in comparison to a deep gated recurrent neural network baseline.

Related papers

• SMORE: Similarity-based Hyperdimensional Domain Adaptation for Multi-Sensor Time Series Classification [17.052624039805856]
  We propose SMORE, a novel resource-efficient domain adaptation (DA) algorithm for multi-sensor time series classification. SMORE achieves on average 1.98% higher accuracy than state-of-the-art (SOTA) DNN-based DA algorithms with 18.81x faster training and 4.63x faster inference.
  arXiv  Detail & Related papers  (2024-02-20T18:48:49Z)
• A distributed neural network architecture for dynamic sensor selection with application to bandwidth-constrained body-sensor networks [53.022158485867536]
  We propose a dynamic sensor selection approach for deep neural networks (DNNs) It is able to derive an optimal sensor subset selection for each specific input sample instead of a fixed selection for the entire dataset. We show how we can use this dynamic selection to increase the lifetime of a wireless sensor network (WSN) by imposing constraints on how often each node is allowed to transmit.
  arXiv  Detail & Related papers  (2023-08-16T14:04:50Z)
• Deep Learning Method for Cell-Wise Object Tracking, Velocity Estimation and Projection of Sensor Data over Time [0.7340017786387767]
  We show how ConvNets suffer from architectural restrictions for this task. In a last step, the memory state of the Recurrent Neural Network is projected based on extracted velocity estimates.
  arXiv  Detail & Related papers  (2023-06-08T07:33:05Z)
• Continuous time recurrent neural networks: overview and application to forecasting blood glucose in the intensive care unit [56.801856519460465]
  Continuous time autoregressive recurrent neural networks (CTRNNs) are a deep learning model that account for irregular observations. We demonstrate the application of these models to probabilistic forecasting of blood glucose in a critical care setting.
  arXiv  Detail & Related papers  (2023-04-14T09:39:06Z)
• HyperTime: Implicit Neural Representation for Time Series [131.57172578210256]
  Implicit neural representations (INRs) have recently emerged as a powerful tool that provides an accurate and resolution-independent encoding of data. In this paper, we analyze the representation of time series using INRs, comparing different activation functions in terms of reconstruction accuracy and training convergence speed. We propose a hypernetwork architecture that leverages INRs to learn a compressed latent representation of an entire time series dataset.
  arXiv  Detail & Related papers  (2022-08-11T14:05:51Z)
• Novel Features for Time Series Analysis: A Complex Networks Approach [62.997667081978825]
  Time series data are ubiquitous in several domains as climate, economics and health care. Recent conceptual approach relies on time series mapping to complex networks. Network analysis can be used to characterize different types of time series.
  arXiv  Detail & Related papers  (2021-10-11T13:46:28Z)
• Graph Attention Recurrent Neural Networks for Correlated Time Series Forecasting -- Full version [16.22449727526222]
  We consider a setting where multiple entities inter-act with each other over time and the time-varying statuses of the entities are represented as correlated time series. To enable accurate forecasting on correlated time series, we proposes graph attention recurrent neural networks. Experiments on a large real-world speed time series data set suggest that the proposed method is effective and outperforms the state-of-the-art in most settings.
  arXiv  Detail & Related papers  (2021-03-19T12:15:37Z)
• Deep Cellular Recurrent Network for Efficient Analysis of Time-Series Data with Spatial Information [52.635997570873194]
  This work proposes a novel deep cellular recurrent neural network (DCRNN) architecture to process complex multi-dimensional time series data with spatial information. The proposed architecture achieves state-of-the-art performance while utilizing substantially less trainable parameters when compared to comparable methods in the literature.
  arXiv  Detail & Related papers  (2021-01-12T20:08:18Z)
• RE-MIMO: Recurrent and Permutation Equivariant Neural MIMO Detection [85.44877328116881]
  We present a novel neural network for symbol detection in wireless communication systems. It is motivated by several important considerations in wireless communication systems. We compare its performance against existing methods and the results show the ability of our network to efficiently handle a variable number of transmitters.
  arXiv  Detail & Related papers  (2020-06-30T22:43:01Z)
• Deep ConvLSTM with self-attention for human activity decoding using wearables [0.0]
  We propose a deep neural network architecture that captures features of multiple sensor time-series data but also selects important time points. We show the validity of the proposed approach across different data sampling strategies and demonstrate that the self-attention mechanism gave a significant improvement. The proposed methods open avenues for better decoding of human activity from multiple body sensors over extended periods time.
  arXiv  Detail & Related papers  (2020-05-02T04:30:31Z)
• Sensor selection on graphs via data-driven node sub-sampling in network time series [0.0]
  This paper is concerned by the problem of selecting an optimal sampling set of sensors over a network of time series. We propose and compare various data-driven strategies to turn off a fixed number of sensors or equivalently to select a sampling set of nodes. To illustrate the performances of our approach, we report numerical experiments on the analysis of real data from bike sharing networks in different cities.
  arXiv  Detail & Related papers  (2020-04-24T15:51:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.