Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendation

• URL: http://arxiv.org/abs/2212.08262v2
• Date: Sun, 17 Dec 2023 06:05:22 GMT
• Title: Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendation
• Authors: Yizhou Dang, Enneng Yang, Guibing Guo, Linying Jiang, Xingwei Wang, Xiaoxiao Xu, Qinghui Sun, Hong Liu
• Abstract summary: Sequential recommendation is an important task to predict the next-item to access based on a sequence of items. Most existing works learn user preference as the transition pattern from the previous item to the next one, ignoring the time interval between these two items. We propose to augment sequence data from the perspective of time interval, which is not studied in the literature.
• Score: 16.00020821220671
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Sequential recommendation is an important task to predict the next-item to access based on a sequence of interacted items. Most existing works learn user preference as the transition pattern from the previous item to the next one, ignoring the time interval between these two items. However, we observe that the time interval in a sequence may vary significantly different, and thus result in the ineffectiveness of user modeling due to the issue of \emph{preference drift}. In fact, we conducted an empirical study to validate this observation, and found that a sequence with uniformly distributed time interval (denoted as uniform sequence) is more beneficial for performance improvement than that with greatly varying time interval. Therefore, we propose to augment sequence data from the perspective of time interval, which is not studied in the literature. Specifically, we design five operators (Ti-Crop, Ti-Reorder, Ti-Mask, Ti-Substitute, Ti-Insert) to transform the original non-uniform sequence to uniform sequence with the consideration of variance of time intervals. Then, we devise a control strategy to execute data augmentation on item sequences in different lengths. Finally, we implement these improvements on a state-of-the-art model CoSeRec and validate our approach on four real datasets. The experimental results show that our approach reaches significantly better performance than the other 11 competing methods. Our implementation is available: https://github.com/KingGugu/TiCoSeRec.

Related papers

• Seq-to-Final: A Benchmark for Tuning from Sequential Distributions to a Final Time Point [18.843395348612553]
  Leveraging historical data is necessary to learn a model for the last time point when limited data is available in the final period. We construct a benchmark with different sequences of synthetic shifts to evaluate the effectiveness of 3 classes of methods. Our results suggest that, for the sequences in our benchmark, methods that disregard the sequential structure and adapt to the final time point tend to perform well.
  arXiv  Detail & Related papers  (2024-07-12T19:03:42Z)
• UniRec: A Dual Enhancement of Uniformity and Frequency in Sequential Recommendations [13.654819858917332]
  We propose UniRec, a novel bidirectional enhancement sequential recommendation method. UniRec improves the representation of non-uniform sequences and less-frequent items. To the best of our knowledge, UniRec is the first method to utilize the characteristics of uniformity and frequency for feature augmentation.
  arXiv  Detail & Related papers  (2024-06-26T16:28:24Z)
• Made to Order: Discovering monotonic temporal changes via self-supervised video ordering [89.0660110757949]
  We exploit a simple proxy task of ordering a shuffled image sequence, with time' serving as a supervisory signal. We introduce a transformer-based model for ordering of image sequences of arbitrary length with built-in attribution maps.
  arXiv  Detail & Related papers  (2024-04-25T17:59:56Z)
• TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling [67.02157180089573]
  Time series pre-training has recently garnered wide attention for its potential to reduce labeling expenses and benefit various downstream tasks. This paper proposes TimeSiam as a simple but effective self-supervised pre-training framework for Time series based on Siamese networks.
  arXiv  Detail & Related papers  (2024-02-04T13:10:51Z)
• Ego-Network Transformer for Subsequence Classification in Time Series Data [36.591480151951515]
  Real-world time series data often contain foreground subsequences intertwined with background subsequences. We propose a novel subsequence classification method that represents each subsequence as an ego-network. Our method outperforms the baseline on 104 out of 158 datasets.
  arXiv  Detail & Related papers  (2023-11-05T04:21:42Z)
• Elastic Product Quantization for Time Series [19.839572576189187]
  We propose the use of product quantization for efficient similarity-based comparison of time series under time warping. The proposed solution emerges as a highly efficient (both in terms of memory usage and time) replacement for elastic measures in time series applications.
  arXiv  Detail & Related papers  (2022-01-04T09:23:06Z)
• Learning to Align Sequential Actions in the Wild [123.62879270881807]
  We propose an approach to align sequential actions in the wild that involve diverse temporal variations. Our model accounts for both monotonic and non-monotonic sequences. We demonstrate that our approach consistently outperforms the state-of-the-art in self-supervised sequential action representation learning.
  arXiv  Detail & Related papers  (2021-11-17T18:55:36Z)
• Cluster-and-Conquer: A Framework For Time-Series Forecasting [94.63501563413725]
  We propose a three-stage framework for forecasting high-dimensional time-series data. Our framework is highly general, allowing for any time-series forecasting and clustering method to be used in each step. When instantiated with simple linear autoregressive models, we are able to achieve state-of-the-art results on several benchmark datasets.
  arXiv  Detail & Related papers  (2021-10-26T20:41:19Z)
• Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformer [69.0621959845251]
  We propose a new framework Temporal Graph Sequential Recommender (TGSRec) upon our defined continuous-time bi-partite graph. TCT layer can simultaneously capture collaborative signals from both users and items, as well as considering temporal dynamics inside sequential patterns. Empirical results on five datasets show that TGSRec significantly outperforms other baselines.
  arXiv  Detail & Related papers  (2021-08-14T22:50:53Z)
• Sequence Adaptation via Reinforcement Learning in Recommender Systems [8.909115457491522]
  We propose the SAR model, which learns the sequential patterns and adjusts the sequence length of user-item interactions in a personalized manner. In addition, we optimize a joint loss function to align the accuracy of the sequential recommendations with the expected cumulative rewards of the critic network. Our experimental evaluation on four real-world datasets demonstrates the superiority of our proposed model over several baseline approaches.
  arXiv  Detail & Related papers  (2021-07-31T13:56:46Z)
• Modeling Sequences as Distributions with Uncertainty for Sequential Recommendation [63.77513071533095]
  Most existing sequential methods assume users are deterministic. Item-item transitions might fluctuate significantly in several item aspects and exhibit randomness of user interests. We propose a Distribution-based Transformer Sequential Recommendation (DT4SR) which injects uncertainties into sequential modeling.
  arXiv  Detail & Related papers  (2021-06-11T04:35:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.