A Deep Graph Reinforcement Learning Model for Improving User Experience in Live Video Streaming

• URL: http://arxiv.org/abs/2107.13619v1
• Date: Wed, 28 Jul 2021 19:53:05 GMT
• Title: A Deep Graph Reinforcement Learning Model for Improving User Experience in Live Video Streaming
• Authors: Stefanos Antaris, Dimitrios Rafailidis, Sarunas Girdzijauskas
• Abstract summary: We present a deep graph reinforcement learning model to predict and improve the user experience during a live video streaming event. Our model can significantly increase the number of viewers with high quality experience by at least 75% over the first streaming minutes.
• Score: 7.852895577861326
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper we present a deep graph reinforcement learning model to predict and improve the user experience during a live video streaming event, orchestrated by an agent/tracker. We first formulate the user experience prediction problem as a classification task, accounting for the fact that most of the viewers at the beginning of an event have poor quality of experience due to low-bandwidth connections and limited interactions with the tracker. In our model we consider different factors that influence the quality of user experience and train the proposed model on diverse state-action transitions when viewers interact with the tracker. In addition, provided that past events have various user experience characteristics we follow a gradient boosting strategy to compute a global model that learns from different events. Our experiments with three real-world datasets of live video streaming events demonstrate the superiority of the proposed model against several baseline strategies. Moreover, as the majority of the viewers at the beginning of an event has poor experience, we show that our model can significantly increase the number of viewers with high quality experience by at least 75% over the first streaming minutes. Our evaluation datasets and implementation are publicly available at https://publicresearch.z13.web.core.windows.net

Related papers

• SWaT: Statistical Modeling of Video Watch Time through User Behavior Analysis [15.246875830547056]
  We propose a white-box statistical framework that translates various user behavior assumptions in watching (short) videos into statistical watch time models. We test our models extensively on two public datasets, a large-scale offline industrial dataset, and an online A/B test on a short video platform with hundreds of millions of daily-active users.
  arXiv  Detail & Related papers  (2024-08-14T18:19:35Z)
• MMBee: Live Streaming Gift-Sending Recommendations via Multi-Modal Fusion and Behaviour Expansion [18.499672566131355]
  Accurately modeling the gifting interaction not only enhances users' experience but also increases streamers' revenue. Previous studies on live streaming gifting prediction treat this task as a conventional recommendation problem. We propose MMBee based on real-time Multi-Modal Fusion and Behaviour Expansion to address these issues.
  arXiv  Detail & Related papers  (2024-06-15T04:59:00Z)
• Early Action Recognition with Action Prototypes [62.826125870298306]
  We propose a novel model that learns a prototypical representation of the full action for each class. We decompose the video into short clips, where a visual encoder extracts features from each clip independently. Later, a decoder aggregates together in an online fashion features from all the clips for the final class prediction.
  arXiv  Detail & Related papers  (2023-12-11T18:31:13Z)
• Learning from One Continuous Video Stream [70.30084026960819]
  We introduce a framework for online learning from a single continuous video stream. This poses great challenges given the high correlation between consecutive video frames. We employ pixel-to-pixel modelling as a practical and flexible way to switch between pre-training and single-stream evaluation.
  arXiv  Detail & Related papers  (2023-12-01T14:03:30Z)
• Click-Based Student Performance Prediction: A Clustering Guided Meta-Learning Approach [10.962724342736042]
  We study the problem of predicting student knowledge acquisition in online courses from clickstream behavior. Our methodology for predicting in-video quiz performance is based on three key ideas we develop.
  arXiv  Detail & Related papers  (2021-10-28T14:03:29Z)
• Meta-Reinforcement Learning via Buffering Graph Signatures for Live Video Streaming Events [4.332367445046418]
  We present a meta-learning model to adapt the predictions of the network's capacity between viewers who participate in a live video streaming event. We evaluate the proposed model on the link weight prediction task on three real-world of live video streaming events.
  arXiv  Detail & Related papers  (2021-10-03T14:03:22Z)
• Multi-Task Learning for User Engagement and Adoption in Live Video Streaming Events [7.5413579967970605]
  We present a multi-task deep reinforcement learning model to select the time of a live video streaming event. We consider the engagement and adoption of the viewers as independent tasks and formulate a unified loss function to learn a common policy. Our experiments demonstrate the effectiveness of the proposed model when compared with several state-of-the-art strategies.
  arXiv  Detail & Related papers  (2021-06-18T18:30:22Z)
• CoCon: Cooperative-Contrastive Learning [52.342936645996765]
  Self-supervised visual representation learning is key for efficient video analysis. Recent success in learning image representations suggests contrastive learning is a promising framework to tackle this challenge. We introduce a cooperative variant of contrastive learning to utilize complementary information across views.
  arXiv  Detail & Related papers  (2021-04-30T05:46:02Z)
• Reducing Representation Drift in Online Continual Learning [87.71558506591937]
  We study the online continual learning paradigm, where agents must learn from a changing distribution with constrained memory and compute. In this work we instead focus on the change in representations of previously observed data due to the introduction of previously unobserved class samples in the incoming data stream.
  arXiv  Detail & Related papers  (2021-04-11T15:19:30Z)
• Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling [70.64257515361972]
  We argue that focusing on tail users could bring more benefits and address the long tails issue. Specifically, we propose a gradient alignment and adopt an adversarial training scheme to facilitate knowledge transfer from the head to the tail.
  arXiv  Detail & Related papers  (2020-10-22T03:12:02Z)
• Omni-supervised Facial Expression Recognition via Distilled Data [120.11782405714234]
  We propose omni-supervised learning to exploit reliable samples in a large amount of unlabeled data for network training. We experimentally verify that the new dataset can significantly improve the ability of the learned FER model. To tackle this, we propose to apply a dataset distillation strategy to compress the created dataset into several informative class-wise images.
  arXiv  Detail & Related papers  (2020-05-18T09:36:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.