Modeling Live Video Streaming: Real-Time Classification, QoE Inference, and Field Evaluation

• URL: http://arxiv.org/abs/2112.02637v1
• Date: Sun, 5 Dec 2021 17:53:06 GMT
• Title: Modeling Live Video Streaming: Real-Time Classification, QoE Inference, and Field Evaluation
• Authors: Sharat Chandra Madanapalli, Alex Mathai, Hassan Habibi Gharakheili, and Vijay Sivaraman
• Abstract summary: ReCLive is a machine learning method for live video detection and QoE measurement based on network-level behavioral characteristics. We analyze about 23,000 video streams from Twitch and YouTube, and identify key features in their traffic profile that differentiate live and on-demand streaming. Our solution provides ISPs with fine-grained visibility into live video streams, enabling them to measure and improve user experience.
• Score: 1.4353812560047186
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Social media, professional sports, and video games are driving rapid growth in live video streaming, on platforms such as Twitch and YouTube Live. Live streaming experience is very susceptible to short-time-scale network congestion since client playback buffers are often no more than a few seconds. Unfortunately, identifying such streams and measuring their QoE for network management is challenging, since content providers largely use the same delivery infrastructure for live and video-on-demand (VoD) streaming, and packet inspection techniques (including SNI/DNS query monitoring) cannot always distinguish between the two. In this paper, we design, build, and deploy ReCLive: a machine learning method for live video detection and QoE measurement based on network-level behavioral characteristics. Our contributions are four-fold: (1) We analyze about 23,000 video streams from Twitch and YouTube, and identify key features in their traffic profile that differentiate live and on-demand streaming. We release our traffic traces as open data to the public; (2) We develop an LSTM-based binary classifier model that distinguishes live from on-demand streams in real-time with over 95% accuracy across providers; (3) We develop a method that estimates QoE metrics of live streaming flows in terms of resolution and buffer stall events with overall accuracies of 93% and 90%, respectively; and (4) Finally, we prototype our solution, train it in the lab, and deploy it in a live ISP network serving more than 7,000 subscribers. Our method provides ISPs with fine-grained visibility into live video streams, enabling them to measure and improve user experience.

Related papers

• Satellite Streaming Video QoE Prediction: A Real-World Subjective Database and Network-Level Prediction Models [59.061552498630874]
  We introduce the LIVE-Viasat Real-World Satellite QoE Database. This database consists of 179 videos recorded from real-world streaming services affected by various authentic distortion patterns. We demonstrate the usefulness of this unique new resource by evaluating the efficacy of QoE-prediction models on it. We also created a new model that maps the network parameters to predicted human perception scores, which can be used by ISPs to optimize the video streaming quality of their networks.
  arXiv  Detail & Related papers  (2024-10-17T18:22:50Z)
• Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams [78.72965584414368]
  We present Flash-VStream, a video-language model that simulates the memory mechanism of human. Compared to existing models, Flash-VStream achieves significant reductions in latency inference and VRAM consumption. We propose VStream-QA, a novel question answering benchmark specifically designed for online video streaming understanding.
  arXiv  Detail & Related papers  (2024-06-12T11:07:55Z)
• Reinforcement Learning -based Adaptation and Scheduling Methods for Multi-source DASH [1.1971219484941955]
  Dynamic adaptive streaming over HTTP (DASH) has been widely used in video streaming recently. In multi-source streaming, video chunks may arrive out of order due to different conditions of the network paths. This paper proposes two algorithms for streaming from multiple sources: RL-based adaptation with greedy scheduling (RLAGS) and RL-based adaptation and scheduling (RLAS)
  arXiv  Detail & Related papers  (2023-07-25T06:47:12Z)
• LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos [82.48910259277984]
  Livestream tutorial videos are usually hours long, recorded, and uploaded to the Internet directly after the live sessions, making it hard for other people to catch up quickly. An outline will be a beneficial solution, which requires the video to be temporally segmented according to topics. We propose LiveSeg, an unsupervised Livestream video temporal solution, which takes advantage of multimodal features from different domains.
  arXiv  Detail & Related papers  (2022-10-12T00:08:17Z)
• Telepresence Video Quality Assessment [13.417089780219326]
  We create an online video quality prediction framework for live streaming, using a multi-modal learning framework with separate pathways to compute visual and audio quality predictions. Our all-in-one model is able to provide accurate quality predictions at the patch, frame, clip, and audiovisual levels.
  arXiv  Detail & Related papers  (2022-07-20T15:02:55Z)
• Real-time Object Detection for Streaming Perception [84.2559631820007]
  Streaming perception is proposed to jointly evaluate the latency and accuracy into a single metric for video online perception. We build a simple and effective framework for streaming perception. Our method achieves competitive performance on Argoverse-HD dataset and improves the AP by 4.9% compared to the strong baseline.
  arXiv  Detail & Related papers  (2022-03-23T11:33:27Z)
• Searching for Two-Stream Models in Multivariate Space for Video Recognition [80.25356538056839]
  We present a pragmatic neural architecture search approach, which is able to search for two-stream video models in giant spaces efficiently. We demonstrate two-stream models with significantly better performance can be automatically discovered in our design space.
  arXiv  Detail & Related papers  (2021-08-30T02:03:28Z)
• VStreamDRLS: Dynamic Graph Representation Learning with Self-Attention for Enterprise Distributed Video Streaming Solutions [4.568777157687959]
  VStreamDRLS is a graph neural network architecture with a self-attention mechanism to capture the evolution of the graph structure of live video streaming events. We evaluate our proposed approach on the link prediction task on two real-world datasets, generated by enterprise live video streaming events.
  arXiv  Detail & Related papers  (2020-11-11T10:00:12Z)
• ApproxDet: Content and Contention-Aware Approximate Object Detection for Mobiles [19.41234144545467]
  We introduce ApproxDet, an adaptive video object detection framework for mobile devices to meet accuracy-latency requirements. We evaluate ApproxDet on a large benchmark video dataset and compare quantitatively to AdaScale and YOLOv3. We find that ApproxDet is able to adapt to a wide variety of contention and content characteristics and outshines all baselines.
  arXiv  Detail & Related papers  (2020-10-21T04:11:05Z)
• Non-Cooperative Game Theory Based Rate Adaptation for Dynamic Video Streaming over HTTP [89.30855958779425]
  Dynamic Adaptive Streaming over HTTP (DASH) has demonstrated to be an emerging and promising multimedia streaming technique. We propose a novel algorithm to optimally allocate the limited export bandwidth of the server to multi-users to maximize their Quality of Experience (QoE) with fairness guaranteed.
  arXiv  Detail & Related papers  (2019-12-27T01:19:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.