Learning to Compress Unmanned Aerial Vehicle (UAV) Captured Video: Benchmark and Analysis

• URL: http://arxiv.org/abs/2301.06115v1
• Date: Sun, 15 Jan 2023 15:18:02 GMT
• Title: Learning to Compress Unmanned Aerial Vehicle (UAV) Captured Video: Benchmark and Analysis
• Authors: Chuanmin Jia, Feng Ye, Huifang Sun, Siwei Ma, Wen Gao
• Abstract summary: We propose a novel task for learned UAV video coding and construct a comprehensive and systematic benchmark for such a task. It is expected that the benchmark will accelerate the research and development in video coding on drone platforms.
• Score: 54.07535860237662
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: During the past decade, the Unmanned-Aerial-Vehicles (UAVs) have attracted increasing attention due to their flexible, extensive, and dynamic space-sensing capabilities. The volume of video captured by UAVs is exponentially growing along with the increased bitrate generated by the advancement of the sensors mounted on UAVs, bringing new challenges for on-device UAV storage and air-ground data transmission. Most existing video compression schemes were designed for natural scenes without consideration of specific texture and view characteristics of UAV videos. In this work, we first contribute a detailed analysis of the current state of the field of UAV video coding. Then we propose to establish a novel task for learned UAV video coding and construct a comprehensive and systematic benchmark for such a task, present a thorough review of high quality UAV video datasets and benchmarks, and contribute extensive rate-distortion efficiency comparison of learned and conventional codecs after. Finally, we discuss the challenges of encoding UAV videos. It is expected that the benchmark will accelerate the research and development in video coding on drone platforms.

Related papers

• UAVDB: Trajectory-Guided Adaptable Bounding Boxes for UAV Detection [0.03464344220266879]
  Patch Intensity Convergence (PIC) technique generates high-fidelity bounding boxes for UAV detection without manual labeling. This technique forms the foundation of UAVDB, a dedicated database designed specifically for UAV detection. We benchmark UAVDB using state-of-the-art (SOTA) YOLO series detectors, providing a comprehensive performance analysis.
  arXiv  Detail & Related papers  (2024-09-09T13:27:53Z)
• Multiview Aerial Visual Recognition (MAVREC): Can Multi-view Improve Aerial Visual Perception? [57.77643186237265]
  We present Multiview Aerial Visual RECognition or MAVREC, a video dataset where we record synchronized scenes from different perspectives. MAVREC consists of around 2.5 hours of industry-standard 2.7K resolution video sequences, more than 0.5 million frames, and 1.1 million annotated bounding boxes. This makes MAVREC the largest ground and aerial-view dataset, and the fourth largest among all drone-based datasets.
  arXiv  Detail & Related papers  (2023-12-07T18:59:14Z)
• Evidential Detection and Tracking Collaboration: New Problem, Benchmark and Algorithm for Robust Anti-UAV System [56.51247807483176]
  Unmanned Aerial Vehicles (UAVs) have been widely used in many areas, including transportation, surveillance, and military. Previous works have simplified such an anti-UAV task as a tracking problem, where prior information of UAVs is always provided. In this paper, we first formulate a new and practical anti-UAV problem featuring the UAVs perception in complex scenes without prior UAVs information.
  arXiv  Detail & Related papers  (2023-06-27T19:30:23Z)
• E^2VTS: Energy-Efficient Video Text Spotting from Unmanned Aerial Vehicles [78.50123964690094]
  Unmanned Aerial Vehicles (UAVs) based video text spotting has been extensively used in civil and military domains. Our proposed energy-efficient video text spotting solution, dubbed as E2VTS, outperforms all previous methods by achieving a competitive tradeoff between energy efficiency and performance.
  arXiv  Detail & Related papers  (2022-06-05T22:43:17Z)
• 3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning [75.78929539923749]
  Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enhancing the network performance and coverage in wireless communication. It is challenging to obtain an optimal resource allocation scheme for the UAV-assisted Internet of Things (IoT) In this paper, we design a new UAV-assisted IoT systems relying on the shortest flight path of the UAVs while maximising the amount of data collected from IoT devices.
  arXiv  Detail & Related papers  (2021-06-06T14:08:41Z)
• UAV-ReID: A Benchmark on Unmanned Aerial Vehicle Re-identification [21.48667873335246]
  Recent development in deep learning allows vision-based counter-UAV systems to detect and track UAVs with a single camera. The coverage of a single camera is limited, necessitating the need for multicamera configurations to match UAVs across cameras. We propose the first new UAV re-identification data set, UAV-reID, that facilitates the development of machine learning solutions in this emerging area.
  arXiv  Detail & Related papers  (2021-04-13T14:13:09Z)
• Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking [59.06167734555191]
  Unmanned Aerial Vehicle (UAV) offers lots of applications in both commerce and recreation. We consider the task of tracking UAVs, providing rich information such as location and trajectory. We propose a dataset, Anti-UAV, with more than 300 video pairs containing over 580k manually annotated bounding boxes.
  arXiv  Detail & Related papers  (2021-01-21T07:00:15Z)
• Deep Multimodality Learning for UAV Video Aesthetic Quality Assessment [22.277636020333198]
  We present a method of deep multimodality learning for UAV video aesthetic quality assessment. A novel specially designed motion stream network is proposed for this new multistream framework. We present three application examples of UAV video grading, professional segment detection and aesthetic-based UAV path planning.
  arXiv  Detail & Related papers  (2020-11-04T15:37:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.