Lightweight Hybrid Video Compression Framework Using Reference-Guided
Restoration Network
- URL: http://arxiv.org/abs/2303.11592v1
- Date: Tue, 21 Mar 2023 04:42:44 GMT
- Title: Lightweight Hybrid Video Compression Framework Using Reference-Guided
Restoration Network
- Authors: Hochang Rhee, Seyun Kim, Nam Ik Cho
- Abstract summary: We propose a new lightweight hybrid video consisting of a conventional video(HEVC / VVC), a lossless image, and our new restoration network.
Our method achieves comparable performance to top-tier methods, even when applied to HEVC.
- Score: 12.033330902093152
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Recent deep-learning-based video compression methods brought coding gains
over conventional codecs such as AVC and HEVC. However, learning-based codecs
generally require considerable computation time and model complexity. In this
paper, we propose a new lightweight hybrid video codec consisting of a
conventional video codec(HEVC / VVC), a lossless image codec, and our new
restoration network. Precisely, our encoder consists of the conventional video
encoder and a lossless image encoder, transmitting a lossy-compressed video
bitstream along with a losslessly-compressed reference frame. The decoder is
constructed with corresponding video/image decoders and a new restoration
network, which enhances the compressed video in two-step processes. In the
first step, a network trained with a large video dataset restores the details
lost by the conventional encoder. Then, we further boost the video quality with
the guidance of a reference image, which is a losslessly compressed video
frame. The reference image provides video-specific information, which can be
utilized to better restore the details of a compressed video. Experimental
results show that the proposed method achieves comparable performance to
top-tier methods, even when applied to HEVC. Nevertheless, our method has lower
complexity, a faster run time, and can be easily integrated into existing
conventional codecs.
Related papers
- When Video Coding Meets Multimodal Large Language Models: A Unified Paradigm for Video Coding [112.44822009714461]
Cross-Modality Video Coding (CMVC) is a pioneering approach to explore multimodality representation and video generative models in video coding.
During decoding, previously encoded components and video generation models are leveraged to create multiple encoding-decoding modes.
Experiments indicate that TT2V achieves effective semantic reconstruction, while IT2V exhibits competitive perceptual consistency.
arXiv Detail & Related papers (2024-08-15T11:36:18Z) - NU-Class Net: A Novel Approach for Video Quality Enhancement [1.7763979745248648]
This paper introduces NU-Class Net, an innovative deep-learning model designed to mitigate compression artifacts stemming from lossy compression codecs.
By employing the NU-Class Net, the video encoder within the video-capturing node can reduce output quality, thereby generating low-bit-rate videos.
Experimental results affirm the efficacy of the proposed model in enhancing the perceptible quality of videos, especially those streamed at low bit rates.
arXiv Detail & Related papers (2024-01-02T11:46:42Z) - Video Compression with Arbitrary Rescaling Network [8.489428003916622]
We propose a rate-guided arbitrary rescaling network (RARN) for video resizing before encoding.
The lightweight RARN structure can process FHD (1080p) content at real-time speed (91 FPS) and obtain a considerable rate reduction.
arXiv Detail & Related papers (2023-06-07T07:15:18Z) - Leveraging Bitstream Metadata for Fast, Accurate, Generalized Compressed
Video Quality Enhancement [74.1052624663082]
We develop a deep learning architecture capable of restoring detail to compressed videos.
We show that this improves restoration accuracy compared to prior compression correction methods.
We condition our model on quantization data which is readily available in the bitstream.
arXiv Detail & Related papers (2022-01-31T18:56:04Z) - Transcoded Video Restoration by Temporal Spatial Auxiliary Network [64.63157339057912]
We propose a new method, temporal spatial auxiliary network (TSAN), for transcoded video restoration.
The experimental results demonstrate that the performance of the proposed method is superior to that of the previous techniques.
arXiv Detail & Related papers (2021-12-15T08:10:23Z) - Perceptual Learned Video Compression with Recurrent Conditional GAN [158.0726042755]
We propose a Perceptual Learned Video Compression (PLVC) approach with recurrent conditional generative adversarial network.
PLVC learns to compress video towards good perceptual quality at low bit-rate.
The user study further validates the outstanding perceptual performance of PLVC in comparison with the latest learned video compression approaches.
arXiv Detail & Related papers (2021-09-07T13:36:57Z) - Variable Rate Video Compression using a Hybrid Recurrent Convolutional
Learning Framework [1.9290392443571382]
This paper presents PredEncoder, a hybrid video compression framework based on the concept of predictive auto-encoding.
A variable-rate block encoding scheme has been proposed in the paper that leads to remarkably high quality to bit-rate ratios.
arXiv Detail & Related papers (2020-04-08T20:49:25Z) - Content Adaptive and Error Propagation Aware Deep Video Compression [110.31693187153084]
We propose a content adaptive and error propagation aware video compression system.
Our method employs a joint training strategy by considering the compression performance of multiple consecutive frames instead of a single frame.
Instead of using the hand-crafted coding modes in the traditional compression systems, we design an online encoder updating scheme in our system.
arXiv Detail & Related papers (2020-03-25T09:04:24Z) - Learning for Video Compression with Hierarchical Quality and Recurrent
Enhancement [164.7489982837475]
We propose a Hierarchical Learned Video Compression (HLVC) method with three hierarchical quality layers and a recurrent enhancement network.
In our HLVC approach, the hierarchical quality benefits the coding efficiency, since the high quality information facilitates the compression and enhancement of low quality frames at encoder and decoder sides.
arXiv Detail & Related papers (2020-03-04T09:31:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.