Asymmetric Bilateral Motion Estimation for Video Frame Interpolation
- URL: http://arxiv.org/abs/2108.06815v1
- Date: Sun, 15 Aug 2021 21:11:35 GMT
- Title: Asymmetric Bilateral Motion Estimation for Video Frame Interpolation
- Authors: Junheum Park, Chul Lee and Chang-Su Kim
- Abstract summary: We propose a novel video frame algorithm based on asymmetric bilateral motion estimation (ABME)
We predict symmetric bilateral motion fields to interpolate an anchor frame.
We estimate asymmetric bilateral motions fields from the anchor frame to the input frames.
Third, we use the asymmetric fields to warp the input frames backward and reconstruct the intermediate frame.
- Score: 50.44508853885882
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose a novel video frame interpolation algorithm based on asymmetric
bilateral motion estimation (ABME), which synthesizes an intermediate frame
between two input frames. First, we predict symmetric bilateral motion fields
to interpolate an anchor frame. Second, we estimate asymmetric bilateral
motions fields from the anchor frame to the input frames. Third, we use the
asymmetric fields to warp the input frames backward and reconstruct the
intermediate frame. Last, to refine the intermediate frame, we develop a new
synthesis network that generates a set of dynamic filters and a residual frame
using local and global information. Experimental results show that the proposed
algorithm achieves excellent performance on various datasets. The source codes
and pretrained models are available at https://github.com/JunHeum/ABME.
Related papers
- Video Frame Interpolation with Densely Queried Bilateral Correlation [52.823751291070906]
Video Frame Interpolation (VFI) aims to synthesize non-existent intermediate frames between existent frames.
Flow-based VFI algorithms estimate intermediate motion fields to warp the existent frames.
We propose Densely Queried Bilateral Correlation (DQBC) that gets rid of the receptive field dependency problem.
arXiv Detail & Related papers (2023-04-26T14:45:09Z) - BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer
for 4K Video Frame Interpolation [38.415806547786744]
A novel 4K video frame interpolator based on bilateral transformer (BiFormer) is proposed in this paper.
Extensive experiments demonstrate that the proposed BiFormer algorithm achieves excellent performance on 4K datasets.
arXiv Detail & Related papers (2023-04-05T04:52:23Z) - A Unified Pyramid Recurrent Network for Video Frame Interpolation [10.859715542859773]
We present UPR-Net, a novel Unified Pyramid Recurrent Network for frame synthesis.
We show that our iterative synthesis strategy can significantly improve the robustness of the frame on large motion cases.
arXiv Detail & Related papers (2022-11-07T11:12:31Z) - Meta-Interpolation: Time-Arbitrary Frame Interpolation via Dual
Meta-Learning [65.85319901760478]
We consider processing different time-steps with adaptively generated convolutional kernels in a unified way with the help of meta-learning.
We develop a dual meta-learned frame framework to synthesize intermediate frames with the guidance of context information and optical flow.
arXiv Detail & Related papers (2022-07-27T17:36:23Z) - TTVFI: Learning Trajectory-Aware Transformer for Video Frame
Interpolation [50.49396123016185]
Video frame (VFI) aims to synthesize an intermediate frame between two consecutive frames.
We propose a novel Trajectory-aware Transformer for Video Frame Interpolation (TTVFI)
Our method outperforms other state-of-the-art methods in four widely-used VFI benchmarks.
arXiv Detail & Related papers (2022-07-19T03:37:49Z) - Enhanced Bi-directional Motion Estimation for Video Frame Interpolation [0.05541644538483946]
We present a novel yet effective algorithm for motion-based video frame estimation.
Our method achieves excellent performance on a broad range of video frame benchmarks.
arXiv Detail & Related papers (2022-06-17T06:08:43Z) - TimeLens: Event-based Video Frame Interpolation [54.28139783383213]
We introduce Time Lens, a novel indicates equal contribution method that leverages the advantages of both synthesis-based and flow-based approaches.
We show an up to 5.21 dB improvement in terms of PSNR over state-of-the-art frame-based and event-based methods.
arXiv Detail & Related papers (2021-06-14T10:33:47Z) - EA-Net: Edge-Aware Network for Flow-based Video Frame Interpolation [101.75999290175412]
We propose to reduce the image blur and get the clear shape of objects by preserving the edges in the interpolated frames.
The proposed Edge-Aware Network (EANet) integrates the edge information into the frame task.
Three edge-aware mechanisms are developed to emphasize the frame edges in estimating flow maps.
arXiv Detail & Related papers (2021-05-17T08:44:34Z) - BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video
Interpolation [42.40306256282872]
Video increases the temporal resolution of a video sequence by synthesizing intermediate frames between two consecutive frames.
We propose a novel deep-learning-based video algorithm based on bilateral motion estimation.
Experimental results show that the proposed algorithm outperforms the state-of-the-art video algorithms on several benchmark datasets.
arXiv Detail & Related papers (2020-07-17T09:07:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.