FVV Live: Real-Time, Low-Cost, Free Viewpoint Video
- URL: http://arxiv.org/abs/2006.16893v1
- Date: Tue, 30 Jun 2020 15:21:53 GMT
- Title: FVV Live: Real-Time, Low-Cost, Free Viewpoint Video
- Authors: Daniel Berj\'on, Pablo Carballeira, Juli\'an Cabrera, Carlos Carmona,
Daniel Corregidor, C\'esar D\'iaz, Francisco Mor\'an, Narciso Garc\'ia
- Abstract summary: FVV Live is a novel real-time, low-latency, end-to-end free viewpoint system.
System has been specially designed for low-cost and real-time operation.
- Score: 1.2752808844888017
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: FVV Live is a novel real-time, low-latency, end-to-end free viewpoint system
including capture, transmission, synthesis on an edge server and visualization
and control on a mobile terminal. The system has been specially designed for
low-cost and real-time operation, only using off-the-shelf components.
Related papers
- DADFNet: Dual Attention and Dual Frequency-Guided Dehazing Network for
Video-Empowered Intelligent Transportation [79.18450119567315]
Adverse weather conditions pose severe challenges for video-based transportation surveillance.
We propose a dual attention and dual frequency-guided dehazing network (termed DADFNet) for real-time visibility enhancement.
arXiv Detail & Related papers (2023-04-19T11:55:30Z) - Neural Residual Radiance Fields for Streamably Free-Viewpoint Videos [69.22032459870242]
We present a novel technique, Residual Radiance Field or ReRF, as a highly compact neural representation to achieve real-time free-view rendering on long-duration dynamic scenes.
We show such a strategy can handle large motions without sacrificing quality.
Based on ReRF, we design a special FVV that achieves three orders of magnitudes compression rate and provides a companion ReRF player to support online streaming of long-duration FVVs of dynamic scenes.
arXiv Detail & Related papers (2023-04-10T08:36:00Z) - Streaming Video Model [90.24390609039335]
We propose to unify video understanding tasks into one streaming video architecture, referred to as Streaming Vision Transformer (S-ViT)
S-ViT first produces frame-level features with a memory-enabled temporally-aware spatial encoder to serve frame-based video tasks.
The efficiency and efficacy of S-ViT is demonstrated by the state-of-the-art accuracy in the sequence-based action recognition.
arXiv Detail & Related papers (2023-03-30T08:51:49Z) - Propagate And Calibrate: Real-time Passive Non-line-of-sight Tracking [84.38335117043907]
We propose a purely passive method to track a person walking in an invisible room by only observing a relay wall.
To excavate imperceptible changes in videos of the relay wall, we introduce difference frames as an essential carrier of temporal-local motion messages.
To evaluate the proposed method, we build and publish the first dynamic passive NLOS tracking dataset, NLOS-Track.
arXiv Detail & Related papers (2023-03-21T12:18:57Z) - You Can Ground Earlier than See: An Effective and Efficient Pipeline for
Temporal Sentence Grounding in Compressed Videos [56.676761067861236]
Given an untrimmed video, temporal sentence grounding aims to locate a target moment semantically according to a sentence query.
Previous respectable works have made decent success, but they only focus on high-level visual features extracted from decoded frames.
We propose a new setting, compressed-domain TSG, which directly utilizes compressed videos rather than fully-decompressed frames as the visual input.
arXiv Detail & Related papers (2023-03-14T12:53:27Z) - WOC: A Handy Webcam-based 3D Online Chatroom [62.43306257598143]
WOC is a webcam-based 3D virtual online chatroom for multi-person interaction.
It captures the 3D motion of users and drives their individual 3D virtual avatars in real-time.
arXiv Detail & Related papers (2022-09-02T01:34:14Z) - A Multi-user Oriented Live Free-viewpoint Video Streaming System Based
On View Interpolation [15.575219833681635]
We introduce a CNN-based view algorithm to synthesis dense virtual views in real time.
We also build an end-to-end live free-viewpoint system with a multi-user oriented streaming strategy.
arXiv Detail & Related papers (2021-12-20T15:17:57Z) - iButter: Neural Interactive Bullet Time Generator for Human
Free-viewpoint Rendering [36.975827955498914]
We propose a neural interactive bullet-time generator (iButter) for photo-realistic human free-viewpoint rendering from dense RGB streams.
During preview, we propose an interactive bullet-time design approach by extending the NeRF rendering to a real-time and dynamic setting.
During refinement, we introduce an efficient trajectory-aware scheme within 20 minutes, achieving photo-realistic bullet-time viewing experience of human activities.
arXiv Detail & Related papers (2021-08-12T07:52:03Z) - FVV Live: A real-time free-viewpoint video system with consumer
electronics hardware [1.1403672224109256]
FVV Live is a novel end-to-end free-viewpoint video system, designed for low cost and real-time operation.
The system has been designed to yield high-quality free-viewpoint video using consumer-grade cameras and hardware.
arXiv Detail & Related papers (2020-07-01T15:40:28Z) - Neuromorphic Eye-in-Hand Visual Servoing [0.9949801888214528]
Event cameras give human-like vision capabilities with low latency and wide dynamic range.
We present a visual servoing method using an event camera and a switching control strategy to explore, reach and grasp.
Experiments prove the effectiveness of the method to track and grasp objects of different shapes without the need for re-tuning.
arXiv Detail & Related papers (2020-04-15T23:57:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.