Time-Travel Rephotography
- URL: http://arxiv.org/abs/2012.12261v1
- Date: Tue, 22 Dec 2020 18:59:12 GMT
- Title: Time-Travel Rephotography
- Authors: Xuan Luo, Xuaner Zhang, Paul Yoo, Ricardo Martin-Brualla, Jason
Lawrence, Steven M. Seitz
- Abstract summary: This paper simulates traveling back in time with a modern camera to rephotograph famous subjects.
Unlike conventional image restoration filters which apply independent operations like denoising, colorization, and superresolution, we leverage the StyleGAN2 framework to project old photos into the space of modern high-resolution photos.
- Score: 18.27081887716396
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Many historical people are captured only in old, faded, black and white
photos, that have been distorted by the limitations of early cameras and the
passage of time. This paper simulates traveling back in time with a modern
camera to rephotograph famous subjects. Unlike conventional image restoration
filters which apply independent operations like denoising, colorization, and
superresolution, we leverage the StyleGAN2 framework to project old photos into
the space of modern high-resolution photos, achieving all of these effects in a
unified framework. A unique challenge with this approach is capturing the
identity and pose of the photo's subject and not the many artifacts in
low-quality antique photos. Our comparisons to current state-of-the-art
restoration filters show significant improvements and compelling results for a
variety of important historical people.
Related papers
- Preserving Old Memories in Vivid Detail: Human-Interactive Photo Restoration Framework [19.213916633152625]
Photo restoration can improve the quality of outcomes, but it often comes at a high price in terms of cost and time for restoration.
We present the AI-based photo restoration framework composed of multiple stages, where each stage is tailored to enhance and restore specific types of photo damage.
We present a novel old photo restoration dataset because we lack a publicly available dataset for our evaluation.
arXiv Detail & Related papers (2024-10-12T13:23:08Z) - Exposure Bracketing is All You Need for Unifying Image Restoration and Enhancement Tasks [50.822601495422916]
We propose to utilize exposure bracketing photography to unify image restoration and enhancement tasks.
Due to the difficulty in collecting real-world pairs, we suggest a solution that first pre-trains the model with synthetic paired data.
In particular, a temporally modulated recurrent network (TMRNet) and self-supervised adaptation method are proposed.
arXiv Detail & Related papers (2024-01-01T14:14:35Z) - Coloring the Past: Neural Historical Buildings Reconstruction from
Archival Photography [69.93897305312574]
We introduce an approach to reconstruct the geometry of historical buildings, employing volumetric rendering techniques.
We leverage dense point clouds as a geometric prior and introduce a color appearance embedding loss to recover the color of the building given limited available color images.
arXiv Detail & Related papers (2023-11-29T16:59:45Z) - Perceptual Image Enhancement for Smartphone Real-Time Applications [60.45737626529091]
We propose LPIENet, a lightweight network for perceptual image enhancement.
Our model can deal with noise artifacts, diffraction artifacts, blur, and HDR overexposure.
Our model can process 2K resolution images under 1 second in mid-level commercial smartphones.
arXiv Detail & Related papers (2022-10-24T19:16:33Z) - High Dynamic Range and Super-Resolution from Raw Image Bursts [52.341483902624006]
This paper introduces the first approach to reconstruct high-resolution, high-dynamic range color images from raw photographic bursts captured by a handheld camera with exposure bracketing.
The proposed algorithm is fast, with low memory requirements compared to state-of-the-art learning-based approaches to image restoration.
Experiments demonstrate its excellent performance with super-resolution factors of up to $times 4$ on real photographs taken in the wild with hand-held cameras.
arXiv Detail & Related papers (2022-07-29T13:31:28Z) - Pik-Fix: Restoring and Colorizing Old Photo [24.366910102387344]
Restoring and inpainting the visual memories that are present, but often impaired, in old photos remains an intriguing but unsolved research topic.
Deep learning presents a plausible avenue, but the lack of large-scale datasets of old photos makes addressing this restoration task very challenging.
Here we present a novel reference-based end-to-end learning framework that is able to both repair and colorize old and degraded pictures.
arXiv Detail & Related papers (2022-05-04T05:46:43Z) - ROMNet: Renovate the Old Memories [25.41639794384076]
We present a novel reference-based end-to-end learning framework that can jointly repair and colorize degraded legacy pictures.
We also create, to our knowledge, the first public and real-world old photo dataset with paired ground truth for evaluating old photo restoration models.
arXiv Detail & Related papers (2022-02-05T17:48:15Z) - Aliasing is your Ally: End-to-End Super-Resolution from Raw Image Bursts [70.80220990106467]
This presentation addresses the problem of reconstructing a high-resolution image from multiple lower-resolution snapshots captured from slightly different viewpoints in space and time.
Key challenges for solving this problem include (i) aligning the input pictures with sub-pixel accuracy, (ii) handling raw (noisy) images for maximal faithfulness to native camera data, and (iii) designing/learning an image prior (regularizer) well suited to the task.
arXiv Detail & Related papers (2021-04-13T13:39:43Z) - A leak in PRNU based source identification. Questioning fingerprint
uniqueness [75.33542585238497]
Photo Response Non-Uniformity (PRNU) is considered the most effective trace for the image source attribution task.
Recent devices may introduce non-unique artifacts that may reduce PRNU noise's distinctiveness.
We show that the primary cause of high false alarm rates cannot be directly related to specific camera models, firmware, or image contents.
arXiv Detail & Related papers (2020-09-10T14:18:38Z) - High Resolution Face Age Editing [5.809784853115826]
adversarial training has produced some of the most visually impressive results for image manipulation.
We present an encoder-decoder architecture for face age editing.
arXiv Detail & Related papers (2020-05-09T09:59:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.