Image Restoration for Under-Display Camera
- URL: http://arxiv.org/abs/2003.04857v2
- Date: Sun, 14 Mar 2021 07:54:43 GMT
- Title: Image Restoration for Under-Display Camera
- Authors: Yuqian Zhou, David Ren, Neil Emerton, Sehoon Lim, Timothy Large
- Abstract summary: The new trend of full-screen devices encourages us to position a camera behind a screen.
Removing the bezel and centralizing the camera under the screen brings larger display-to-body ratio and enhances eye contact in video chat, but also causes image degradation.
In this paper, we focus on a newly-defined Under-Display Camera (UDC), as a novel real-world single image restoration problem.
- Score: 14.209602483950322
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The new trend of full-screen devices encourages us to position a camera
behind a screen. Removing the bezel and centralizing the camera under the
screen brings larger display-to-body ratio and enhances eye contact in video
chat, but also causes image degradation. In this paper, we focus on a
newly-defined Under-Display Camera (UDC), as a novel real-world single image
restoration problem. First, we take a 4k Transparent OLED (T-OLED) and a phone
Pentile OLED (P-OLED) and analyze their optical systems to understand the
degradation. Second, we design a Monitor-Camera Imaging System (MCIS) for
easier real pair data acquisition, and a model-based data synthesizing pipeline
to generate Point Spread Function (PSF) and UDC data only from display pattern
and camera measurements. Finally, we resolve the complicated degradation using
deconvolution-based pipeline and learning-based methods. Our model demonstrates
a real-time high-quality restoration. The presented methods and results reveal
the promising research values and directions of UDC.
Related papers
- Segmentation Guided Sparse Transformer for Under-Display Camera Image
Restoration [91.65248635837145]
Under-Display Camera (UDC) is an emerging technology that achieves full-screen display via hiding the camera under the display panel.
In this paper, we observe that when using the Vision Transformer for UDC degraded image restoration, the global attention samples a large amount of redundant information and noise.
We propose a Guided Sparse Transformer method (SGSFormer) for the task of restoring high-quality images from UDC degraded images.
arXiv Detail & Related papers (2024-03-09T13:11:59Z) - Decoupling Degradations with Recurrent Network for Video Restoration in
Under-Display Camera [24.330832680171]
Under-display camera (UDC) systems are the foundation of full-screen display devices in which the lens mounts under the display.
We introduce a novel video restoration network, called D$2$RNet, specifically designed for UDC systems.
It employs a set of Decoupling Attention Modules (DAM) that effectively separate the various video degradation factors.
arXiv Detail & Related papers (2024-03-08T20:21:45Z) - Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarks [55.81577205593956]
Event cameras are bio-inspired sensors that capture the per-pixel intensity changes asynchronously.
Deep learning (DL) has been brought to this emerging field and inspired active research endeavors in mining its potential.
arXiv Detail & Related papers (2023-02-17T14:19:28Z) - Real-Time Under-Display Cameras Image Restoration and HDR on Mobile
Devices [81.61356052916855]
The images captured by under-display cameras (UDCs) are degraded by the screen in front of them.
Deep learning methods for image restoration can significantly reduce the degradation of captured images.
We propose a lightweight model for blind UDC Image Restoration and HDR, and we also provide a benchmark comparing the performance and runtime of different methods on smartphones.
arXiv Detail & Related papers (2022-11-25T11:46:57Z) - Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic
Skip Connection Network [80.67717076541956]
Under-Display Camera (UDC) systems provide a true bezel-less and notch-free viewing experience on smartphones.
In a typical UDC system, the pixel array attenuates and diffracts the incident light on the camera, resulting in significant image quality degradation.
In this work, we aim to analyze and tackle the aforementioned degradation problems.
arXiv Detail & Related papers (2021-04-19T18:41:45Z) - Exploiting Raw Images for Real-Scene Super-Resolution [105.18021110372133]
We study the problem of real-scene single image super-resolution to bridge the gap between synthetic data and real captured images.
We propose a method to generate more realistic training data by mimicking the imaging process of digital cameras.
We also develop a two-branch convolutional neural network to exploit the radiance information originally-recorded in raw images.
arXiv Detail & Related papers (2021-02-02T16:10:15Z) - Transform Domain Pyramidal Dilated Convolution Networks For Restoration
of Under Display Camera Images [6.731863717520707]
Under-display camera (UDC) is a novel technology that can make digital imaging experience in handheld devices seamless.
UDC images are severely degraded owing to their positioning under a display screen.
This work addresses the restoration of images degraded as a result of UDC imaging.
arXiv Detail & Related papers (2020-09-20T09:26:10Z) - UDC 2020 Challenge on Image Restoration of Under-Display Camera: Methods
and Results [62.93508251552535]
This paper is the report of the first Under-Display Camera (UDC) image restoration challenge in conjunction with the RLQ workshop at ECCV 2020.
The challenge is based on a newly-collected database of Under-Display Camera.
Along with about 150 teams registered the challenge, eight and nine teams submitted the results during the testing phase for each track.
arXiv Detail & Related papers (2020-08-18T04:48:39Z) - Deep Atrous Guided Filter for Image Restoration in Under Display Cameras [18.6418313982586]
Under Display Cameras present a promising opportunity for phone manufacturers to achieve bezel-free displays by positioning the camera behind semi-transparent OLED screens.
Such imaging systems suffer from severe image degradation due to light attenuation and diffraction effects.
We present Deep Atrous Guided Filter (DAGF), a two-stage, end-to-end approach for image restoration in UDC systems.
arXiv Detail & Related papers (2020-08-14T07:54:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.