4K-HAZE: A Dehazing Benchmark with 4K Resolution Hazy and Haze-Free
Images
- URL: http://arxiv.org/abs/2303.15848v1
- Date: Tue, 28 Mar 2023 09:39:29 GMT
- Title: 4K-HAZE: A Dehazing Benchmark with 4K Resolution Hazy and Haze-Free
Images
- Authors: Zhuoran Zheng and Xiuyi Jia
- Abstract summary: We develop a novel method to simulate 4K hazy images from clear images, which first estimates the scene depth, simulates the light rays and object reflectance, then migrates the synthetic images to real domains by using a GAN.
We wrap these synthesized images into a benchmark called the 4K-HAZE dataset.
The most appealing aspect of our approach is the capability to run a 4K image on a single GPU with 24G RAM in real-time (33fps)
- Score: 12.402054374952485
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Currently, mobile and IoT devices are in dire need of a series of methods to
enhance 4K images with limited resource expenditure. The absence of large-scale
4K benchmark datasets hampers progress in this area, especially for dehazing.
The challenges in building ultra-high-definition (UHD) dehazing datasets are
the absence of estimation methods for UHD depth maps, high-quality 4K depth
estimation datasets, and migration strategies for UHD haze images from
synthetic to real domains. To address these problems, we develop a novel
synthetic method to simulate 4K hazy images (including nighttime and daytime
scenes) from clear images, which first estimates the scene depth, simulates the
light rays and object reflectance, then migrates the synthetic images to real
domains by using a GAN, and finally yields the hazy effects on 4K resolution
images. We wrap these synthesized images into a benchmark called the 4K-HAZE
dataset. Specifically, we design the CS-Mixer (an MLP-based model that
integrates \textbf{C}hannel domain and \textbf{S}patial domain) to estimate the
depth map of 4K clear images, the GU-Net to migrate a 4K synthetic image to the
real hazy domain. The most appealing aspect of our approach (depth estimation
and domain migration) is the capability to run a 4K image on a single GPU with
24G RAM in real-time (33fps). Additionally, this work presents an objective
assessment of several state-of-the-art single-image dehazing methods that are
evaluated using the 4K-HAZE dataset. At the end of the paper, we discuss the
limitations of the 4K-HAZE dataset and its social implications.
Related papers
- Enhancing Underwater Imaging with 4-D Light Fields: Dataset and Method [77.80712860663886]
4-D light fields (LFs) enhance underwater imaging plagued by light absorption, scattering, and other challenges.
We propose a progressive framework for underwater 4-D LF image enhancement and depth estimation.
We construct the first 4-D LF-based underwater image dataset for quantitative evaluation and supervised training of learning-based methods.
arXiv Detail & Related papers (2024-08-30T15:06:45Z) - HoloHisto: End-to-end Gigapixel WSI Segmentation with 4K Resolution Sequential Tokenization [21.1691961979094]
In digital pathology, the traditional method for deep learning-based image segmentation typically involves a two-stage process.
We propose the holistic histopathology (HoloHisto) segmentation method to achieve end-to-end segmentation on gigapixel WSIs.
Under the HoloHisto platform, we unveil a random 4K sampler that transcends ultra-high resolution, delivering 31 and 10 times more pixels than standard 2D and 3D patches.
arXiv Detail & Related papers (2024-07-03T17:49:31Z) - 4K4DGen: Panoramic 4D Generation at 4K Resolution [67.98105958108503]
We tackle the challenging task of elevating a single panorama to an immersive 4D experience.
For the first time, we demonstrate the capability to generate omnidirectional dynamic scenes with 360$circ$ views at 4K resolution.
We achieve high-quality Panorama-to-4D generation at a resolution of 4K for the first time.
arXiv Detail & Related papers (2024-06-19T13:11:02Z) - Towards Ultra-High-Definition Image Deraining: A Benchmark and An Efficient Method [42.331058889312466]
This paper contributes the first large-scale UHD image deraining dataset, 4K-Rain13k, that contains 13,000 image pairs at 4K resolution.
We develop an effective and efficient vision-based architecture (UDR-Mixer) to better solve this task.
arXiv Detail & Related papers (2024-05-27T11:45:08Z) - Real-Time 4K Super-Resolution of Compressed AVIF Images. AIS 2024 Challenge Survey [116.29700317843043]
This paper introduces a novel benchmark as part of the AIS 2024 Real-Time Image Super-Resolution Challenge.
It aims to upscale compressed images from 540p to 4K resolution in real-time on commercial GPUs.
We use a diverse test set containing a variety of 4K images ranging from digital art to gaming and photography.
arXiv Detail & Related papers (2024-04-25T10:12:42Z) - UE4-NeRF:Neural Radiance Field for Real-Time Rendering of Large-Scale
Scene [52.21184153832739]
We propose a novel neural rendering system called UE4-NeRF, specifically designed for real-time rendering of large-scale scenes.
Our approach combines with the Unrealization pipeline in Unreal Engine 4 (UE4), achieving real-time rendering of large-scale scenes at 4K resolution with a frame rate of up to 43 FPS.
arXiv Detail & Related papers (2023-10-20T04:01:35Z) - 4K4D: Real-Time 4D View Synthesis at 4K Resolution [86.6582179227016]
This paper targets high-fidelity and real-time view of dynamic 3D scenes at 4K resolution.
We propose a 4D point cloud representation that supports hardwareization and enables unprecedented rendering speed.
Our representation can be rendered at over 400 FPS on the DNA-Rendering dataset at 1080p resolution and 80 FPS on the ENeRF-Outdoor dataset at 4K resolution using an 4090 GPU.
arXiv Detail & Related papers (2023-10-17T17:57:38Z) - Towards Efficient and Scale-Robust Ultra-High-Definition Image
Demoireing [71.62289021118983]
We present an efficient baseline model ESDNet for tackling 4K moire images, wherein we build a semantic-aligned scale-aware module to address the scale variation of moire patterns.
Our approach outperforms state-of-the-art methods by a large margin while being much more lightweight.
arXiv Detail & Related papers (2022-07-20T14:20:52Z) - Single UHD Image Dehazing via Interpretable Pyramid Network [10.00144096602321]
Currently, most single image dehazing models cannot run an ultra-high-resolution (UHD) image with a single GPU in real-time.
We introduce the principle of infinite approximation of Taylor's theorem with the Laplace pyramid pattern to build a model which is capable of handling 4K images in real-time.
arXiv Detail & Related papers (2022-02-17T11:14:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.