SimHaze: game engine simulated data for real-world dehazing
- URL: http://arxiv.org/abs/2305.16481v1
- Date: Thu, 25 May 2023 21:26:43 GMT
- Title: SimHaze: game engine simulated data for real-world dehazing
- Authors: Zhengyang Lou, Huan Xu, Fangzhou Mu, Yanli Liu, Xiaoyu Zhang, Liang
Shang, Jiang Li, Bochen Guan, Yin Li, Yu Hen Hu
- Abstract summary: We propose an alternative approach for generating paired clean-hazy images by leveraging computer graphics.
Using a modern game engine, our approach renders crisp clean images and their precise depth maps, based on which high-quality hazy images can be synthesized for training dehazing models.
We show that training with SimHaze alone allows the latest dehazing models to achieve significantly better performance in comparison to previous dehazing datasets.
- Score: 31.13013422142817
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep models have demonstrated recent success in single-image dehazing. Most
prior methods consider fully supervised training and learn from paired clean
and hazy images, where a hazy image is synthesized based on a clean image and
its estimated depth map. This paradigm, however, can produce low-quality hazy
images due to inaccurate depth estimation, resulting in poor generalization of
the trained models. In this paper, we explore an alternative approach for
generating paired clean-hazy images by leveraging computer graphics. Using a
modern game engine, our approach renders crisp clean images and their precise
depth maps, based on which high-quality hazy images can be synthesized for
training dehazing models. To this end, we present SimHaze: a new synthetic haze
dataset. More importantly, we show that training with SimHaze alone allows the
latest dehazing models to achieve significantly better performance in
comparison to previous dehazing datasets. Our dataset and code will be made
publicly available.
Related papers
- SynFog: A Photo-realistic Synthetic Fog Dataset based on End-to-end Imaging Simulation for Advancing Real-World Defogging in Autonomous Driving [48.27575423606407]
We introduce an end-to-end simulation pipeline designed to generate photo-realistic foggy images.
We present a new synthetic fog dataset named SynFog, which features both sky light and active lighting conditions.
Experimental results demonstrate that models trained on SynFog exhibit superior performance in visual perception and detection accuracy.
arXiv Detail & Related papers (2024-03-25T18:32:41Z) - Reliable Image Dehazing by NeRF [16.679492999738788]
We present an image dehazing algorithm with high quality, wide application, and no data training or prior needed.
We analyze the defects of the original dehazing model, and propose a new and reliable dehazing reconstruction and dehazing model based on the combination of optical scattering model and computer graphics lighting rendering model.
Based on the new haze model and the images obtained by the cameras, we can reconstruct the three-dimensional space, accurately calculate the objects and haze in the space, and use the transparency relationship of haze to perform accurate haze removal.
arXiv Detail & Related papers (2023-03-16T08:34:03Z) - TexPose: Neural Texture Learning for Self-Supervised 6D Object Pose
Estimation [55.94900327396771]
We introduce neural texture learning for 6D object pose estimation from synthetic data.
We learn to predict realistic texture of objects from real image collections.
We learn pose estimation from pixel-perfect synthetic data.
arXiv Detail & Related papers (2022-12-25T13:36:32Z) - Is synthetic data from generative models ready for image recognition? [69.42645602062024]
We study whether and how synthetic images generated from state-of-the-art text-to-image generation models can be used for image recognition tasks.
We showcase the powerfulness and shortcomings of synthetic data from existing generative models, and propose strategies for better applying synthetic data for recognition tasks.
arXiv Detail & Related papers (2022-10-14T06:54:24Z) - Dual-Scale Single Image Dehazing Via Neural Augmentation [29.019279446792623]
A novel single image dehazing algorithm is introduced by combining model-based and data-driven approaches.
Results indicate that the proposed algorithm can remove haze well from real-world and synthetic hazy images.
arXiv Detail & Related papers (2022-09-13T11:56:03Z) - A Shared Representation for Photorealistic Driving Simulators [83.5985178314263]
We propose to improve the quality of generated images by rethinking the discriminator architecture.
The focus is on the class of problems where images are generated given semantic inputs, such as scene segmentation maps or human body poses.
We aim to learn a shared latent representation that encodes enough information to jointly do semantic segmentation, content reconstruction, along with a coarse-to-fine grained adversarial reasoning.
arXiv Detail & Related papers (2021-12-09T18:59:21Z) - Model-Based Single Image Deep Dehazing [20.39952114471173]
A novel single image dehazing algorithm is introduced by fusing model-based and data-driven approaches.
Experimental results indicate that the proposed algorithm can remove haze well from real-world and synthetic hazy images.
arXiv Detail & Related papers (2021-11-22T01:57:51Z) - Unsupervised Neural Rendering for Image Hazing [31.108654945661705]
Image hazing aims to render a hazy image from a given clean one, which could be applied to a variety of practical applications such as gaming, filming, photographic filtering, and image dehazing.
We propose a neural rendering method for image hazing, dubbed as HazeGEN. To be specific, HazeGEN is a knowledge-driven neural network which estimates the transmission map by leveraging a new prior.
To adaptively learn the airlight, we build a neural module based on another new prior, i.e., the rendered hazy image and the exemplar are similar in the airlight distribution.
arXiv Detail & Related papers (2021-07-14T13:15:14Z) - Advanced Multiple Linear Regression Based Dark Channel Prior Applied on
Dehazing Image and Generating Synthetic Haze [0.6875312133832078]
Authors propose a multiple linear regression haze removal model based on a widely adopted dehazing algorithm named Dark Channel Prior.
To increase object detection accuracy in the hazy environment, the authors present an algorithm to build a synthetic hazy COCO training dataset.
arXiv Detail & Related papers (2021-03-12T03:32:08Z) - Intrinsic Autoencoders for Joint Neural Rendering and Intrinsic Image
Decomposition [67.9464567157846]
We propose an autoencoder for joint generation of realistic images from synthetic 3D models while simultaneously decomposing real images into their intrinsic shape and appearance properties.
Our experiments confirm that a joint treatment of rendering and decomposition is indeed beneficial and that our approach outperforms state-of-the-art image-to-image translation baselines both qualitatively and quantitatively.
arXiv Detail & Related papers (2020-06-29T12:53:58Z) - Two-shot Spatially-varying BRDF and Shape Estimation [89.29020624201708]
We propose a novel deep learning architecture with a stage-wise estimation of shape and SVBRDF.
We create a large-scale synthetic training dataset with domain-randomized geometry and realistic materials.
Experiments on both synthetic and real-world datasets show that our network trained on a synthetic dataset can generalize well to real-world images.
arXiv Detail & Related papers (2020-04-01T12:56:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.