GridDehazeNet+: An Enhanced Multi-Scale Network with Intra-Task
Knowledge Transfer for Single Image Dehazing
- URL: http://arxiv.org/abs/2103.13998v1
- Date: Thu, 25 Mar 2021 17:35:36 GMT
- Title: GridDehazeNet+: An Enhanced Multi-Scale Network with Intra-Task
Knowledge Transfer for Single Image Dehazing
- Authors: Xiaohong Liu, Zhihao Shi, Zijun Wu, Jun Chen
- Abstract summary: We propose an enhanced multi-scale network, dubbed GridDehazeNet+, for single image dehazing.
It consists of three modules: pre-processing, backbone, and post-processing.
- Score: 12.982905875008214
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose an enhanced multi-scale network, dubbed GridDehazeNet+, for single
image dehazing. It consists of three modules: pre-processing, backbone, and
post-processing. The trainable pre-processing module can generate learned
inputs with better diversity and more pertinent features as compared to those
derived inputs produced by hand-selected pre-processing methods. The backbone
module implements multi-scale estimation with two major enhancements: 1) a
novel grid structure that effectively alleviates the bottleneck issue via dense
connections across different scales; 2) a spatial-channel attention block that
can facilitate adaptive fusion by consolidating dehazing-relevant features. The
post-processing module helps to reduce the artifacts in the final output. To
alleviate domain shift between network training and testing, we convert
synthetic data to so-called translated data with the distribution shaped to
match that of real data. Moreover, to further improve the dehazing performance
in real-world scenarios, we propose a novel intra-task knowledge transfer
mechanism that leverages the distilled knowledge from synthetic data to assist
the learning process on translated data. Experimental results indicate that the
proposed GridDehazeNet+ outperforms the state-of-the-art methods on several
dehazing benchmarks. The proposed dehazing method does not rely on the
atmosphere scattering model, and we provide a possible explanation as to why it
is not necessarily beneficial to take advantage of the dimension reduction
offered by this model, even if only the dehazing results on synthetic images
are concerned.
Related papers
- WiNet: Wavelet-based Incremental Learning for Efficient Medical Image Registration [68.25711405944239]
Deep image registration has demonstrated exceptional accuracy and fast inference.
Recent advances have adopted either multiple cascades or pyramid architectures to estimate dense deformation fields in a coarse-to-fine manner.
We introduce a model-driven WiNet that incrementally estimates scale-wise wavelet coefficients for the displacement/velocity field across various scales.
arXiv Detail & Related papers (2024-07-18T11:51:01Z) - DualFluidNet: an Attention-based Dual-pipeline Network for FLuid Simulation [4.694954114339147]
We propose an innovative approach for 3D fluid simulations utilizing an Attention-based Dual-pipeline Network.
We find a way to achieve a better balance between global fluid control and physical law constraints.
We also propose a new dataset, Tank3D, to further explore the network's ability to handle more complicated scenes.
arXiv Detail & Related papers (2023-12-28T07:37:11Z) - Mutual Information-driven Triple Interaction Network for Efficient Image
Dehazing [54.168567276280505]
We propose a novel Mutual Information-driven Triple interaction Network (MITNet) for image dehazing.
The first stage, named amplitude-guided haze removal, aims to recover the amplitude spectrum of the hazy images for haze removal.
The second stage, named phase-guided structure refined, devotes to learning the transformation and refinement of the phase spectrum.
arXiv Detail & Related papers (2023-08-14T08:23:58Z) - Scale-Semantic Joint Decoupling Network for Image-text Retrieval in
Remote Sensing [23.598273691455503]
We propose a novel Scale-Semantic Joint Decoupling Network (SJDN) for remote sensing image-text retrieval.
Our proposed SSJDN outperforms state-of-the-art approaches in numerical experiments conducted on four benchmark remote sensing datasets.
arXiv Detail & Related papers (2022-12-12T08:02:35Z) - From Synthetic to Real: Image Dehazing Collaborating with Unlabeled Real
Data [58.50411487497146]
We propose a novel image dehazing framework collaborating with unlabeled real data.
First, we develop a disentangled image dehazing network (DID-Net), which disentangles the feature representations into three component maps.
Then a disentangled-consistency mean-teacher network (DMT-Net) is employed to collaborate unlabeled real data for boosting single image dehazing.
arXiv Detail & Related papers (2021-08-06T04:00:28Z) - EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentation [62.210091681352914]
We study multi-sensor fusion for 3D semantic segmentation for many applications, such as autonomous driving and robotics.
In this work, we investigate a collaborative fusion scheme called perception-aware multi-sensor fusion (PMF)
We propose a two-stream network to extract features from the two modalities separately. The extracted features are fused by effective residual-based fusion modules.
arXiv Detail & Related papers (2021-06-21T10:47:26Z) - $P^2$ Net: Augmented Parallel-Pyramid Net for Attention Guided Pose
Estimation [69.25492391672064]
We propose an augmented Parallel-Pyramid Net with feature refinement by dilated bottleneck and attention module.
A parallel-pyramid structure is followed to compensate the information loss introduced by the network.
Our method achieves the best performance on the challenging MSCOCO and MPII datasets.
arXiv Detail & Related papers (2020-10-26T02:10:12Z) - Joint Self-Attention and Scale-Aggregation for Self-Calibrated Deraining
Network [13.628218953897946]
In this paper, we propose an effective algorithm, called JDNet, to solve the single image deraining problem.
By designing the Scale-Aggregation and Self-Attention modules with Self-Calibrated convolution skillfully, the proposed model has better deraining results.
arXiv Detail & Related papers (2020-08-06T17:04:34Z) - Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [92.92572594942071]
We propose a Multi-Scale Boosted Dehazing Network with Dense Feature Fusion based on the U-Net architecture.
We show that the proposed model performs favorably against the state-of-the-art approaches on the benchmark datasets as well as real-world hazy images.
arXiv Detail & Related papers (2020-04-28T09:34:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.