Towards Ultra-High-Definition Image Deraining: A Benchmark and An Efficient Method

• URL: http://arxiv.org/abs/2405.17074v1
• Date: Mon, 27 May 2024 11:45:08 GMT
• Title: Towards Ultra-High-Definition Image Deraining: A Benchmark and An Efficient Method
• Authors: Hongming Chen, Xiang Chen, Chen Wu, Zhuoran Zheng, Jinshan Pan, Xianping Fu,
• Abstract summary: This paper contributes the first large-scale UHD image deraining dataset, 4K-Rain13k, that contains 13,000 image pairs at 4K resolution. We develop an effective and efficient vision-based architecture (UDR-Mixer) to better solve this task.
• Score: 42.331058889312466
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite significant progress has been made in image deraining, existing approaches are mostly carried out on low-resolution images. The effectiveness of these methods on high-resolution images is still unknown, especially for ultra-high-definition (UHD) images, given the continuous advancement of imaging devices. In this paper, we focus on the task of UHD image deraining, and contribute the first large-scale UHD image deraining dataset, 4K-Rain13k, that contains 13,000 image pairs at 4K resolution. Based on this dataset, we conduct a benchmark study on existing methods for processing UHD images. Furthermore, we develop an effective and efficient vision MLP-based architecture (UDR-Mixer) to better solve this task. Specifically, our method contains two building components: a spatial feature rearrangement layer that captures long-range information of UHD images, and a frequency feature modulation layer that facilitates high-quality UHD image reconstruction. Extensive experimental results demonstrate that our method performs favorably against the state-of-the-art approaches while maintaining a lower model complexity. The code and dataset will be available at https://github.com/cschenxiang/UDR-Mixer.

Related papers

• Assessing UHD Image Quality from Aesthetics, Distortions, and Saliency [51.36674160287799]
  We design a multi-branch deep neural network (DNN) to assess the quality of UHD images from three perspectives. aesthetic features are extracted from low-resolution images downsampled from the UHD ones. Technical distortions are measured using a fragment image composed of mini-patches cropped from UHD images. The salient content of UHD images is detected and cropped to extract quality-aware features from the salient regions.
  arXiv  Detail & Related papers  (2024-09-01T15:26:11Z)
• Generating Content for HDR Deghosting from Frequency View [56.103761824603644]
  Recent Diffusion Models (DMs) have been introduced in HDR imaging field. DMs require extensive iterations with large models to estimate entire images. We propose the Low-Frequency aware Diffusion (LF-Diff) model for ghost-free HDR imaging.
  arXiv  Detail & Related papers  (2024-04-01T01:32:11Z)
• Recurrent Multi-scale Transformer for High-Resolution Salient Object Detection [68.65338791283298]
  Salient Object Detection (SOD) aims to identify and segment the most conspicuous objects in an image or video. Traditional SOD methods are largely limited to low-resolution images, making them difficult to adapt to the development of High-Resolution SOD. In this work, we first propose a new HRS10K dataset, which contains 10,500 high-quality annotated images at 2K-8K resolution.
  arXiv  Detail & Related papers  (2023-08-07T17:49:04Z)
• Benchmarking Ultra-High-Definition Image Reflection Removal [43.34342640578687]
  We propose a transformer-based architecture named RRFormer for reflection removal. We show that RRFormer achieves state-of-the-art performance on both the non-UHD dataset and our proposed UHDRR datasets.
  arXiv  Detail & Related papers  (2023-08-01T03:56:50Z)
• Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement [78.67036949708795]
  Ultra-High-Definition (UHD) photo has gradually become the standard configuration in advanced imaging devices. We propose a new solution, UHDFour, that embeds Fourier transform into a cascaded network. We also contribute the first real UHD LLIE dataset, textbfUHD-LL, that contains 2,150 low-noise/normal-clear 4K image pairs.
  arXiv  Detail & Related papers  (2023-02-23T07:43:41Z)
• Deep Progressive Feature Aggregation Network for High Dynamic Range Imaging [24.94466716276423]
  We propose a deep progressive feature aggregation network for improving HDR imaging quality in dynamic scenes. Our method implicitly samples high-correspondence features and aggregates them in a coarse-to-fine manner for alignment. Experiments show that our proposed method can achieve state-of-the-art performance under different scenes.
  arXiv  Detail & Related papers  (2022-08-04T04:37:35Z)
• Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireing [71.62289021118983]
  We present an efficient baseline model ESDNet for tackling 4K moire images, wherein we build a semantic-aligned scale-aware module to address the scale variation of moire patterns. Our approach outperforms state-of-the-art methods by a large margin while being much more lightweight.
  arXiv  Detail & Related papers  (2022-07-20T14:20:52Z)
• Progressive and Selective Fusion Network for High Dynamic Range Imaging [28.639647755164916]
  This paper considers the problem of generating an HDR image of a scene from its LDR images. Recent studies employ deep learning and solve the problem in an end-to-end fashion, leading to significant performance improvements. We propose a novel method that can better fuse the features based on two ideas. One is multi-step feature fusion; our network gradually fuses the features in a stack of blocks having the same structure.
  arXiv  Detail & Related papers  (2021-08-19T09:42:03Z)
• HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Dataset [30.249052175655606]
  We introduce a coarse-to-fine deep learning framework for HDR video reconstruction. Firstly, we perform coarse alignment and pixel blending in the image space to estimate the coarse HDR video. Secondly, we conduct more sophisticated alignment and temporal fusion in the feature space of the coarse HDR video to produce better reconstruction.
  arXiv  Detail & Related papers  (2021-03-27T16:40:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.