GAMA-IR: Global Additive Multidimensional Averaging for Fast Image Restoration

• URL: http://arxiv.org/abs/2404.00807v1
• Date: Sun, 31 Mar 2024 21:43:08 GMT
• Title: GAMA-IR: Global Additive Multidimensional Averaging for Fast Image Restoration
• Authors: Youssef Mansour, Reinhard Heckel,
• Abstract summary: We introduce an image restoration network that is both fast and yields excellent image quality. The network is designed to minimize the latency and memory consumption when executed on a standard GPU. We exceed the state-of-the-art result on real-world SIDD denoising by 0.11dB, while being 2 to 10 times faster.
• Score: 22.53813258871828
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep learning-based methods have shown remarkable success for various image restoration tasks such as denoising and deblurring. The current state-of-the-art networks are relatively deep and utilize (variants of) self attention mechanisms. Those networks are significantly slower than shallow convolutional networks, which however perform worse. In this paper, we introduce an image restoration network that is both fast and yields excellent image quality. The network is designed to minimize the latency and memory consumption when executed on a standard GPU, while maintaining state-of-the-art performance. The network is a simple shallow network with an efficient block that implements global additive multidimensional averaging operations. This block can capture global information and enable a large receptive field even when used in shallow networks with minimal computational overhead. Through extensive experiments and evaluations on diverse tasks, we demonstrate that our network achieves comparable or even superior results to existing state-of-the-art image restoration networks with less latency. For instance, we exceed the state-of-the-art result on real-world SIDD denoising by 0.11dB, while being 2 to 10 times faster.

Related papers

• Unified-Width Adaptive Dynamic Network for All-In-One Image Restoration [50.81374327480445]
  We introduce a novel concept positing that intricate image degradation can be represented in terms of elementary degradation. We propose the Unified-Width Adaptive Dynamic Network (U-WADN), consisting of two pivotal components: a Width Adaptive Backbone (WAB) and a Width Selector (WS) The proposed U-WADN achieves better performance while simultaneously reducing up to 32.3% of FLOPs and providing approximately 15.7% real-time acceleration.
  arXiv  Detail & Related papers  (2024-01-24T04:25:12Z)
• DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image Enhancement [77.0360085530701]
  Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments. Previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features. Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space.
  arXiv  Detail & Related papers  (2023-12-12T06:07:21Z)
• RDRN: Recursively Defined Residual Network for Image Super-Resolution [58.64907136562178]
  Deep convolutional neural networks (CNNs) have obtained remarkable performance in single image super-resolution. We propose a novel network architecture which utilizes attention blocks efficiently.
  arXiv  Detail & Related papers  (2022-11-17T11:06:29Z)
• Deep Idempotent Network for Efficient Single Image Blind Deblurring [45.52473840749836]
  Single image blind deblurring is highly ill-posed as neither the latent sharp image nor the blur kernel is known. We present a deep idempotent network to achieve improved blind non-uniform deblurring performance with stable re-deblurring. Our proposed network is nearly 6.5X smaller and 6.4X faster than the state-of-the-art while achieving comparable high performance.
  arXiv  Detail & Related papers  (2022-10-13T16:01:21Z)
• Rethinking Performance Gains in Image Dehazing Networks [25.371802581339576]
  We make minimal modifications to popular U-Net to obtain a compact dehazing network. Specifically, we swap out the convolutional blocks in U-Net for residual blocks with the gating mechanism. With a significantly reduced overhead, gUNet is superior to state-of-the-art methods on multiple image dehazing datasets.
  arXiv  Detail & Related papers  (2022-09-23T07:14:48Z)
• Image Superresolution using Scale-Recurrent Dense Network [30.75380029218373]
  Recent advances in the design of convolutional neural network (CNN) have yielded significant improvements in the performance of image super-resolution (SR) We propose a scale recurrent SR architecture built upon units containing series of dense connections within a residual block (Residual Dense Blocks (RDBs)) Our scale recurrent design delivers competitive performance for higher scale factors while being parametrically more efficient as compared to current state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-01-28T09:18:43Z)
• Attention based Broadly Self-guided Network for Low light Image Enhancement [0.0]
  We propose Attention based Broadly self-guided network (ABSGN) for real world low-light image Enhancement. The proposed network is validated by many mainstream benchmark. Additional experimental results show that the proposed network outperforms most of state-of-the-art low-light image Enhancement solutions.
  arXiv  Detail & Related papers  (2021-12-12T13:11:29Z)
• Searching for Controllable Image Restoration Networks [57.23583915884236]
  Existing methods require separate inference through the entire network per each output. We propose a novel framework based on a neural architecture search technique that enables efficient generation of multiple imagery effects.
  arXiv  Detail & Related papers  (2020-12-21T10:08:18Z)
• LCA-Net: Light Convolutional Autoencoder for Image Dehazing [1.433758865948252]
  Image dehazing is a crucial image pre-processing task aimed at removing the incoherent noise generated by haze to improve the visual appeal of the image. Our proposed generic model uses a very light convolutional encoder-decoder network which does not depend on any atmospheric models. This network achieves optimum dehazing performance at a much faster rate, on several standard datasets, comparable to the state-of-the-art methods in terms of image quality.
  arXiv  Detail & Related papers  (2020-08-24T11:20:52Z)
• Neural Sparse Representation for Image Restoration [116.72107034624344]
  Inspired by the robustness and efficiency of sparse coding based image restoration models, we investigate the sparsity of neurons in deep networks. Our method structurally enforces sparsity constraints upon hidden neurons. Experiments show that sparse representation is crucial in deep neural networks for multiple image restoration tasks.
  arXiv  Detail & Related papers  (2020-06-08T05:15:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.