Strong and Controllable Blind Image Decomposition

• URL: http://arxiv.org/abs/2403.10520v1
• Date: Fri, 15 Mar 2024 17:59:44 GMT
• Title: Strong and Controllable Blind Image Decomposition
• Authors: Zeyu Zhang, Junlin Han, Chenhui Gou, Hongdong Li, Liang Zheng,
• Abstract summary: Blind image decomposition aims to decompose all components present in an image. Users might want to retain certain degradations, such as watermarks, for copyright protection. We design an architecture named controllable blind image decomposition network.
• Score: 57.682079186903195
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Blind image decomposition aims to decompose all components present in an image, typically used to restore a multi-degraded input image. While fully recovering the clean image is appealing, in some scenarios, users might want to retain certain degradations, such as watermarks, for copyright protection. To address this need, we add controllability to the blind image decomposition process, allowing users to enter which types of degradation to remove or retain. We design an architecture named controllable blind image decomposition network. Inserted in the middle of U-Net structure, our method first decomposes the input feature maps and then recombines them according to user instructions. Advantageously, this functionality is implemented at minimal computational cost: decomposition and recombination are all parameter-free. Experimentally, our system excels in blind image decomposition tasks and can outputs partially or fully restored images that well reflect user intentions. Furthermore, we evaluate and configure different options for the network structure and loss functions. This, combined with the proposed decomposition-and-recombination method, yields an efficient and competitive system for blind image decomposition, compared with current state-of-the-art methods.

Related papers

• OneRestore: A Universal Restoration Framework for Composite Degradation [33.556183375565034]
  In real-world scenarios, image impairments often manifest as composite degradations, presenting a complex interplay of elements such as low light, haze, rain, and snow. Our study proposes a versatile imaging model that consolidates four physical corruption paradigms to accurately represent complex, composite degradation scenarios. OneRestore is a novel transformer-based framework designed for adaptive, controllable scene restoration.
  arXiv  Detail & Related papers  (2024-07-05T16:27:00Z)
• Unified-Width Adaptive Dynamic Network for All-In-One Image Restoration [50.81374327480445]
  We introduce a novel concept positing that intricate image degradation can be represented in terms of elementary degradation. We propose the Unified-Width Adaptive Dynamic Network (U-WADN), consisting of two pivotal components: a Width Adaptive Backbone (WAB) and a Width Selector (WS) The proposed U-WADN achieves better performance while simultaneously reducing up to 32.3% of FLOPs and providing approximately 15.7% real-time acceleration.
  arXiv  Detail & Related papers  (2024-01-24T04:25:12Z)
• Prompt-based Ingredient-Oriented All-in-One Image Restoration [0.0]
  We propose a novel data ingredient-oriented approach to tackle multiple image degradation tasks. Specifically, we utilize a encoder to capture features and introduce prompts with degradation-specific information to guide the decoder. Our method performs competitively to the state-of-the-art.
  arXiv  Detail & Related papers  (2023-09-06T15:05:04Z)
• All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representation [47.00239809958627]
  We propose a novel All-in-one Multi-degradation Image Restoration Network (AMIRNet) AMIRNet learns a degradation representation for unknown degraded images by progressively constructing a tree structure through clustering. This tree-structured representation explicitly reflects the consistency and discrepancy of various distortions, providing a specific clue for image restoration.
  arXiv  Detail & Related papers  (2023-08-06T04:51:41Z)
• Bridging Component Learning with Degradation Modelling for Blind Image Super-Resolution [69.11604249813304]
  We propose a components decomposition and co-optimization network (CDCN) for blind SR. CDCN decomposes the input LR image into structure and detail components in feature space. We present a degradation-driven learning strategy to jointly supervise the HR image detail and structure restoration process.
  arXiv  Detail & Related papers  (2022-12-03T14:53:56Z)
• Discriminative feature encoding for intrinsic image decomposition [16.77439691640257]
  Intrinsic image decomposition is an important and long-standing computer vision problem. This work takes advantage of deep learning, and shows that it can solve this challenging computer vision problem with high efficiency.
  arXiv  Detail & Related papers  (2022-09-25T05:51:49Z)
• RestoreDet: Degradation Equivariant Representation for Object Detection in Low Resolution Images [81.91416537019835]
  We propose a novel framework, RestoreDet, to detect objects in degraded low resolution images. Our framework based on CenterNet has achieved superior performance compared with existing methods when facing variant degradation situations.
  arXiv  Detail & Related papers  (2022-01-07T03:40:23Z)
• Blind Image Decomposition [53.760745569495825]
  We present Blind Image Decomposition (BID), which requires separating a superimposed image into constituent underlying images in a blind setting. How to decompose superimposed images, like rainy images, into distinct source components is a crucial step towards real-world vision systems. We propose a simple yet general Blind Image Decomposition Network (BIDeN) to serve as a strong baseline for future work.
  arXiv  Detail & Related papers  (2021-08-25T17:37:19Z)
• Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
  We propose a dual-branch convolutional neural network to extract base features and recovered features separately. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
  arXiv  Detail & Related papers  (2020-03-02T13:28:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.