Inter-Image Pixel Shuffling for Multi-focus Image Fusion

• URL: http://arxiv.org/abs/2603.07120v1
• Date: Sat, 07 Mar 2026 09:11:50 GMT
• Title: Inter-Image Pixel Shuffling for Multi-focus Image Fusion
• Abstract summary: Inter-image Pixel Shuffling (IPS) is a novel method that allows neural networks to learn multi-focus image fusion.<n>IPS significantly outperforms existing multi-focus image fusion methods, even without training on multi-focus images.
• Score: 6.717503707944545
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multi-focus image fusion aims to combine multiple partially focused images into a single all-in-focus image. Although deep learning has shown promise in this task, its effectiveness is often limited by the scarcity of suitable training data. This paper introduces Inter-image Pixel Shuffling (IPS), a novel method that allows neural networks to learn multi-focus image fusion without requiring actual multi-focus images. IPS reformulates the task as a pixel-wise classification problem, where the goal is to identify the focused pixel from a pixel group at each spatial position. In this method, pixels from a clear optical image are treated as focused, while pixels from a low-pass filtered version of the same image are considered defocused. By randomly shuffling the focused and defocused pixels at identical spatial positions in the original and filtered images, IPS generates training data that preserves spatial structure while mixing focus-defocus information. The model is trained to select the focused pixel from each spatially aligned pixel group, thus learning to reconstruct an all-in-focus image by aggregating sharp content from the input. To further enhance fusion quality, IPS adopts a cross-image fusion network that integrates the localized representation power of convolutional neural networks with the long-range modeling capabilities of state space models. This design effectively leverages both spatial detail and contextual information to produce high-quality fused results. Experimental results indicate that IPS significantly outperforms existing multi-focus image fusion methods, even without training on multi-focus images.

Related papers

• Clarity Contrast and Similarity Selection for Multi-Focus Image Fusion [42.88094876202308]
  Multi-focus image fusion (MFIF) aims to generate an all-in-focus image from multiple images of the same scene focused at different regions.<n>This paper presents a novel Clarity Contrast and Similarity Selection Network (CSNet) to bridge direct information exchange for MFIF.
  arXiv  Detail & Related papers  (2026-08-04T07:24:12Z)
• PCIM: Learning Pixel Attributions via Pixel-wise Channel Isolation Mixing in High Content Imaging [1.1866227238721938]
  This work introduces a novel method, Pixel-wise Channel Isolation Mixing ( PCIM), to calculate pixel attribution maps.<n> PCIM treats each pixel as a distinct input channel and trains a blending layer to mix these pixels, reflecting specific classifications.<n>This unique approach allows the generation of pixel attribution maps for each image, but agnostic to the choice of the underlying classification network.
  arXiv  Detail & Related papers  (2024-12-03T08:48:30Z)
• Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localization [4.8454936010479335]
  We propose a Multi-view Pixel-wise Contrastive algorithm (MPC) for image forgery localization. Specifically, we first pre-train the backbone network with the supervised contrastive loss. Then the localization head is fine-tuned using the cross-entropy loss, resulting in a better pixel localizer.
  arXiv  Detail & Related papers  (2024-06-19T13:51:52Z)
• Towards Real-World Focus Stacking with Deep Learning [97.34754533628322]
  We introduce a new dataset consisting of 94 high-resolution bursts of raw images with focus bracketing. This dataset is used to train the first deep learning algorithm for focus stacking capable of handling bursts of sufficient length for real-world applications.
  arXiv  Detail & Related papers  (2023-11-29T17:49:33Z)
• Pixel-Inconsistency Modeling for Image Manipulation Localization [59.968362815126326]
  Digital image forensics plays a crucial role in image authentication and manipulation localization. This paper presents a generalized and robust manipulation localization model through the analysis of pixel inconsistency artifacts. Experiments show that our method successfully extracts inherent pixel-inconsistency forgery fingerprints.
  arXiv  Detail & Related papers  (2023-09-30T02:54:51Z)
• Generation and Recombination for Multifocus Image Fusion with Free Number of Inputs [17.32596568119519]
  Multifocus image fusion is an effective way to overcome the limitation of optical lenses. Previous methods assume that the focused areas of the two source images are complementary, making it impossible to achieve simultaneous fusion of multiple images. In GRFusion, focus property detection of each source image can be implemented independently, enabling simultaneous fusion of multiple source images.
  arXiv  Detail & Related papers  (2023-09-09T01:47:56Z)
• Learning Enriched Features for Fast Image Restoration and Enhancement [166.17296369600774]
  This paper presents a holistic goal of maintaining spatially-precise high-resolution representations through the entire network. We learn an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details. Our approach achieves state-of-the-art results for a variety of image processing tasks, including defocus deblurring, image denoising, super-resolution, and image enhancement.
  arXiv  Detail & Related papers  (2022-04-19T17:59:45Z)
• Single image deep defocus estimation and its applications [82.93345261434943]
  We train a deep neural network to classify image patches into one of the 20 levels of blurriness. The trained model is used to determine the patch blurriness which is then refined by applying an iterative weighted guided filter. The result is a defocus map that carries the information of the degree of blurriness for each pixel.
  arXiv  Detail & Related papers  (2021-07-30T06:18:16Z)
• Real-MFF: A Large Realistic Multi-focus Image Dataset with Ground Truth [58.226535803985804]
  We introduce a large and realistic multi-focus dataset called Real-MFF. The dataset contains 710 pairs of source images with corresponding ground truth images. We evaluate 10 typical multi-focus algorithms on this dataset for the purpose of illustration.
  arXiv  Detail & Related papers  (2020-03-28T12:33:46Z)
• Learning Enriched Features for Real Image Restoration and Enhancement [166.17296369600774]
  convolutional neural networks (CNNs) have achieved dramatic improvements over conventional approaches for image restoration task. We present a novel architecture with the collective goals of maintaining spatially-precise high-resolution representations through the entire network. Our approach learns an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details.
  arXiv  Detail & Related papers  (2020-03-15T11:04:30Z)
• FFusionCGAN: An end-to-end fusion method for few-focus images using conditional GAN in cytopathological digital slides [0.0]
  Multi-focus image fusion technologies compress different focus depth images into an image in which most objects are in focus. This paper proposes a novel method for generating fused images from single-focus or few-focus images based on conditional generative adversarial network (GAN) By integrating the network into the generative model, the quality of the generated fused images is effectively improved.
  arXiv  Detail & Related papers  (2020-01-03T02:13:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.