Image Separation with Side Information: A Connected Auto-Encoders Based Approach

• URL: http://arxiv.org/abs/2009.07889v1
• Date: Wed, 16 Sep 2020 18:39:42 GMT
• Title: Image Separation with Side Information: A Connected Auto-Encoders Based Approach
• Authors: Wei Pu, Barak Sober, Nathan Daly, Zahra Sabetsarvestani, Catherine Higgitt, Ingrid Daubechies, and Miguel R.D. Rodrigues
• Abstract summary: We deal with the problem of separating mixed X-ray images originating from the radiography of double-sided paintings. We propose a new Neural Network architecture, based upon 'connected' auto-encoders, designed to separate the mixed X-ray image into two simulated X-ray images corresponding to each side. These tests show that the proposed approach outperforms other state-of-the-art X-ray image separation methods for art investigation applications.
• Score: 18.18248997032482
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: X-radiography (X-ray imaging) is a widely used imaging technique in art investigation. It can provide information about the condition of a painting as well as insights into an artist's techniques and working methods, often revealing hidden information invisible to the naked eye. In this paper, we deal with the problem of separating mixed X-ray images originating from the radiography of double-sided paintings. Using the visible color images (RGB images) from each side of the painting, we propose a new Neural Network architecture, based upon 'connected' auto-encoders, designed to separate the mixed X-ray image into two simulated X-ray images corresponding to each side. In this proposed architecture, the convolutional auto encoders extract features from the RGB images. These features are then used to (1) reproduce both of the original RGB images, (2) reconstruct the hypothetical separated X-ray images, and (3) regenerate the mixed X-ray image. The algorithm operates in a totally self-supervised fashion without requiring a sample set that contains both the mixed X-ray images and the separated ones. The methodology was tested on images from the double-sided wing panels of the \textsl{Ghent Altarpiece}, painted in 1432 by the brothers Hubert and Jan van Eyck. These tests show that the proposed approach outperforms other state-of-the-art X-ray image separation methods for art investigation applications.

Related papers

• Quality Enhancement of Radiographic X-ray Images by Interpretable Mapping [0.282736966249181]
  inconsistency in the initial presentation of X-ray images is a common complaint by radiologists. Existing deep-learning-based end-to-end solutions can automatically correct images with promising performances. A novel interpretable mapping method by deep learning is proposed, which automatically enhances the image brightness and contrast globally and locally.
  arXiv  Detail & Related papers  (2025-01-21T16:04:53Z)
• BGM: Background Mixup for X-ray Prohibited Items Detection [75.58709178012502]
  This paper introduces a novel data augmentation approach tailored for prohibited item detection, leveraging unique characteristics inherent to X-ray imagery. Our method is motivated by observations of physical properties including: 1) X-ray Transmission Imagery: Unlike reflected light images, transmitted X-ray pixels represent composite information from multiple materials along the imaging path. We propose a simple yet effective X-ray image augmentation technique, Background Mixup (BGM), for prohibited item detection in security screening contexts.
  arXiv  Detail & Related papers  (2024-11-30T12:26:55Z)
• Coarse-Fine View Attention Alignment-Based GAN for CT Reconstruction from Biplanar X-Rays [22.136553745483305]
  We propose a novel attention-informed coarse-to-fine cross-view fusion method to combine the features extracted from the biplanar views. Experiments have demonstrated the superiority of our proposed method over the SOTA methods.
  arXiv  Detail & Related papers  (2024-08-19T06:57:07Z)
• Multi-view X-ray Image Synthesis with Multiple Domain Disentanglement from CT Scans [10.72672892416061]
  Over-dosed X-rays superimpose potential risks to human health to some extent. Data-driven algorithms from volume scans to X-ray images are restricted by the scarcity of paired X-ray and volume data. We propose CT2X-GAN to synthesize the X-ray images in an end-to-end manner using the content and style disentanglement from three different image domains.
  arXiv  Detail & Related papers  (2024-04-18T04:25:56Z)
• Detecting Recolored Image by Spatial Correlation [60.08643417333974]
  Image recoloring is an emerging editing technique that can manipulate the color values of an image to give it a new style. In this paper, we explore a solution from the perspective of the spatial correlation, which exhibits the generic detection capability for both conventional and deep learning-based recoloring. Our method achieves the state-of-the-art detection accuracy on multiple benchmark datasets and exhibits well generalization for unknown types of recoloring methods.
  arXiv  Detail & Related papers  (2022-04-23T01:54:06Z)
• Enhancement of Novel View Synthesis Using Omnidirectional Image Completion [61.78187618370681]
  We present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) Experiments demonstrated that the proposed method can synthesize plausible novel views while preserving the features of the scene for both artificial and real-world data.
  arXiv  Detail & Related papers  (2022-03-18T13:49:25Z)
• Mixed X-Ray Image Separation for Artworks with Concealed Designs [32.83098605051855]
  We propose a self-supervised deep learning-based image separation approach that can be applied to the X-ray images from such paintings. One of these reconstructed images is related to the X-ray image of the concealed painting, while the second one contains only information related to the X-ray of the visible painting. The proposed method is demonstrated on a real painting with concealed content, Dona Isabel de Porcel by Francisco de Goya, to show its effectiveness.
  arXiv  Detail & Related papers  (2022-01-23T03:20:35Z)
• Cross-Modal Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loop [63.81818077092879]
  We propose an end-to-end semi-supervised cross-modal contrastive learning framework for medical images. We first apply an image encoder to classify the chest X-rays and to generate the image features. The radiomic features are then passed through another dedicated encoder to act as the positive sample for the image features generated from the same chest X-ray.
  arXiv  Detail & Related papers  (2021-04-11T09:16:29Z)
• XraySyn: Realistic View Synthesis From a Single Radiograph Through CT Priors [118.27130593216096]
  A radiograph visualizes the internal anatomy of a patient through the use of X-ray, which projects 3D information onto a 2D plane. To the best of our knowledge, this is the first work on radiograph view synthesis. We show that by gaining an understanding of radiography in 3D space, our method can be applied to radiograph bone extraction and suppression without groundtruth bone labels.
  arXiv  Detail & Related papers  (2020-12-04T05:08:53Z)
• From Perspective X-ray Imaging to Parallax-Robust Orthographic Stitching [47.44626333193997]
  In this work, we leverage the Fourier slice theorem to aggregate information from multiple transmission images in parallax-free domains. The semantics of the stitched image are restored using a novel deep learning strategy that exploits similarity measures designed around frequency. Our pipeline, not only stitches images, but also provides orthographic reconstruction that enables metric measurements of clinically relevant quantities directly on the 2D image plane.
  arXiv  Detail & Related papers  (2020-03-05T23:16:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.