Mixed X-Ray Image Separation for Artworks with Concealed Designs
- URL: http://arxiv.org/abs/2201.09167v1
- Date: Sun, 23 Jan 2022 03:20:35 GMT
- Title: Mixed X-Ray Image Separation for Artworks with Concealed Designs
- Authors: Wei Pu, Jun-Jie Huang, Barak Sober, Nathan Daly, Catherine Higgitt,
Ingrid Daubechies, Pier Luigi Dragotti, Miguel Rodigues
- Abstract summary: We propose a self-supervised deep learning-based image separation approach that can be applied to the X-ray images from such paintings.
One of these reconstructed images is related to the X-ray image of the concealed painting, while the second one contains only information related to the X-ray of the visible painting.
The proposed method is demonstrated on a real painting with concealed content, Dona Isabel de Porcel by Francisco de Goya, to show its effectiveness.
- Score: 32.83098605051855
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we focus on X-ray images of paintings with concealed
sub-surface designs (e.g., deriving from reuse of the painting support or
revision of a composition by the artist), which include contributions from both
the surface painting and the concealed features. In particular, we propose a
self-supervised deep learning-based image separation approach that can be
applied to the X-ray images from such paintings to separate them into two
hypothetical X-ray images. One of these reconstructed images is related to the
X-ray image of the concealed painting, while the second one contains only
information related to the X-ray of the visible painting. The proposed
separation network consists of two components: the analysis and the synthesis
sub-networks. The analysis sub-network is based on learned coupled iterative
shrinkage thresholding algorithms (LCISTA) designed using algorithm unrolling
techniques, and the synthesis sub-network consists of several linear mappings.
The learning algorithm operates in a totally self-supervised fashion without
requiring a sample set that contains both the mixed X-ray images and the
separated ones. The proposed method is demonstrated on a real painting with
concealed content, Do\~na Isabel de Porcel by Francisco de Goya, to show its
effectiveness.
Related papers
- BGM: Background Mixup for X-ray Prohibited Items Detection [75.58709178012502]
This paper introduces a novel data augmentation approach tailored for prohibited item detection, leveraging unique characteristics inherent to X-ray imagery.
Our method is motivated by observations of physical properties including: 1) X-ray Transmission Imagery: Unlike reflected light images, transmitted X-ray pixels represent composite information from multiple materials along the imaging path.
We propose a simple yet effective X-ray image augmentation technique, Background Mixup (BGM), for prohibited item detection in security screening contexts.
arXiv Detail & Related papers (2024-11-30T12:26:55Z) - Multi-view X-ray Image Synthesis with Multiple Domain Disentanglement from CT Scans [10.72672892416061]
Over-dosed X-rays superimpose potential risks to human health to some extent.
Data-driven algorithms from volume scans to X-ray images are restricted by the scarcity of paired X-ray and volume data.
We propose CT2X-GAN to synthesize the X-ray images in an end-to-end manner using the content and style disentanglement from three different image domains.
arXiv Detail & Related papers (2024-04-18T04:25:56Z) - Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images [60.34381768479834]
Recent advancements in diffusion models have enabled the generation of realistic deepfakes from textual prompts in natural language.
We pioneer a systematic study on deepfake detection generated by state-of-the-art diffusion models.
arXiv Detail & Related papers (2023-04-02T10:25:09Z) - OccluMix: Towards De-Occlusion Virtual Try-on by Semantically-Guided
Mixup [79.3118064406151]
Image Virtual try-on aims at replacing the cloth on a personal image with a garment image (in-shop clothes)
Prior methods successfully preserve the character of clothing images.
Occlusion remains a pernicious effect for realistic virtual try-on.
arXiv Detail & Related papers (2023-01-03T06:29:11Z) - Image Separation with Side Information: A Connected Auto-Encoders Based
Approach [18.18248997032482]
We deal with the problem of separating mixed X-ray images originating from the radiography of double-sided paintings.
We propose a new Neural Network architecture, based upon 'connected' auto-encoders, designed to separate the mixed X-ray image into two simulated X-ray images corresponding to each side.
These tests show that the proposed approach outperforms other state-of-the-art X-ray image separation methods for art investigation applications.
arXiv Detail & Related papers (2020-09-16T18:39:42Z) - A novel approach to remove foreign objects from chest X-ray images [0.0]
In this paper, we use multi-method to tackle both removal and inpainting chest radiographs.
To conclude, we achieved state-of-the-art accuracy.
arXiv Detail & Related papers (2020-08-16T03:06:28Z) - Sketch-Guided Scenery Image Outpainting [83.6612152173028]
We propose an encoder-decoder based network to conduct sketch-guided outpainting.
We apply a holistic alignment module to make the synthesized part be similar to the real one from the global view.
Second, we reversely produce the sketches from the synthesized part and encourage them be consistent with the ground-truth ones.
arXiv Detail & Related papers (2020-06-17T11:34:36Z) - From Perspective X-ray Imaging to Parallax-Robust Orthographic Stitching [47.44626333193997]
In this work, we leverage the Fourier slice theorem to aggregate information from multiple transmission images in parallax-free domains.
The semantics of the stitched image are restored using a novel deep learning strategy that exploits similarity measures designed around frequency.
Our pipeline, not only stitches images, but also provides orthographic reconstruction that enables metric measurements of clinically relevant quantities directly on the 2D image plane.
arXiv Detail & Related papers (2020-03-05T23:16:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.