Degradation-invariant Enhancement of Fundus Images via Pyramid
Constraint Network
- URL: http://arxiv.org/abs/2210.09606v1
- Date: Tue, 18 Oct 2022 05:45:13 GMT
- Title: Degradation-invariant Enhancement of Fundus Images via Pyramid
Constraint Network
- Authors: Haofeng Liu, Heng Li, Huazhu Fu, Ruoxiu Xiao, Yunshu Gao, Yan Hu,
Jiang Liu
- Abstract summary: This paper proposes the pyramid constraint to develop a degradation-invariant enhancement network (PCE-Net)
High-quality images are randomly degraded to form sequences of low-quality ones sharing the same content (SeqLCs)
Then individual low-quality images are decomposed to Laplacian pyramid features (LPF) as the multi-level input for the enhancement.
- Score: 27.374391253266428
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: As an economical and efficient fundus imaging modality, retinal fundus images
have been widely adopted in clinical fundus examination. Unfortunately, fundus
images often suffer from quality degradation caused by imaging interferences,
leading to misdiagnosis. Despite impressive enhancement performances that
state-of-the-art methods have achieved, challenges remain in clinical
scenarios. For boosting the clinical deployment of fundus image enhancement,
this paper proposes the pyramid constraint to develop a degradation-invariant
enhancement network (PCE-Net), which mitigates the demand for clinical data and
stably enhances unknown data. Firstly, high-quality images are randomly
degraded to form sequences of low-quality ones sharing the same content
(SeqLCs). Then individual low-quality images are decomposed to Laplacian
pyramid features (LPF) as the multi-level input for the enhancement.
Subsequently, a feature pyramid constraint (FPC) for the sequence is introduced
to enforce the PCE-Net to learn a degradation-invariant model. Extensive
experiments have been conducted under the evaluation metrics of enhancement and
segmentation. The effectiveness of the PCE-Net was demonstrated in comparison
with state-of-the-art methods and the ablation study. The source code of this
study is publicly available at
https://github.com/HeverLaw/PCENet-Image-Enhancement.
Related papers
- CriDiff: Criss-cross Injection Diffusion Framework via Generative Pre-train for Prostate Segmentation [60.61972883059688]
CriDiff is a two-stage feature injecting framework with a Crisscross Injection Strategy (CIS) and a Generative Pre-train (GP) approach for prostate segmentation.
To effectively learn multi-level of edge features and non-edge features, we proposed two parallel conditioners in the CIS.
The GP approach eases the inconsistency between the images features and the diffusion model without adding additional parameters.
arXiv Detail & Related papers (2024-06-20T10:46:50Z) - Semantic Ensemble Loss and Latent Refinement for High-Fidelity Neural Image Compression [58.618625678054826]
This study presents an enhanced neural compression method designed for optimal visual fidelity.
We have trained our model with a sophisticated semantic ensemble loss, integrating Charbonnier loss, perceptual loss, style loss, and a non-binary adversarial loss.
Our empirical findings demonstrate that this approach significantly improves the statistical fidelity of neural image compression.
arXiv Detail & Related papers (2024-01-25T08:11:27Z) - A Practical Framework for Unsupervised Structure Preservation Medical
Image Enhancement [9.453554184019108]
In practice, low-quality (LQ) medical images, such as images that are hazy/blurry, are often obtained during data acquisition.
Several generative adversarial networks (GAN)-based image enhancement methods have been proposed and have shown promising results.
We propose a framework for practical unsupervised medical image enhancement that includes a non-reference objective evaluation of structure preservation.
arXiv Detail & Related papers (2023-04-04T15:13:44Z) - OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation
Meets Regularization by Enhancing [4.951748109810726]
Optimal retinal image quality is mandated for accurate medical diagnoses and automated analyses.
We propose an unpaired image-to-image translation scheme for mapping low-quality retinal CFPs to high-quality counterparts.
We validated the integrated framework, OTRE, on three publicly available retinal image datasets.
arXiv Detail & Related papers (2023-02-06T18:39:40Z) - Retinal Image Restoration and Vessel Segmentation using Modified
Cycle-CBAM and CBAM-UNet [0.7868449549351486]
A cycle-consistent generative adversarial network (CycleGAN) with a convolution block attention module (CBAM) is used for retinal image restoration.
A modified UNet is used for retinal vessel segmentation for the restored retinal images.
The proposed method can significantly reduce the degradation effects caused by out-of-focus blurring, color distortion, low, high, and uneven illumination.
arXiv Detail & Related papers (2022-09-09T10:47:20Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - RFormer: Transformer-based Generative Adversarial Network for Real
Fundus Image Restoration on A New Clinical Benchmark [8.109057397954537]
Ophthalmologists have used fundus images to screen and diagnose eye diseases.
Low-quality (LQ) degraded fundus images easily lead to uncertainty in clinical screening and generally increase the risk of misdiagnosis.
We propose a novel Transformer-based Generative Adversarial Network (RFormer) to restore the real degradation of clinical fundus images.
arXiv Detail & Related papers (2022-01-03T03:56:58Z) - Deep AUC Maximization for Medical Image Classification: Challenges and
Opportunities [60.079782224958414]
We will present and discuss opportunities and challenges brought by a new deep learning method by AUC (aka underlinebf Deep underlinebf AUC classification)
arXiv Detail & Related papers (2021-11-01T15:31:32Z) - Automated Prostate Cancer Diagnosis Based on Gleason Grading Using
Convolutional Neural Network [12.161266795282915]
We propose a convolutional neural network (CNN)-based automatic classification method for accurate grading of prostate cancer (PCa) using whole slide histopathology images.
A data augmentation method named Patch-Based Image Reconstruction (PBIR) was proposed to reduce the high resolution and increase the diversity of WSIs.
A distribution correction module was developed to enhance the adaption of pretrained model to the target dataset.
arXiv Detail & Related papers (2020-11-29T06:42:08Z) - The Power of Triply Complementary Priors for Image Compressive Sensing [89.14144796591685]
We propose a joint low-rank deep (LRD) image model, which contains a pair of complementaryly trip priors.
We then propose a novel hybrid plug-and-play framework based on the LRD model for image CS.
To make the optimization tractable, a simple yet effective algorithm is proposed to solve the proposed H-based image CS problem.
arXiv Detail & Related papers (2020-05-16T08:17:44Z) - Modeling and Enhancing Low-quality Retinal Fundus Images [167.02325845822276]
Low-quality fundus images increase uncertainty in clinical observation and lead to the risk of misdiagnosis.
We propose a clinically oriented fundus enhancement network (cofe-Net) to suppress global degradation factors.
Experiments on both synthetic and real images demonstrate that our algorithm effectively corrects low-quality fundus images without losing retinal details.
arXiv Detail & Related papers (2020-05-12T08:01:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.