Simultaneous segmentation and classification of the retinal arteries and veins from color fundus images

• URL: http://arxiv.org/abs/2209.09582v1
• Date: Tue, 20 Sep 2022 09:54:01 GMT
• Title: Simultaneous segmentation and classification of the retinal arteries and veins from color fundus images
• Authors: Jos\'e Morano, \'Alvaro S. Hervella, Jorge Novo, Jos\'e Rouco
• Abstract summary: The study of the retinal vasculature is a fundamental stage in the screening and diagnosis of many diseases. We propose a novel approach for the simultaneous segmentation and classification of the retinal A/V from eye fundus images.
• Score: 6.027522272446452
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The study of the retinal vasculature is a fundamental stage in the screening and diagnosis of many diseases. A complete retinal vascular analysis requires to segment and classify the blood vessels of the retina into arteries and veins (A/V). Early automatic methods approached these segmentation and classification tasks in two sequential stages. However, currently, these tasks are approached as a joint semantic segmentation task, as the classification results highly depend on the effectiveness of the vessel segmentation. In that regard, we propose a novel approach for the simultaneous segmentation and classification of the retinal A/V from eye fundus images. In particular, we propose a novel method that, unlike previous approaches, and thanks to a novel loss, decomposes the joint task into three segmentation problems targeting arteries, veins and the whole vascular tree. This configuration allows to handle vessel crossings intuitively and directly provides accurate segmentation masks of the different target vascular trees. The provided ablation study on the public Retinal Images vessel Tree Extraction (RITE) dataset demonstrates that the proposed method provides a satisfactory performance, particularly in the segmentation of the different structures. Furthermore, the comparison with the state of the art shows that our method achieves highly competitive results in A/V classification, while significantly improving vascular segmentation. The proposed multi-segmentation method allows to detect more vessels and better segment the different structures, while achieving a competitive classification performance. Also, in these terms, our approach outperforms the approaches of various reference works. Moreover, in contrast with previous approaches, the proposed method allows to directly detect the vessel crossings, as well as preserving the continuity of A/V at these complex locations.

Related papers

• Multi-task Explainable Skin Lesion Classification [54.76511683427566]
  We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data. The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
  arXiv  Detail & Related papers  (2023-10-11T05:49:47Z)
• Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective [51.70661197256033]
  We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation. We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks. We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
  arXiv  Detail & Related papers  (2023-02-03T13:50:25Z)
• Learning-Based Keypoint Registration for Fetoscopic Mosaicking [65.02392513942533]
  In Twin-to-Twin Transfusion Syndrome (TTTS), abnormal vascular anastomoses in the monochorionic placenta can produce uneven blood flow between the two fetuses. We propose a learning-based framework for in-vivo fetoscopy frame registration for field-of-view expansion.
  arXiv  Detail & Related papers  (2022-07-26T21:21:12Z)
• An Algorithm for the Labeling and Interactive Visualization of the Cerebrovascular System of Ischemic Strokes [59.116811751334225]
  VirtualDSA++ is an algorithm designed to segment and label the cerebrovascular tree on CTA scans. We extend the labeling mechanism for the cerebral arteries to identify occluded vessels. We present the generic concept of iterative systematic search for pathways on all nodes of said model, which enables new interactive features.
  arXiv  Detail & Related papers  (2022-04-26T14:20:26Z)
• RAVIR: A Dataset and Methodology for the Semantic Segmentation and Quantitative Analysis of Retinal Arteries and Veins in Infrared Reflectance Imaging [7.316426736150123]
  We present a novel dataset, dubbed RAVIR, for the semantic segmentation of Retinal Arteries and Veins in Infrared Reflectance (IR) imaging. We propose a novel deep learning-based methodology, denoted as SegRAVIR, for the semantic segmentation of retinal arteries and veins. Our experiments validate the effectiveness of SegRAVIR and demonstrate its superior performance in comparison to state-of-the-art models.
  arXiv  Detail & Related papers  (2022-03-28T17:30:29Z)
• JOINED : Prior Guided Multi-task Learning for Joint Optic Disc/Cup Segmentation and Fovea Detection [1.2250035750661867]
  We present a novel method, named JOINED, for prior guided multi-task learning for joint OD/OC segmentation and fovea detection. Our proposed JOINED pipeline consists of a coarse stage and a fine stage. Experimental results reveal that our proposed JOINED outperforms existing state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-03-01T13:47:48Z)
• Fully Automated Tree Topology Estimation and Artery-Vein Classification [0.0]
  We present a fully automatic technique for extracting the retinal vascular topology, i.e., how the different vessels are connected to each other, given a single color fundus image. We validated the usefulness of our extraction method by using it to achieve state-of-the-art results in retinal artery-vein classification.
  arXiv  Detail & Related papers  (2022-02-04T20:40:01Z)
• Hierarchical Deep Network with Uncertainty-aware Semi-supervised Learning for Vessel Segmentation [58.45470500617549]
  We propose a hierarchical deep network where an attention mechanism localizes the low-contrast capillary regions guided by the whole vessels. The proposed method achieves the state-of-the-art performance in the benchmarks of both retinal artery/vein segmentation in fundus images and liver portal/hepatic vessel segmentation in CT images.
  arXiv  Detail & Related papers  (2021-05-31T06:55:43Z)
• Learning to Address Intra-segment Misclassification in Retinal Imaging [3.552155712390612]
  We propose a new approach that decomposes multi-class segmentation into multiple binary, followed by a binary-to-multi-class fusion network. The network merges representations of artery, vein, and multi-class feature maps, each of which are supervised by expert vessel annotation in adversarial training. The results show that, our model respectively improves F1-score by 4.4%, 5.1%, and 4.2% compared with three state-of-the-art deep learning based methods on DRIVE-AV, LES-AV, and HRF-AV data sets.
  arXiv  Detail & Related papers  (2021-04-25T11:57:26Z)
• Assignment Flow for Order-Constrained OCT Segmentation [0.0]
  The identification of retinal layer thicknesses serves as an essential task be done for each patient separately. The elaboration of automated segmentation models has become an important task in the field of medical image processing. We propose a novel, purely data driven textitgeometric approach to order-constrained 3D OCT retinal cell layer segmentation
  arXiv  Detail & Related papers  (2020-09-10T01:57:53Z)
• Multi-Task Neural Networks with Spatial Activation for Retinal Vessel Segmentation and Artery/Vein Classification [49.64863177155927]
  We propose a multi-task deep neural network with spatial activation mechanism to segment full retinal vessel, artery and vein simultaneously. The proposed network achieves pixel-wise accuracy of 95.70% for vessel segmentation, and A/V classification accuracy of 94.50%, which is the state-of-the-art performance for both tasks.
  arXiv  Detail & Related papers  (2020-07-18T05:46:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.