Medical Image Retrieval via Nearest Neighbor Search on Pre-trained Image Features

• URL: http://arxiv.org/abs/2210.02401v1
• Date: Wed, 5 Oct 2022 17:21:11 GMT
• Title: Medical Image Retrieval via Nearest Neighbor Search on Pre-trained Image Features
• Authors: Deepak Gupta, Russell Loane, Soumya Gayen, and Dina Demner-Fushman
• Abstract summary: Nearest neighbor search (NNS) aims to locate the points in high-dimensional space that is closest to the query point. This paper proposes DenseLinkSearch, an effective and efficient algorithm that searches and retrieves relevant images from heterogeneous sources of medical images. We extensively tested the proposed NNS approach and compared the performance with state-of-the-art NNS approaches on benchmark datasets and our created medical image datasets.
• Score: 15.331765570210479
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Nearest neighbor search (NNS) aims to locate the points in high-dimensional space that is closest to the query point. The brute-force approach for finding the nearest neighbor becomes computationally infeasible when the number of points is large. The NNS has multiple applications in medicine, such as searching large medical imaging databases, disease classification, diagnosis, etc. With a focus on medical imaging, this paper proposes DenseLinkSearch an effective and efficient algorithm that searches and retrieves the relevant images from heterogeneous sources of medical images. Towards this, given a medical database, the proposed algorithm builds the index that consists of pre-computed links of each point in the database. The search algorithm utilizes the index to efficiently traverse the database in search of the nearest neighbor. We extensively tested the proposed NNS approach and compared the performance with state-of-the-art NNS approaches on benchmark datasets and our created medical image datasets. The proposed approach outperformed the existing approach in terms of retrieving accurate neighbors and retrieval speed. We also explore the role of medical image feature representation in content-based medical image retrieval tasks. We propose a Transformer-based feature representation technique that outperformed the existing pre-trained Transformer approach on CLEF 2011 medical image retrieval task. The source code of our experiments are available at https://github.com/deepaknlp/DLS.

Related papers

• Deep supervised hashing for fast retrieval of radio image cubes [5.688539343057255]
  Deep hashing algorithms have been shown to be efficient at image retrieval tasks in the fields of computer vision and multimedia. In this work, we utilize deep hashing to rapidly search for similar images in a large database. The experimental results demonstrate the capability to search and retrieve similar radio images efficiently and at scale.
  arXiv  Detail & Related papers  (2023-09-02T12:59:52Z)
• A Hierarchical Descriptor Framework for On-the-Fly Anatomical Location Matching between Longitudinal Studies [0.07499722271664144]
  We propose a method to match anatomical locations between pairs of medical images in longitudinal comparisons. The matching is made possible by computing a descriptor of the query point in a source image. A hierarchical search operation finds the corresponding point with the most similar descriptor in the target image.
  arXiv  Detail & Related papers  (2023-08-11T18:01:27Z)
• LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matching [59.01894976615714]
  We introduce LVM-Med, the first family of deep networks trained on large-scale medical datasets. We have collected approximately 1.3 million medical images from 55 publicly available datasets. LVM-Med empirically outperforms a number of state-of-the-art supervised, self-supervised, and foundation models.
  arXiv  Detail & Related papers  (2023-06-20T22:21:34Z)
• Advanced Medical Image Representation for Efficient Processing and Transfer in Multisite Clouds [0.6091702876917281]
  Human brain databases at medical institutes can accumulate tens of Terabytes of data per year. We propose a novel medical image format representation based on multiple data structures that improve the information maintained in the medical images.
  arXiv  Detail & Related papers  (2023-04-29T18:09:17Z)
• Machine learning based biomedical image processing for echocardiographic images [0.0]
  The proposed method uses K-Nearest Neighbor (KNN) algorithm for segmentation of medical images. The trained neural network has been tested successfully on a group of echocardiographic images.
  arXiv  Detail & Related papers  (2023-03-16T06:23:43Z)
• ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and Retrieval [51.588385824875886]
  Cross-modal retrieval consists in finding images related to a given query text or vice-versa. Many recent methods proposed effective solutions to the image-text matching problem, mostly using recent large vision-language (VL) Transformer networks. This paper proposes an ALign And DIstill Network (ALADIN) to fill in the gap between effectiveness and efficiency.
  arXiv  Detail & Related papers  (2022-07-29T16:01:48Z)
• Preservation of High Frequency Content for Deep Learning-Based Medical Image Classification [74.84221280249876]
  An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists. We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
  arXiv  Detail & Related papers  (2022-05-08T15:29:54Z)
• Deep Triplet Hashing Network for Case-based Medical Image Retrieval [33.21919320742157]
  We propose an end-to-end framework, called Attention-based Triplet Hashing (ATH) network, to learn low-dimensional hash codes. We show that our proposed ATH can further improve the retrieval performance compared to the state-of-the-art deep hashing methods.
  arXiv  Detail & Related papers  (2021-01-29T01:35:46Z)
• Y-Net for Chest X-Ray Preprocessing: Simultaneous Classification of Geometry and Segmentation of Annotations [70.0118756144807]
  This work introduces a general pre-processing step for chest x-ray input into machine learning algorithms. A modified Y-Net architecture based on the VGG11 encoder is used to simultaneously learn geometric orientation and segmentation of radiographs. Results were evaluated by expert clinicians, with acceptable geometry in 95.8% and annotation mask in 96.2%, compared to 27.0% and 34.9% respectively in control images.
  arXiv  Detail & Related papers  (2020-05-08T02:16:17Z)
• Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentation [84.7571086566595]
  We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape. The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
  arXiv  Detail & Related papers  (2020-03-31T11:50:43Z)
• VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Images [121.31355003451152]
  Large Scale Vertebrae Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020. We present the the results of this evaluation and further investigate the performance-variation at vertebra-level, scan-level, and at different fields-of-view.
  arXiv  Detail & Related papers  (2020-01-24T21:09:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.