Bag of Visual Words (BoVW) with Deep Features -- Patch Classification Model for Limited Dataset of Breast Tumours

• URL: http://arxiv.org/abs/2202.10701v1
• Date: Tue, 22 Feb 2022 07:19:18 GMT
• Title: Bag of Visual Words (BoVW) with Deep Features -- Patch Classification Model for Limited Dataset of Breast Tumours
• Abstract summary: Bag of Visual Words (BoVW) is used as a feature selector to select most discriminative features among the CNN features. The pipeline is end-to-end since it does not require post processing of patch predictions to select discriminative patches.
• Score: 11.731001328350985
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Currently, the computational complexity limits the training of high resolution gigapixel images using Convolutional Neural Networks. Therefore, such images are divided into patches or tiles. Since, these high resolution patches are encoded with discriminative information therefore; CNNs are trained on these patches to perform patch-level predictions. However, the problem with patch-level prediction is that pathologist generally annotates at image-level and not at patch level. Due to this limitation most of the patches may not contain enough class-relevant features. Through this work, we tried to incorporate patch descriptive capability within the deep framework by using Bag of Visual Words (BoVW) as a kind of regularisation to improve generalizability. Using this hypothesis, we aim to build a patch based classifier to discriminate between four classes of breast biopsy image patches (normal, benign, \textit{In situ} carcinoma, invasive carcinoma). The task is to incorporate quality deep features using CNN to describe relevant information in the images while simultaneously discarding irrelevant information using Bag of Visual Words (BoVW). The proposed method passes patches obtained from WSI and microscopy images through pre-trained CNN to extract features. BoVW is used as a feature selector to select most discriminative features among the CNN features. Finally, the selected feature sets are classified as one of the four classes. The hybrid model provides flexibility in terms of choice of pre-trained models for feature extraction. The pipeline is end-to-end since it does not require post processing of patch predictions to select discriminative patches. We compared our observations with state-of-the-art methods like ResNet50, DenseNet169, and InceptionV3 on the BACH-2018 challenge dataset. Our proposed method shows better performance than all the three methods.

Related papers

• EvoPS: Evolutionary Patch Selection for Whole Slide Image Analysis in Computational Pathology [0.0]
  We propose EvoPS, a novel framework that formulates patch selection as a multi-objective optimization problem.<n>We validated our framework across four major cancer cohorts from The Cancer Genome Atlas.
  arXiv  Detail & Related papers  (2025-11-10T19:07:44Z)
• Seeing What Matters: Empowering CLIP with Patch Generation-to-Selection [54.21851618853518]
  We present a concise yet effective approach called Patch Generation-to-Selection to enhance CLIP's training efficiency. Our approach, CLIP-PGS, sets new state-of-the-art results in zero-shot classification and retrieval tasks.
  arXiv  Detail & Related papers  (2025-03-21T12:10:38Z)
• A Graph-Based Framework for Interpretable Whole Slide Image Analysis [86.37618055724441]
  We develop a framework that transforms whole-slide images into biologically-informed graph representations.<n>Our approach builds graph nodes from tissue regions that respect natural structures, not arbitrary grids.<n>We demonstrate strong performance on challenging cancer staging and survival prediction tasks.
  arXiv  Detail & Related papers  (2025-03-14T20:15:04Z)
• Efficient Classification of Histopathology Images [5.749787074942512]
  We use images with annotated tumor regions to identify a set of tumor patches and a set of benign patches in a cancerous slide. This creates an important problem during patch-level classification, where the majority of patches from an image labeled as 'cancerous' are actually tumor-free.
  arXiv  Detail & Related papers  (2024-09-08T17:41:04Z)
• Boosting Vision-Language Models for Histopathology Classification: Predict all at once [11.644118356081531]
  We introduce a transductive approach to vision-language models for histo-pathology. Our approach is highly efficient, processing $105$ patches in just a few seconds.
  arXiv  Detail & Related papers  (2024-09-03T13:24:12Z)
• Semi-supervised 3D Object Detection with PatchTeacher and PillarMix [71.4908268136439]
  Current semi-supervised 3D object detection methods typically use a teacher to generate pseudo labels for a student. We propose PatchTeacher, which focuses on partial scene 3D object detection to provide high-quality pseudo labels for the student. We introduce three key techniques, i.e., Patch Normalizer, Quadrant Align, and Fovea Selection, to improve the performance of PatchTeacher.
  arXiv  Detail & Related papers  (2024-07-13T06:58:49Z)
• Fine-grained Recognition with Learnable Semantic Data Augmentation [68.48892326854494]
  Fine-grained image recognition is a longstanding computer vision challenge. We propose diversifying the training data at the feature-level to alleviate the discriminative region loss problem. Our method significantly improves the generalization performance on several popular classification networks.
  arXiv  Detail & Related papers  (2023-09-01T11:15:50Z)
• Hardwiring ViT Patch Selectivity into CNNs using Patch Mixing [64.7892681641764]
  We train vision transformers (ViTs) and convolutional neural networks (CNNs) We find that ViTs do not improve nor degrade when trained using Patch Mixing. We conclude that this training method is a way of simulating in CNNs the abilities that ViTs already possess.
  arXiv  Detail & Related papers  (2023-06-30T17:59:53Z)
• DBAT: Dynamic Backward Attention Transformer for Material Segmentation with Cross-Resolution Patches [8.812837829361923]
  We propose the Dynamic Backward Attention Transformer (DBAT) to aggregate cross-resolution features. Experiments show that our DBAT achieves an accuracy of 86.85%, which is the best performance among state-of-the-art real-time models. We further align features to semantic labels, performing network dissection, to infer that the proposed model can extract material-related features better than other methods.
  arXiv  Detail & Related papers  (2023-05-06T03:47:20Z)
• CEC-CNN: A Consecutive Expansion-Contraction Convolutional Network for Very Small Resolution Medical Image Classification [0.8108972030676009]
  We introduce a new CNN architecture which preserves multi-scale features from deep, intermediate, and shallow layers. Using a dataset of very low resolution patches from Pancreatic Ductal Adenocarcinoma (PDAC) CT scans we demonstrate that our network can outperform current state of the art models.
  arXiv  Detail & Related papers  (2022-09-27T20:01:12Z)
• HIPA: Hierarchical Patch Transformer for Single Image Super Resolution [62.7081074931892]
  This paper presents HIPA, a novel Transformer architecture that progressively recovers the high resolution image using a hierarchical patch partition. We build a cascaded model that processes an input image in multiple stages, where we start with tokens with small patch sizes and gradually merge to the full resolution. Such a hierarchical patch mechanism not only explicitly enables feature aggregation at multiple resolutions but also adaptively learns patch-aware features for different image regions.
  arXiv  Detail & Related papers  (2022-03-19T05:09:34Z)
• Convolution-Free Medical Image Segmentation using Transformers [8.130670465411239]
  We show that a different method, based entirely on self-attention between neighboring image patches, can achieve competitive or better results. We show that the proposed model can achieve segmentation accuracies that are better than the state of the art CNNs on three datasets.
  arXiv  Detail & Related papers  (2021-02-26T18:49:13Z)
• The Mind's Eye: Visualizing Class-Agnostic Features of CNNs [92.39082696657874]
  We propose an approach to visually interpret CNN features given a set of images by creating corresponding images that depict the most informative features of a specific layer. Our method uses a dual-objective activation and distance loss, without requiring a generator network nor modifications to the original model.
  arXiv  Detail & Related papers  (2021-01-29T07:46:39Z)
• Rethinking Generative Zero-Shot Learning: An Ensemble Learning Perspective for Recognising Visual Patches [52.67723703088284]
  We propose a novel framework called multi-patch generative adversarial nets (MPGAN) MPGAN synthesises local patch features and labels unseen classes with a novel weighted voting strategy. MPGAN has significantly greater accuracy than state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-07-27T05:49:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.