DPA-P2PNet: Deformable Proposal-aware P2PNet for Accurate Point-based Cell Detection

• URL: http://arxiv.org/abs/2303.02602v2
• Date: Sat, 26 Aug 2023 07:24:35 GMT
• Title: DPA-P2PNet: Deformable Proposal-aware P2PNet for Accurate Point-based Cell Detection
• Authors: Zhongyi Shui, Sunyi Zheng, Chenglu Zhu, Shichuan Zhang, Xiaoxuan Yu, Honglin Li, Jingxiong Li, Pingyi Chen, Lin Yang
• Abstract summary: Point-based cell detection (PCD) has garnered increased attention in computational pathology community. Unlike mainstream PCD methods that rely on intermediate density map representations, the Point-to-Point network (P2PNet) has recently emerged as an end-to-end solution for PCD. P2PNet is limited to decoding from a single-level feature map due to the scale-agnostic property of point proposals. The proposed method directly extracts multi-scale features for decoding according to the coordinates of point proposals on hierarchical feature maps.
• Score: 5.994317314012678
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Point-based cell detection (PCD), which pursues high-performance cell sensing under low-cost data annotation, has garnered increased attention in computational pathology community. Unlike mainstream PCD methods that rely on intermediate density map representations, the Point-to-Point network (P2PNet) has recently emerged as an end-to-end solution for PCD, demonstrating impressive cell detection accuracy and efficiency. Nevertheless, P2PNet is limited to decoding from a single-level feature map due to the scale-agnostic property of point proposals, which is insufficient to leverage multi-scale information. Moreover, the spatial distribution of pre-set point proposals is biased from that of cells, leading to inaccurate cell localization. To lift these limitations, we present DPA-P2PNet in this work. The proposed method directly extracts multi-scale features for decoding according to the coordinates of point proposals on hierarchical feature maps. On this basis, we further devise deformable point proposals to mitigate the positional bias between proposals and potential cells to promote cell localization. Inspired by practical pathological diagnosis that usually combines high-level tissue structure and low-level cell morphology for accurate cell classification, we propose a multi-field-of-view (mFoV) variant of DPA-P2PNet to accommodate additional large FoV images with tissue information as model input. Finally, we execute the first self-supervised pre-training on immunohistochemistry histopathology image data and evaluate the suitability of four representative self-supervised methods on the PCD task. Experimental results on three benchmarks and a large-scale and real-world interval dataset demonstrate the superiority of our proposed models over the state-of-the-art counterparts. Codes and pre-trained weights will be available.

Related papers

• Domain Adaptive Synapse Detection with Weak Point Annotations [63.97144211520869]
  We present AdaSyn, a framework for domain adaptive synapse detection with weak point annotations. In the WASPSYN challenge at I SBI 2023, our method ranks the 1st place.
  arXiv  Detail & Related papers  (2023-08-31T05:05:53Z)
• Distribution Aligned Diffusion and Prototype-guided network for Unsupervised Domain Adaptive Segmentation [19.043268288432156]
  We propose a Diffusion-based and Prototype-guided network (DP-Net) for unsupervised domain adaptive segmentation. Our approach is evaluated on fundus datasets through a series of experiments, which demonstrate that the performance of the proposed method is reliable and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-03-22T05:03:14Z)
• Point-to-Box Network for Accurate Object Detection via Single Point Supervision [51.95993495703855]
  We introduce a lightweight alternative to the off-the-shelf proposal (OTSP) method. P2BNet can construct an inter-objects balanced proposal bag by generating proposals in an anchor-like way. The code will be released at COCO.com/ucas-vg/P2BNet.
  arXiv  Detail & Related papers  (2022-07-14T11:32:00Z)
• End-to-end cell recognition by point annotation [5.130998755172569]
  In this paper, we introduce an end-to-end framework that applies direct regression and classification for preset anchor points. Specifically, we propose a pyramidal feature aggregation strategy to combine low-level features and high-level semantics simultaneously. In addition, an optimized cost function is designed to adapt our multi-task learning framework by matching ground truth and predicted points.
  arXiv  Detail & Related papers  (2022-07-01T02:44:58Z)
• TC-Net: Triple Context Network for Automated Stroke Lesion Segmentation [0.5482532589225552]
  We propose a new network, Triple Context Network (TC-Net), with the capture of spatial contextual information as the core. Our network is evaluated on the open dataset ATLAS, achieving the highest score of 0.594, Hausdorff distance of 27.005 mm, and average symmetry surface distance of 7.137 mm.
  arXiv  Detail & Related papers  (2022-02-28T11:12:16Z)
• Rethinking Counting and Localization in Crowds:A Purely Point-Based Framework [59.578339075658995]
  We propose a purely point-based framework for joint crowd counting and individual localization. We design an intuitive solution under this framework, which is called Point to Point Network (P2PNet)
  arXiv  Detail & Related papers  (2021-07-27T11:41:50Z)
• CPP-Net: Context-aware Polygon Proposal Network for Nucleus Segmentation [71.81734047345587]
  We propose a Context-aware Polygon Proposal Network ( CPP-Net) for nucleus segmentation. First, we sample a point set rather than one single pixel within each cell for distance prediction. Second, we propose a Confidence-based Weighting Module, which adaptively fuses the predictions from the sampled point set. Third, we introduce a novel Shape-Aware Perceptual (SAP) loss that constrains the shape of the predicted polygons.
  arXiv  Detail & Related papers  (2021-02-13T05:59:52Z)
• PC-RGNN: Point Cloud Completion and Graph Neural Network for 3D Object Detection [57.49788100647103]
  LiDAR-based 3D object detection is an important task for autonomous driving. Current approaches suffer from sparse and partial point clouds of distant and occluded objects. In this paper, we propose a novel two-stage approach, namely PC-RGNN, dealing with such challenges by two specific solutions.
  arXiv  Detail & Related papers  (2020-12-18T18:06:43Z)
• An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
  We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks. We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem. We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
  arXiv  Detail & Related papers  (2020-12-06T18:55:07Z)
• D-VPnet: A Network for Real-time Dominant Vanishing Point Detection in Natural Scenes [3.8170259685864165]
  Vanishing points (VPs) provide useful clues for mapping objects from 2D photos to 3D space. We present a new convolutional neural network (CNN) to detect dominant VPs in natural scenes.
  arXiv  Detail & Related papers  (2020-06-09T17:12:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.