Agent with Tangent-based Formulation and Anatomical Perception for Standard Plane Localization in 3D Ultrasound

• URL: http://arxiv.org/abs/2207.00475v1
• Date: Fri, 1 Jul 2022 14:53:27 GMT
• Title: Agent with Tangent-based Formulation and Anatomical Perception for Standard Plane Localization in 3D Ultrasound
• Authors: Yuxin Zou, Haoran Dou, Yuhao Huang, Xin Yang, Jikuan Qian, Chaojiong Zhen, Xiaodan Ji, Nishant Ravikumar, Guoqiang Chen, Weijun Huang, Alejandro F. Frangi, Dong Ni
• Abstract summary: We introduce a novel reinforcement learning framework for automatic SP localization in 3D US. First, we formulate SP localization in 3D US as a tangent-point-based problem in RL to restructure the action space. Second, we design an auxiliary task learning strategy to enhance the model's ability to recognize subtle differences crossing Non-SPs and SPs in plane search.
• Score: 56.7645826576439
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Standard plane (SP) localization is essential in routine clinical ultrasound (US) diagnosis. Compared to 2D US, 3D US can acquire multiple view planes in one scan and provide complete anatomy with the addition of coronal plane. However, manually navigating SPs in 3D US is laborious and biased due to the orientation variability and huge search space. In this study, we introduce a novel reinforcement learning (RL) framework for automatic SP localization in 3D US. Our contribution is three-fold. First, we formulate SP localization in 3D US as a tangent-point-based problem in RL to restructure the action space and significantly reduce the search space. Second, we design an auxiliary task learning strategy to enhance the model's ability to recognize subtle differences crossing Non-SPs and SPs in plane search. Finally, we propose a spatial-anatomical reward to effectively guide learning trajectories by exploiting spatial and anatomical information simultaneously. We explore the efficacy of our approach on localizing four SPs on uterus and fetal brain datasets. The experiments indicate that our approach achieves a high localization accuracy as well as robust performance.

Related papers

• GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplane [53.388937705785025]
  3D open-vocabulary scene understanding is crucial for advancing augmented reality and robotic applications. We introduce GOI, a framework that integrates semantic features from 2D vision-language foundation models into 3D Gaussian Splatting (3DGS) Our method treats the feature selection process as a hyperplane division within the feature space, retaining only features that are highly relevant to the query.
  arXiv  Detail & Related papers  (2024-05-27T18:57:18Z)
• On the Localization of Ultrasound Image Slices within Point Distribution Models [84.27083443424408]
  Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US) Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology. We present a framework for automated US image slice localization within a 3D shape representation.
  arXiv  Detail & Related papers  (2023-09-01T10:10:46Z)
• Searching a High-Performance Feature Extractor for Text Recognition Network [92.12492627169108]
  We design a domain-specific search space by exploring principles for having good feature extractors. As the space is huge and complexly structured, no existing NAS algorithms can be applied. We propose a two-stage algorithm to effectively search in the space.
  arXiv  Detail & Related papers  (2022-09-27T03:49:04Z)
• Searching Collaborative Agents for Multi-plane Localization in 3D Ultrasound [15.573821037925143]
  3D ultrasound can contain multiple standard planes (SPs) in one shot. Manual SP localization in 3D US is challenging because of the low image quality, huge search space and large anatomical variability. We propose a novel multi-agent reinforcement learning framework to simultaneously localize multiple SPs in 3D US.
  arXiv  Detail & Related papers  (2021-05-22T02:48:23Z)
• Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound [14.256624552635786]
  This study enhances our previous RL framework with a newly designed adaptive dynamic termination to enable an early stop for the agent searching. Our approach achieves localization error of 2.52mm/10.26 degrees, 2.48mm/10.39 degrees, 2.02mm/10.48 degrees, 2.00mm/14.57 degrees, 2.61mm/9.71 degrees, 3.09mm/9.58 degrees, 1.49mm/7.54 degrees for the transcerebellar, transventricular, transthalamic planes in fetal brain, abdominal plane in fetal abdomen, and mid-sagittal, transverse and coronal planes in uterus.
  arXiv  Detail & Related papers  (2021-03-26T14:57:26Z)
• 3D Axial-Attention for Lung Nodule Classification [0.11458853556386794]
  We propose to use 3D Axial-Attention, which requires a fraction of the computing power of a regular Non-Local network. We solve the position invariant problem of the Non-Local network by proposing adding 3D positional encoding to shared embeddings. Our results show that the 3D Axial-Attention model achieves state-of-the-art performance on all evaluation metrics including AUC and Accuracy.
  arXiv  Detail & Related papers  (2020-12-28T06:49:09Z)
• Searching Collaborative Agents for Multi-plane Localization in 3D Ultrasound [59.97366727654676]
  3D ultrasound (US) is widely used due to its rich diagnostic information, portability and low cost. Standard plane (SP) localization in US volume not only improves efficiency and reduces user-dependence, but also boosts 3D US interpretation. We propose a novel Multi-Agent Reinforcement Learning framework to localize multiple uterine SPs in 3D US simultaneously.
  arXiv  Detail & Related papers  (2020-07-30T07:23:55Z)
• Agent with Warm Start and Active Termination for Plane Localization in 3D Ultrasound [56.14006424500334]
  Standard plane localization is crucial for ultrasound (US) diagnosis. In prenatal US, dozens of standard planes are manually acquired with a 2D probe. We propose a novel reinforcement learning framework to automatically localize fetal brain standard planes in 3D US.
  arXiv  Detail & Related papers  (2019-10-10T02:21:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.