PICS in Pics: Physics Informed Contour Selection for Rapid Image Segmentation

• URL: http://arxiv.org/abs/2311.07002v1
• Date: Mon, 13 Nov 2023 01:03:19 GMT
• Title: PICS in Pics: Physics Informed Contour Selection for Rapid Image Segmentation
• Authors: Vikas Dwivedi, Balaji Srinivasan and Ganapathy Krishnamurthi
• Abstract summary: We introduce Physics Informed Contour Selection (PICS) for rapid image segmentation without relying on labeled data. PICS draws inspiration from physics-informed neural networks (PINNs) and an active contour model called snake. It is fast and computationally lightweight because it employs cubic splines instead of a deep neural network as a basis function. It is the first snake variant to minimize a region-based loss function instead of traditional edge-based loss functions.
• Score: 0.05251974546677281
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Effective training of deep image segmentation models is challenging due to the need for abundant, high-quality annotations. Generating annotations is laborious and time-consuming for human experts, especially in medical image segmentation. To facilitate image annotation, we introduce Physics Informed Contour Selection (PICS) - an interpretable, physics-informed algorithm for rapid image segmentation without relying on labeled data. PICS draws inspiration from physics-informed neural networks (PINNs) and an active contour model called snake. It is fast and computationally lightweight because it employs cubic splines instead of a deep neural network as a basis function. Its training parameters are physically interpretable because they directly represent control knots of the segmentation curve. Traditional snakes involve minimization of the edge-based loss functionals by deriving the Euler-Lagrange equation followed by its numerical solution. However, PICS directly minimizes the loss functional, bypassing the Euler Lagrange equations. It is the first snake variant to minimize a region-based loss function instead of traditional edge-based loss functions. PICS uniquely models the three-dimensional (3D) segmentation process with an unsteady partial differential equation (PDE), which allows accelerated segmentation via transfer learning. To demonstrate its effectiveness, we apply PICS for 3D segmentation of the left ventricle on a publicly available cardiac dataset. While doing so, we also introduce a new convexity-preserving loss term that encodes the shape information of the left ventricle to enhance PICS's segmentation quality. Overall, PICS presents several novelties in network architecture, transfer learning, and physics-inspired losses for image segmentation, thereby showing promising outcomes and potential for further refinement.

Related papers

• PI-Att: Topology Attention for Segmentation Networks through Adaptive Persistence Image Representation [1.4680035572775534]
  We introduce a new topology-aware loss function, which explicitly forces the network to minimize the topological dissimilarity between the ground truth and prediction maps. We quantify the topology of each map by the persistence image representation, for the first time in the context of a segmentation network loss. The effectiveness of the proposed PI-Att loss is demonstrated on two different datasets for aorta and great vessel segmentation in computed tomography images.
  arXiv  Detail & Related papers  (2024-08-15T09:06:49Z)
• GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction [50.248694764703714]
  Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based regularization. We propose Greedy LEarning for Accelerated MRI reconstruction, an efficient training strategy for high-dimensional imaging settings.
  arXiv  Detail & Related papers  (2022-07-18T06:01:29Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• Automatic size and pose homogenization with spatial transformer network to improve and accelerate pediatric segmentation [51.916106055115755]
  We propose a new CNN architecture that is pose and scale invariant thanks to the use of Spatial Transformer Network (STN) Our architecture is composed of three sequential modules that are estimated together during training. We test the proposed method in kidney and renal tumor segmentation on abdominal pediatric CT scanners.
  arXiv  Detail & Related papers  (2021-07-06T14:50:03Z)
• Image Restoration by Deep Projected GSURE [115.57142046076164]
  Ill-posed inverse problems appear in many image processing applications, such as deblurring and super-resolution. We propose a new image restoration framework that is based on minimizing a loss function that includes a "projected-version" of the Generalized SteinUnbiased Risk Estimator (GSURE) and parameterization of the latent image by a CNN.
  arXiv  Detail & Related papers  (2021-02-04T08:52:46Z)
• Learning Euler's Elastica Model for Medical Image Segmentation [28.638720771555914]
  We propose a novel active contour with elastica (ACE) loss function incorporating Elastica (curvature and length) and region information as geometrically-natural constraints for the image segmentation tasks. Our results show that the proposed loss function outperforms other mainstream loss functions on different segmentation networks.
  arXiv  Detail & Related papers  (2020-11-01T15:14:37Z)
• Weakly-supervised Learning For Catheter Segmentation in 3D Frustum Ultrasound [74.22397862400177]
  We propose a novel Frustum ultrasound based catheter segmentation method. The proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume.
  arXiv  Detail & Related papers  (2020-10-19T13:56:22Z)
• GarNet++: Improving Fast and Accurate Static3D Cloth Draping by Curvature Loss [89.96698250086064]
  We introduce a two-stream deep network model that produces a visually plausible draping of a template cloth on virtual 3D bodies. Our network learns to mimic a Physics-Based Simulation (PBS) method while requiring two orders of magnitude less computation time. We validate our framework on four garment types for various body shapes and poses.
  arXiv  Detail & Related papers  (2020-07-20T13:40:15Z)
• An Elastic Interaction-Based Loss Function for Medical Image Segmentation [10.851295591782538]
  This paper introduces a long-range elastic interaction-based training strategy for medical image segmentation. In this strategy, CNN learns the target region under the guidance of the elastic interaction energy between the boundary of the predicted region and that of the actual object. Experimental results show that our method is able to achieve considerable improvements compared to commonly used pixel-wise loss functions.
  arXiv  Detail & Related papers  (2020-07-06T11:49:14Z)
• A Spatially Constrained Deep Convolutional Neural Network for Nerve Fiber Segmentation in Corneal Confocal Microscopic Images using Inaccurate Annotations [10.761046991755311]
  We propose a spatially constrained deep convolutional neural network (DCNN) to achieve smooth and robust image segmentation. The proposed method has been evaluated based on corneal confocal microscopic ( CCM) images for nerve fiber segmentation.
  arXiv  Detail & Related papers  (2020-04-20T16:56:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.