Recovering the Imperfect: Cell Segmentation in the Presence of
Dynamically Localized Proteins
- URL: http://arxiv.org/abs/2011.10486v1
- Date: Fri, 20 Nov 2020 16:30:55 GMT
- Title: Recovering the Imperfect: Cell Segmentation in the Presence of
Dynamically Localized Proteins
- Authors: \"Ozg\"un \c{C}i\c{c}ek, Yassine Marrakchi, Enoch Boasiako Antwi,
Barbara Di Ventura and Thomas Brox
- Abstract summary: We provide a solution to segmentation of imperfect data through time based on temporal propagation and uncertainty estimation.
We demonstrate the value of this approach over frame-by-frame segmentation and regular temporal propagation on data from human embryonic kidney cells.
- Score: 31.835275627382497
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deploying off-the-shelf segmentation networks on biomedical data has become
common practice, yet if structures of interest in an image sequence are visible
only temporarily, existing frame-by-frame methods fail. In this paper, we
provide a solution to segmentation of imperfect data through time based on
temporal propagation and uncertainty estimation. We integrate uncertainty
estimation into Mask R-CNN network and propagate motion-corrected segmentation
masks from frames with low uncertainty to those frames with high uncertainty to
handle temporary loss of signal for segmentation. We demonstrate the value of
this approach over frame-by-frame segmentation and regular temporal propagation
on data from human embryonic kidney (HEK293T) cells transiently transfected
with a fluorescent protein that moves in and out of the nucleus over time. The
method presented here will empower microscopic experiments aimed at
understanding molecular and cellular function.
Related papers
- Uncertainty-aware retinal layer segmentation in OCT through probabilistic signed distance functions [6.765624289092461]
We present a new approach for uncertainty-aware retinal layer segmentation in Optical Coherence Tomography ( OCT) scans.
Our methodology refines the segmentation by predicting a signed distance function (SDF) that effectively parameterizes the retinal layer shape via level set.
This ensures a robust representation of the retinal layer even in the presence of ambiguous input, imaging noise, and unreliable segmentations.
arXiv Detail & Related papers (2024-12-06T10:44:11Z) - Robust Real-time Segmentation of Bio-Morphological Features in Human Cherenkov Imaging during Radiotherapy via Deep Learning [4.726507415759874]
Cherenkov imaging enables real-time visualization of megavoltage X-ray or electron beam delivery to the patient during Radiation Therapy (RT)
Bio-morphological features, such as vasculature, seen in these images are patient-specific signatures that can be used for verification of positioning and motion management.
This study demonstrated the first deep learning framework for such an application, achieving video frame rate processing.
arXiv Detail & Related papers (2024-09-09T14:37:33Z) - LGRNet: Local-Global Reciprocal Network for Uterine Fibroid Segmentation in Ultrasound Videos [19.661094457941417]
Regular screening and early discovery of uterine fibroid are crucial for preventing potential malignant transformations.
We present Local-Global Reciprocal Network (LGRNet) to efficiently and effectively propagate the long-term temporal context.
arXiv Detail & Related papers (2024-07-08T08:06:06Z) - FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transforms [60.195642571004804]
We introduce FlowSDF, an image-guided conditional flow matching framework, to represent an implicit distribution of segmentation masks.
Our framework enables accurate sampling of segmentation masks and the computation of relevant statistical measures.
arXiv Detail & Related papers (2024-05-28T11:47:12Z) - Fuzzy Attention Neural Network to Tackle Discontinuity in Airway
Segmentation [67.19443246236048]
Airway segmentation is crucial for the examination, diagnosis, and prognosis of lung diseases.
Some small-sized airway branches (e.g., bronchus and terminaloles) significantly aggravate the difficulty of automatic segmentation.
This paper presents an efficient method for airway segmentation, comprising a novel fuzzy attention neural network and a comprehensive loss function.
arXiv Detail & Related papers (2022-09-05T16:38:13Z) - Temporal Transductive Inference for Few-Shot Video Object Segmentation [27.140141181513425]
Few-shot object segmentation (FS-VOS) aims at segmenting video frames using a few labelled examples of classes not seen during initial training.
Key to our approach is the use of both global and local temporal constraints.
Empirically, our model outperforms state-of-the-art meta-learning approaches in terms of mean intersection over union on YouTube-VIS by 2.8%.
arXiv Detail & Related papers (2022-03-27T14:08:30Z) - Recurrence-in-Recurrence Networks for Video Deblurring [58.49075799159015]
State-of-the-art video deblurring methods often adopt recurrent neural networks to model the temporal dependency between the frames.
In this paper, we propose recurrence-in-recurrence network architecture to cope with the limitations of short-ranged memory.
arXiv Detail & Related papers (2022-03-12T11:58:13Z) - Search for temporal cell segmentation robustness in phase-contrast
microscopy videos [31.92922565397439]
In this work, we present a deep learning-based workflow to segment cancer cells embedded in 3D collagen matrices.
We also propose a geometrical-characterization approach to studying cancer cell morphology.
We introduce a new annotated dataset for 2D cell segmentation and tracking, and an open-source implementation to replicate the experiments or adapt them to new image processing problems.
arXiv Detail & Related papers (2021-12-16T12:03:28Z) - Inconsistency-aware Uncertainty Estimation for Semi-supervised Medical
Image Segmentation [92.9634065964963]
We present a new semi-supervised segmentation model, namely, conservative-radical network (CoraNet) based on our uncertainty estimation and separate self-training strategy.
Compared with the current state of the art, our CoraNet has demonstrated superior performance.
arXiv Detail & Related papers (2021-10-17T08:49:33Z) - An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks.
We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem.
We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
arXiv Detail & Related papers (2020-12-06T18:55:07Z) - Unsupervised Instance Segmentation in Microscopy Images via Panoptic
Domain Adaptation and Task Re-weighting [86.33696045574692]
We propose a Cycle Consistency Panoptic Domain Adaptive Mask R-CNN (CyC-PDAM) architecture for unsupervised nuclei segmentation in histopathology images.
We first propose a nuclei inpainting mechanism to remove the auxiliary generated objects in the synthesized images.
Secondly, a semantic branch with a domain discriminator is designed to achieve panoptic-level domain adaptation.
arXiv Detail & Related papers (2020-05-05T11:08:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.