IB-U-Nets: Improving medical image segmentation tasks with 3D Inductive
Biased kernels
- URL: http://arxiv.org/abs/2210.15949v1
- Date: Fri, 28 Oct 2022 07:12:15 GMT
- Title: IB-U-Nets: Improving medical image segmentation tasks with 3D Inductive
Biased kernels
- Authors: Shrajan Bhandary and Zahra Babaiee and Dejan Kostyszyn and Tobias
Fechter and Constantinos Zamboglou and Anca-Ligia Grosu and Radu Grosu
- Abstract summary: We introduce IB-U-Nets, a novel architecture with inductive bias, inspired by the visual processing in vertebrates.
With the 3D U-Net as the base, we add two 3D residual components to the second encoder blocks. They provide an inductive bias, helping U-Nets to segment anatomical structures from 3D images with increased robustness and accuracy.
Our results demonstrate the superior robustness and accuracy of IB-U-Nets, especially on small datasets, as is typically the case in medical-image analysis.
- Score: 8.361151913935776
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Despite the success of convolutional neural networks for 3D medical-image
segmentation, the architectures currently used are still not robust enough to
the protocols of different scanners, and the variety of image properties they
produce. Moreover, access to large-scale datasets with annotated regions of
interest is scarce, and obtaining good results is thus difficult. To overcome
these challenges, we introduce IB-U-Nets, a novel architecture with inductive
bias, inspired by the visual processing in vertebrates. With the 3D U-Net as
the base, we add two 3D residual components to the second encoder blocks. They
provide an inductive bias, helping U-Nets to segment anatomical structures from
3D images with increased robustness and accuracy. We compared IB-U-Nets with
state-of-the-art 3D U-Nets on multiple modalities and organs, such as the
prostate and spleen, using the same training and testing pipeline, including
data processing, augmentation and cross-validation. Our results demonstrate the
superior robustness and accuracy of IB-U-Nets, especially on small datasets, as
is typically the case in medical-image analysis. IB-U-Nets source code and
models are publicly available.
Related papers
- Improved distinct bone segmentation in upper-body CT through
multi-resolution networks [0.39583175274885335]
In distinct bone segmentation from upper body CTs a large field of view and a computationally taxing 3D architecture are required.
This leads to low-resolution results lacking detail or localisation errors due to missing spatial context.
We propose end-to-end trainable segmentation networks that combine several 3D U-Nets working at different resolutions.
arXiv Detail & Related papers (2023-01-31T14:46:16Z) - Enforcing connectivity of 3D linear structures using their 2D
projections [54.0598511446694]
We propose to improve the 3D connectivity of our results by minimizing a sum of topology-aware losses on their 2D projections.
This suffices to increase the accuracy and to reduce the annotation effort required to provide the required annotated training data.
arXiv Detail & Related papers (2022-07-14T11:42:18Z) - Super Images -- A New 2D Perspective on 3D Medical Imaging Analysis [0.0]
We present a simple yet effective 2D method to handle 3D data while efficiently embedding the 3D knowledge during training.
Our method generates a super-resolution image by stitching slices side by side in the 3D image.
While attaining equal, if not superior, results to 3D networks utilizing only 2D counterparts, the model complexity is reduced by around threefold.
arXiv Detail & Related papers (2022-05-05T09:59:03Z) - Two-Stream Graph Convolutional Network for Intra-oral Scanner Image
Segmentation [133.02190910009384]
We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes.
Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
arXiv Detail & Related papers (2022-04-19T10:41:09Z) - 3D-OOCS: Learning Prostate Segmentation with Inductive Bias [5.907824204733372]
We introduce OOCS-enhanced networks, a novel architecture inspired by the innate nature of visual processing in the vertebrates.
With different 3D U-Net variants as the base, we add two 3D residual components to the second encoder blocks: on and off center-surround.
OOCS helps 3D U-Nets to scrutinise and delineate anatomical structures present in 3D images with increased accuracy.
arXiv Detail & Related papers (2021-10-29T10:14:56Z) - R2U3D: Recurrent Residual 3D U-Net for Lung Segmentation [17.343802171952195]
We propose a novel model, namely, Recurrent Residual 3D U-Net (R2U3D), for the 3D lung segmentation task.
In particular, the proposed model integrates 3D convolution into the Recurrent Residual Neural Network based on U-Net.
The proposed R2U3D network is trained on the publicly available dataset LUNA16 and it achieves state-of-the-art performance.
arXiv Detail & Related papers (2021-05-05T19:17:14Z) - CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image
Segmentation [95.51455777713092]
Convolutional neural networks (CNNs) have been the de facto standard for nowadays 3D medical image segmentation.
We propose a novel framework that efficiently bridges a bf Convolutional neural network and a bf Transformer bf (CoTr) for accurate 3D medical image segmentation.
arXiv Detail & Related papers (2021-03-04T13:34:22Z) - TSGCNet: Discriminative Geometric Feature Learning with Two-Stream
GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes.
We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
arXiv Detail & Related papers (2020-12-26T08:02:56Z) - Efficient embedding network for 3D brain tumor segmentation [0.33727511459109777]
In this paper, we investigate a way to transfer the performance of a two-dimensional classiffication network for the purpose of three-dimensional semantic segmentation of brain tumors.
As the input data is in 3D, the first layers of the encoder are devoted to the reduction of the third dimension in order to fit the input of the EfficientNet network.
Experimental results on validation and test data from the BraTS 2020 challenge demonstrate that the proposed method achieve promising performance.
arXiv Detail & Related papers (2020-11-22T16:17:29Z) - Volumetric Medical Image Segmentation: A 3D Deep Coarse-to-fine
Framework and Its Adversarial Examples [74.92488215859991]
We propose a novel 3D-based coarse-to-fine framework to efficiently tackle these challenges.
The proposed 3D-based framework outperforms their 2D counterparts by a large margin since it can leverage the rich spatial information along all three axes.
We conduct experiments on three datasets, the NIH pancreas dataset, the JHMI pancreas dataset and the JHMI pathological cyst dataset.
arXiv Detail & Related papers (2020-10-29T15:39:19Z) - KiU-Net: Overcomplete Convolutional Architectures for Biomedical Image
and Volumetric Segmentation [71.79090083883403]
"Traditional" encoder-decoder based approaches perform poorly in detecting smaller structures and are unable to segment boundary regions precisely.
We propose KiU-Net which has two branches: (1) an overcomplete convolutional network Kite-Net which learns to capture fine details and accurate edges of the input, and (2) U-Net which learns high level features.
The proposed method achieves a better performance as compared to all the recent methods with an additional benefit of fewer parameters and faster convergence.
arXiv Detail & Related papers (2020-10-04T19:23:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.