Fully automated landmarking and facial segmentation on 3D photographs
- URL: http://arxiv.org/abs/2309.10472v1
- Date: Tue, 19 Sep 2023 09:39:55 GMT
- Title: Fully automated landmarking and facial segmentation on 3D photographs
- Authors: Bo Berends, Freek Bielevelt, Ruud Schreurs, Shankeeth Vinayahalingam,
Thomas Maal and Guido de Jong
- Abstract summary: The aim in this study was to develop and evaluate an automated cephalometric annotation method using a deep learning-based approach.
Ten landmarks were manually annotated on 2897 3D facial photographs by a single observer.
The workflow was successful in 98.6% of all test cases.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Three-dimensional facial stereophotogrammetry provides a detailed
representation of craniofacial soft tissue without the use of ionizing
radiation. While manual annotation of landmarks serves as the current gold
standard for cephalometric analysis, it is a time-consuming process and is
prone to human error. The aim in this study was to develop and evaluate an
automated cephalometric annotation method using a deep learning-based approach.
Ten landmarks were manually annotated on 2897 3D facial photographs by a single
observer. The automated landmarking workflow involved two successive
DiffusionNet models and additional algorithms for facial segmentation. The
dataset was randomly divided into a training and test dataset. The training
dataset was used to train the deep learning networks, whereas the test dataset
was used to evaluate the performance of the automated workflow. The precision
of the workflow was evaluated by calculating the Euclidean distances between
the automated and manual landmarks and compared to the intra-observer and
inter-observer variability of manual annotation and the semi-automated
landmarking method. The workflow was successful in 98.6% of all test cases. The
deep learning-based landmarking method achieved precise and consistent landmark
annotation. The mean precision of 1.69 (+/-1.15) mm was comparable to the
inter-observer variability (1.31 +/-0.91 mm) of manual annotation. The
Euclidean distance between the automated and manual landmarks was within 2 mm
in 69%. Automated landmark annotation on 3D photographs was achieved with the
DiffusionNet-based approach. The proposed method allows quantitative analysis
of large datasets and may be used in diagnosis, follow-up, and virtual surgical
planning.
Related papers
- An edge detection-based deep learning approach for tear meniscus height measurement [20.311238180811404]
We introduce an automatic TMH measurement technique based on edge detection-assisted annotation within a deep learning framework.
For improved segmentation of the pupil and tear meniscus areas, the convolutional neural network Inceptionv3 was first implemented.
The algorithm can automatically screen images based on their quality,segment the pupil and tear meniscus areas, and automatically measure TMH.
arXiv Detail & Related papers (2024-03-23T14:16:26Z) - Neural Semantic Surface Maps [52.61017226479506]
We present an automated technique for computing a map between two genus-zero shapes, which matches semantically corresponding regions to one another.
Our approach can generate semantic surface-to-surface maps, eliminating manual annotations or any 3D training data requirement.
arXiv Detail & Related papers (2023-09-09T16:21:56Z) - Improving Online Lane Graph Extraction by Object-Lane Clustering [106.71926896061686]
We propose an architecture and loss formulation to improve the accuracy of local lane graph estimates.
The proposed method learns to assign the objects to centerlines by considering the centerlines as cluster centers.
We show that our method can achieve significant performance improvements by using the outputs of existing 3D object detection methods.
arXiv Detail & Related papers (2023-07-20T15:21:28Z) - An adaptive human-in-the-loop approach to emission detection of Additive
Manufacturing processes and active learning with computer vision [76.72662577101988]
In-situ monitoring and process control in Additive Manufacturing (AM) allows the collection of large amounts of emission data.
This data can be used as input into 3D and 2D representations of the 3D-printed parts.
The aim of this paper is to propose an adaptive human-in-the-loop approach using Machine Learning techniques.
arXiv Detail & Related papers (2022-12-12T15:11:18Z) - BiometryNet: Landmark-based Fetal Biometry Estimation from Standard
Ultrasound Planes [9.919499846996269]
This paper describes BiometryNet, an end-to-end landmark regression framework for fetal biometry estimation.
It includes a novel Dynamic Orientation Determination (DOD) method for enforcing measurement-specific orientation consistency during network training.
To validate our method, we assembled a dataset of 3,398 ultrasound images from 1,829 subjects acquired in three clinical sites with seven different ultrasound devices.
arXiv Detail & Related papers (2022-06-29T14:32:32Z) - Fully Automated Binary Pattern Extraction For Finger Vein Identification
using Double Optimization Stages-Based Unsupervised Learning Approach [0.0]
Machine learning-based unsupervised, supervised, and deep learning algorithms have had a significant influence on finger vein detection and recognition.
Deep learning necessitates a large number of training datasets that must be manually produced and labeled.
In this research, we offer a completely automated unsupervised learning strategy for training dataset creation.
arXiv Detail & Related papers (2022-05-08T11:01:25Z) - Automated Atlas-based Segmentation of Single Coronal Mouse Brain Slices
using Linear 2D-2D Registration [0.0]
This paper proposes a strategy to automatically segment single 2D coronal slices within a 3D volume of atlas, using linear registration.
We validated its robustness and performance using an exploratory approach at whole-brain scale.
arXiv Detail & Related papers (2021-11-16T12:33:09Z) - Human-in-the-Loop Disinformation Detection: Stance, Sentiment, or
Something Else? [93.91375268580806]
Both politics and pandemics have recently provided ample motivation for the development of machine learning-enabled disinformation (a.k.a. fake news) detection algorithms.
Existing literature has focused primarily on the fully-automated case, but the resulting techniques cannot reliably detect disinformation on the varied topics, sources, and time scales required for military applications.
By leveraging an already-available analyst as a human-in-the-loop, canonical machine learning techniques of sentiment analysis, aspect-based sentiment analysis, and stance detection become plausible methods to use for a partially-automated disinformation detection system.
arXiv Detail & Related papers (2021-11-09T13:30:34Z) - Progressive Spatio-Temporal Bilinear Network with Monte Carlo Dropout
for Landmark-based Facial Expression Recognition with Uncertainty Estimation [93.73198973454944]
The performance of our method is evaluated on three widely used datasets.
It is comparable to that of video-based state-of-the-art methods while it has much less complexity.
arXiv Detail & Related papers (2021-06-08T13:40:30Z) - Automated 3D cephalometric landmark identification using computerized
tomography [1.4349468613117398]
Identification of 3D cephalometric landmarks that serve as proxy to the shape of human skull is the fundamental step in cephalometric analysis.
Recently, automatic landmarking of 2D cephalograms using deep learning (DL) has achieved great success, but 3D landmarking for more than 80 landmarks has not yet reached a satisfactory level.
This paper presents a semi-supervised DL method for 3D landmarking that takes advantage of anonymized landmark dataset with paired CT data being removed.
arXiv Detail & Related papers (2020-12-16T07:29:32Z) - Structured Landmark Detection via Topology-Adapting Deep Graph Learning [75.20602712947016]
We present a new topology-adapting deep graph learning approach for accurate anatomical facial and medical landmark detection.
The proposed method constructs graph signals leveraging both local image features and global shape features.
Experiments are conducted on three public facial image datasets (WFLW, 300W, and COFW-68) as well as three real-world X-ray medical datasets (Cephalometric (public), Hand and Pelvis)
arXiv Detail & Related papers (2020-04-17T11:55:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.