A Comprehensive Dataset and Automated Pipeline for Nailfold Capillary Analysis
- URL: http://arxiv.org/abs/2312.05930v2
- Date: Thu, 14 Mar 2024 15:39:55 GMT
- Title: A Comprehensive Dataset and Automated Pipeline for Nailfold Capillary Analysis
- Authors: Linxi Zhao, Jiankai Tang, Dongyu Chen, Xiaohong Liu, Yong Zhou, Yuanchun Shi, Guangyu Wang, Yuntao Wang,
- Abstract summary: We present a pioneering effort in constructing a comprehensive nailfold capillary dataset-321 images, 219 videos from 68 subjects, with clinic reports and expert annotations.
We finetuned three deep learning models with expert annotations as supervised labels and integrated them into a novel end-to-end nailfold capillary analysis pipeline.
Experiment results showed that our automated pipeline achieves an average of sub-pixel level precision in measurements and 89.9% accuracy in identifying morphological abnormalities.
- Score: 24.8934927577986
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Nailfold capillaroscopy is widely used in assessing health conditions, highlighting the pressing need for an automated nailfold capillary analysis system. In this study, we present a pioneering effort in constructing a comprehensive nailfold capillary dataset-321 images, 219 videos from 68 subjects, with clinic reports and expert annotations-that serves as a crucial resource for training deep-learning models. Leveraging this dataset, we finetuned three deep learning models with expert annotations as supervised labels and integrated them into a novel end-to-end nailfold capillary analysis pipeline. This pipeline excels in automatically detecting and measuring a wide range of size factors, morphological features, and dynamic aspects of nailfold capillaries. We compared our outcomes with clinical reports. Experiment results showed that our automated pipeline achieves an average of sub-pixel level precision in measurements and 89.9% accuracy in identifying morphological abnormalities. These results underscore its potential for advancing quantitative medical research and enabling pervasive computing in healthcare. Our data and code are available at https://github.com/THU-CS-PI-LAB/ANFC-Automated-Nailfold-Capillary.
Related papers
- Weight Space Correlation Analysis: Quantifying Feature Utilization in Deep Learning Models [7.637026905961675]
We introduce Weight Space Correlation Analysis, an interpretable methodology that quantifies feature utilization.<n>We first validate our method by successfully detecting artificially induced shortcut learning.<n>We then apply it to probe the feature utilization of an SA-SonoNet model trained for Spontaneous Preterm Birth.
arXiv Detail & Related papers (2025-12-15T09:52:46Z) - Deep Learning for Taxol Exposure Analysis: A New Cell Image Dataset and Attention-Based Baseline Model [1.755209318470883]
Monitoring the effects of the chemotherapeutic agent Taxol at the cellular level is critical for both clinical evaluation and biomedical research.<n>Deep learning approaches have shown great promise in medical and biological image analysis.<n>No publicly available dataset currently exists for automated morphological analysis of cellular responses to Taxol exposure.
arXiv Detail & Related papers (2025-08-20T01:41:26Z) - Synthetic Data for Blood Vessel Network Extraction [18.95453617434051]
Blood vessel networks in the brain play a crucial role in stroke research, where understanding their topology is essential.
extracting detailed topological vessel network information from microscopy data remains a significant challenge.
This work combines synthetic data generation with deep learning to automatically extract vessel networks as graphs from volumetric microscopy data.
arXiv Detail & Related papers (2025-04-16T08:29:46Z) - Fusing Echocardiography Images and Medical Records for Continuous Patient Stratification [16.93115087698284]
We propose a method to learn the representation of a cardiovascular pathology with a difficult-to-characterize continuum, namely hypertension.
Our method first projects each variable into its own representation space using modality-specific approaches.
These standardized representations of multimodal data are then fed to a transformer encoder, which learns to merge them into a comprehensive representation of the patient through the task of predicting a clinical rating.
We observe the major trends along this continuum on a cohort of 239 hypertensive patients, providing unprecedented details in the description of hypertension's impact on various cardiac function descriptors.
arXiv Detail & Related papers (2024-01-15T16:04:46Z) - Towards Unifying Anatomy Segmentation: Automated Generation of a
Full-body CT Dataset via Knowledge Aggregation and Anatomical Guidelines [113.08940153125616]
We generate a dataset of whole-body CT scans with $142$ voxel-level labels for 533 volumes providing comprehensive anatomical coverage.
Our proposed procedure does not rely on manual annotation during the label aggregation stage.
We release our trained unified anatomical segmentation model capable of predicting $142$ anatomical structures on CT data.
arXiv Detail & Related papers (2023-07-25T09:48:13Z) - Outlier Detection using Self-Organizing Maps for Automated Blood Cell
Analysis [1.2189422792863451]
In this work, we assess the suitability of Self-Organizing Maps for outlier detection on a medical dataset.
We detect and evaluate outliers based on quantization errors and distance maps.
Self-Organizing Maps perform on par with a manually specified filter based on expert domain knowledge.
arXiv Detail & Related papers (2022-08-18T13:53:27Z) - Hepatic vessel segmentation based on 3Dswin-transformer with inductive
biased multi-head self-attention [46.46365941681487]
We propose a robust end-to-end vessel segmentation network called Indu BIased Multi-Head Attention Vessel Net.
We introduce the voxel-wise embedding rather than patch-wise embedding to locate precise liver vessel voxels.
On the other hand, we propose inductive biased multi-head self-attention which learns inductive biased relative positional embedding from absolute position embedding.
arXiv Detail & Related papers (2021-11-05T10:17:08Z) - HINT: Hierarchical Interaction Network for Trial Outcome Prediction
Leveraging Web Data [56.53715632642495]
Clinical trials face uncertain outcomes due to issues with efficacy, safety, or problems with patient recruitment.
In this paper, we propose Hierarchical INteraction Network (HINT) for more general, clinical trial outcome predictions.
arXiv Detail & Related papers (2021-02-08T15:09:07Z) - A smartphone based multi input workflow for non-invasive estimation of
haemoglobin levels using machine learning techniques [0.2519906683279153]
A combination of image processing, machine learning and deep learning techniques are employed to develop predictive models to measure haemoglobin levels.
This is achieved through the color analysis of the fingernail beds, palpebral conjunctiva and tongue of the patients.
arXiv Detail & Related papers (2020-11-29T13:57:09Z) - Towards an Automatic Analysis of CHO-K1 Suspension Growth in
Microfluidic Single-cell Cultivation [63.94623495501023]
We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data.
Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
arXiv Detail & Related papers (2020-10-20T08:36:51Z) - Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype
Prediction [55.94378672172967]
We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients.
We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks.
Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
arXiv Detail & Related papers (2020-09-02T02:50:30Z) - Trajectories, bifurcations and pseudotime in large clinical datasets:
applications to myocardial infarction and diabetes data [94.37521840642141]
We suggest a semi-supervised methodology for the analysis of large clinical datasets, characterized by mixed data types and missing values.
The methodology is based on application of elastic principal graphs which can address simultaneously the tasks of dimensionality reduction, data visualization, clustering, feature selection and quantifying the geodesic distances (pseudotime) in partially ordered sequences of observations.
arXiv Detail & Related papers (2020-07-07T21:04:55Z) - BS-Net: learning COVID-19 pneumonia severity on a large Chest X-Ray
dataset [6.5800499500032705]
We design an end-to-end deep learning architecture for predicting, on Chest X-rays images (CXR), a multi-regional score conveying the degree of lung compromise in COVID-19 patients.
We exploit a clinical dataset of almost 5,000 CXR annotated images collected in the same hospital.
Our solution outperforms single human annotators in rating accuracy and consistency.
arXiv Detail & Related papers (2020-06-08T13:55:58Z) - An Extensive Study on Cross-Dataset Bias and Evaluation Metrics
Interpretation for Machine Learning applied to Gastrointestinal Tract
Abnormality Classification [2.985964157078619]
Automatic analysis of diseases in the GI tract is a hot topic in computer science and medical-related journals.
A clear understanding of evaluation metrics and machine learning models with cross datasets is crucial to bring research in the field to a new quality level.
We present comprehensive evaluations of five distinct machine learning models that can classify 16 different GI tract conditions.
arXiv Detail & Related papers (2020-05-08T08:59:31Z) - Self-Training with Improved Regularization for Sample-Efficient Chest
X-Ray Classification [80.00316465793702]
We present a deep learning framework that enables robust modeling in challenging scenarios.
Our results show that using 85% lesser labeled data, we can build predictive models that match the performance of classifiers trained in a large-scale data setting.
arXiv Detail & Related papers (2020-05-03T02:36:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.