Full-Self Diagnostics (FSD): Physics-Grounded Visual Biomarker Inference from Smartphone Video via Inverse Problems and Operator Learning

• URL: http://arxiv.org/abs/2606.19372v1
• Date: Thu, 11 Jun 2026 20:26:47 GMT
• Title: Full-Self Diagnostics (FSD): Physics-Grounded Visual Biomarker Inference from Smartphone Video via Inverse Problems and Operator Learning
• Abstract summary: Full-Self Diagnostics (FSD) is a unified mathematical framework for recovering latent physiological states from unconstrained 9-second facial videos.<n> Empirical validation on 38812 real-world paired scans across 59 subjects demonstrates practical performance.<n>Results confirm that consumer-grade facial video encodes sufficient structured information for clinically relevant, non-invasive inference under fully unconstrained conditions.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present Full-Self Diagnostics (FSD), a unified mathematical framework for recovering latent physiological states from unconstrained 9-second facial videos captured by consumer smartphones. The approach integrates five mutually reinforcing components: (1) a physics-based forward model derived from the radiative transfer equation and chromophore absorption that maps camera observables to biomarker concentrations; (2) an information-theoretic observability theory proving that multi-channel visual signals (spectral, pulse, respiratory, micro-expression, and oculomotor) contain strictly increasing mutual information with physiological state; (3) a stable, Tikhonov-regularized inverse problem with domain-uniform identifiability guarantees; (4) an operator-learning formulation that enables generalization across devices, resolutions, and populations; and (5) a supervised learning procedure, interpretable as stochastic variational inference, that continuously refines the model from paired biosensor ground truth with performance improving proportionally to one over the square root of the number of paired observations. Empirical validation on 38812 real-world paired scans across 59 subjects demonstrates practical performance. Self-collected data from the lead author (glucose range 35-550 mg/dL) yields MARD of 29.86 percent with 97.57 percent of predictions in Clarke Error Grid Zones A+B and only 0.27 percent in the dangerous Zone E. A well-managed diabetic participant achieves MARD of 17 percent in the narrower 70-180 mg/dL band. These results confirm that consumer-grade facial video encodes sufficient structured information for clinically relevant, non-invasive biomarker inference under fully unconstrained conditions, with performance scaling predictably as more paired data becomes available.

Related papers

• EMFE: A lightweight, explainable machine learning framework for malaria cell classification [0.7437884690206271]
  Automated malaria diagnosis from stained blood-smear microscopy is dominated by deep convolutional neural networks.<n>We present EMFE, a five-feature framework for classifying single red-blood-cell images as parasitized or uninfected.
  arXiv  Detail & Related papers  (2026-08-25T16:38:04Z)
• MARVEL: Universal Murray's Law-informed Vessel Tree Segmentation and Topology Estimation [75.40785674602147]
  Deep learning methods for vascular segmentation often neglect biophysical constraints.<n>This leads to physiologically implausible branching and misclassification vascular trees.<n>We introduce MARVEL, a backbone-agnostic framework that integrates biophysical priors into vascular tree extraction.
  arXiv  Detail & Related papers  (2026-05-25T02:32:29Z)
• Towards a General Intelligence and Interface for Wearable Health Data [45.854819784803055]
  We propose a foundation model for wearable health that is pretrained on more than one trillion minutes of unlabeled sensor signals.<n>We find that this population scale representation unlocks label-efficient few-shot learning and generative capabilities for robust daily metric estimation.
  arXiv  Detail & Related papers  (2026-05-21T17:24:06Z)
• MobileDenseAttn:A Dual-Stream Architecture for Accurate and Interpretable Brain Tumor Detection [0.0]
  We introduce MobileDenseAttn, a fusion model of MobileNetV2 and DenseNet201.<n>MobileDenseAttn is trained on an augmented dataset of 6,020 MRI scans representing glioma, meningioma, pituitary tumors, and normal samples.<n>It provides a training accuracy of 99.75%, a testing accuracy of 98.35%, and a stable F1 score of 0.9835.
  arXiv  Detail & Related papers  (2025-08-22T13:24:38Z)
• HANS-Net: Hyperbolic Convolution and Adaptive Temporal Attention for Accurate and Generalizable Liver and Tumor Segmentation in CT Imaging [2.7205074719266062]
  Accurate liver and tumor segmentation on abdominal CT images is critical for reliable diagnosis and treatment planning.<n>We introduce Hyperbolic-convolutions Adaptive-temporal-attention with Neural-representation and Synaptic-plasticity Network (HANS-Net)<n>HANS-Net combines hyperbolic convolutions for hierarchical geometric representation, a wavelet-inspired decomposition module for multi-scale texture learning, and an implicit neural representation branch.
  arXiv  Detail & Related papers  (2025-07-15T13:56:37Z)
• Finetuning and Quantization of EEG-Based Foundational BioSignal Models on ECG and PPG Data for Blood Pressure Estimation [46.36100528165335]
  Photoplethysmography and electrocardiography can potentially enable continuous blood pressure (BP) monitoring.<n>Yet accurate and robust machine learning (ML) models remains challenging due to variability in data quality and patient-specific factors.<n>In this work, we investigate whether a model pre-trained on one modality can effectively be exploited to improve the accuracy of a different signal type.<n>Our approach achieves near state-of-the-art accuracy for diastolic BP and surpasses by 1.5x the accuracy of prior works for systolic BP.
  arXiv  Detail & Related papers  (2025-02-10T13:33:12Z)
• EVolutionary Independent DEtermiNistiC Explanation [5.127310126394387]
  This paper introduces the Evolutionary Independent Deterministic Explanation (EVIDENCE) theory.<n>EVIDENCE offers a deterministic, model-independent method for extracting significant signals from black-box models.<n> Practical applications of EVIDENCE include improving diagnostic accuracy in healthcare and enhancing audio signal analysis.
  arXiv  Detail & Related papers  (2025-01-20T12:05:14Z)
• An Attention-Guided Deep Learning Approach for Classifying 39 Skin Lesion Types [0.9467360130705921]
  This study advances the field by curating a comprehensive and diverse dataset comprising 39 categories of skin lesions.<n>Five state-of-the-art deep learning models -- MobileNetV2, Xception, InceptionV3, EfficientNetB1, and Vision Transformer - are rigorously evaluated.<n>The Vision Transformer model integrated with CBAM outperforms others, achieving an accuracy of 93.46%, precision of 94%, recall of 93%, F1-score of 93%, and specificity of 93.67%.
  arXiv  Detail & Related papers  (2025-01-10T14:25:01Z)
• AXIAL: Attention-based eXplainability for Interpretable Alzheimer's Localized Diagnosis using 2D CNNs on 3D MRI brain scans [43.06293430764841]
  This study presents an innovative method for Alzheimer's disease diagnosis using 3D MRI designed to enhance the explainability of model decisions. Our approach adopts a soft attention mechanism, enabling 2D CNNs to extract volumetric representations. With voxel-level precision, our method identified which specific areas are being paid attention to, identifying these predominant brain regions.
  arXiv  Detail & Related papers  (2024-07-02T16:44:00Z)
• Generative models improve fairness of medical classifiers under distribution shifts [49.10233060774818]
  We show that learning realistic augmentations automatically from data is possible in a label-efficient manner using generative models. We demonstrate that these learned augmentations can surpass ones by making models more robust and statistically fair in- and out-of-distribution.
  arXiv  Detail & Related papers  (2023-04-18T18:15:38Z)
• Federated Learning Enables Big Data for Rare Cancer Boundary Detection [98.5549882883963]
  We present findings from the largest Federated ML study to-date, involving data from 71 healthcare institutions across 6 continents. We generate an automatic tumor boundary detector for the rare disease of glioblastoma. We demonstrate a 33% improvement over a publicly trained model to delineate the surgically targetable tumor, and 23% improvement over the tumor's entire extent.
  arXiv  Detail & Related papers  (2022-04-22T17:27:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.