Dynamic Uncertainty-aware Multimodal Fusion for Outdoor Health Monitoring

• URL: http://arxiv.org/abs/2508.09085v1
• Date: Tue, 12 Aug 2025 17:07:27 GMT
• Title: Dynamic Uncertainty-aware Multimodal Fusion for Outdoor Health Monitoring
• Authors: Zihan Fang, Zheng Lin, Senkang Hu, Yihang Tao, Yiqin Deng, Xianhao Chen, Yuguang Fang,
• Abstract summary: Multimodal large language models (MLLMs) emerge as a promising alternative.<n> MLLMs fail to capture subtle health status changes due to input and fluctuation noise.<n>We propose a multimodal fusion framework, named multimodal-Health, for outdoor health monitoring in dynamic and noisy environments.
• Score: 14.465453649354531
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Outdoor health monitoring is essential to detect early abnormal health status for safeguarding human health and safety. Conventional outdoor monitoring relies on static multimodal deep learning frameworks, which requires extensive data training from scratch and fails to capture subtle health status changes. Multimodal large language models (MLLMs) emerge as a promising alternative, utilizing only small datasets to fine-tune pre-trained information-rich models for enabling powerful health status monitoring. Unfortunately, MLLM-based outdoor health monitoring also faces significant challenges: I) sensor data contains input noise stemming from sensor data acquisition and fluctuation noise caused by sudden changes in physiological signals due to dynamic outdoor environments, thus degrading the training performance; ii) current transformer based MLLMs struggle to achieve robust multimodal fusion, as they lack a design for fusing the noisy modality; iii) modalities with varying noise levels hinder accurate recovery of missing data from fluctuating distributions. To combat these challenges, we propose an uncertainty-aware multimodal fusion framework, named DUAL-Health, for outdoor health monitoring in dynamic and noisy environments. First, to assess the impact of noise, we accurately quantify modality uncertainty caused by input and fluctuation noise with current and temporal features. Second, to empower efficient muitimodal fusion with low-quality modalities,we customize the fusion weight for each modality based on quantified and calibrated uncertainty. Third, to enhance data recovery from fluctuating noisy modalities, we align modality distributions within a common semantic space. Extensive experiments demonstrate that our DUAL-Health outperforms state-of-the-art baselines in detection accuracy and robustness.

Related papers

• Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classification [55.56234913868664]
  We propose Test-time Adaptive Hierarchical Co-enhanced Denoising Network (TAHCD) for reliable learning on multimodal data.<n>The proposed method achieves superior classification performance, robustness, and generalization compared with state-of-the-art reliable multimodal learning approaches.
  arXiv  Detail & Related papers  (2026-01-12T03:14:12Z)
• Establishing Stochastic Object Models from Noisy Data via Ambient Measurement-Integrated Diffusion [5.400762197932078]
  AMID establishes clean SOMs directly from noisy measurements.<n>Experiments on real CT and mammography datasets show that AMID outperforms existing methods in generation fidelity.
  arXiv  Detail & Related papers  (2025-12-16T08:33:08Z)
• FedGSCA: Medical Federated Learning with Global Sample Selector and Client Adaptive Adjuster under Label Noise [3.5585588724306643]
  Federated Learning (FL) emerged as a solution for collaborative medical image classification while preserving data privacy.<n>We propose FedGSCA, a novel framework for enhancing robustness in noisy medical FL.<n>We evaluate FedGSCA on one real-world colon slides dataset and two synthetic medical datasets under various noise conditions.
  arXiv  Detail & Related papers  (2025-07-13T08:51:51Z)
• Data-Driven Reconstruction and Characterization of Stochastic Dynamics via Dynamical Mode Decomposition [0.0]
  Noise limits the performance and predictive capabilities of classical and quantum dynamical systems.<n>We introduce a general, data-driven framework based on Dynamical Mode Decomposition (DMD) to analyze system dynamics under noise.<n>This methodology provides a broadly applicable tool for diagnostic, predictive, noise mitigation analyses, and control in complex systems.
  arXiv  Detail & Related papers  (2025-07-08T08:59:06Z)
• FM2S: Towards Spatially-Correlated Noise Modeling in Zero-Shot Fluorescence Microscopy Image Denoising [33.383511185170214]
  Fluorescence Micrograph to Self (FM2S) is a zero-shot denoiser that achieves efficient Fluorescence Micrograph to Self (FM2S) denoising through three key innovations.<n>Experiments across FMI datasets demonstrate FM2S's superiority: It outperforms CVF-SID by 1.4dB PSNR on average while requiring 0.1% parameters of AP-BSN.
  arXiv  Detail & Related papers  (2024-12-13T10:45:25Z)
• Explainable Differential Privacy-Hyperdimensional Computing for Balancing Privacy and Transparency in Additive Manufacturing Monitoring [5.282482641822561]
  This study introduces the Differential Privacy-Hyperdimensional Computing (DP-HD) framework.<n>DP-HD enables precise tuning of DP noise levels, ensuring an optimal balance between privacy and performance.<n>It holds substantial promise for broader applications in privacy-sensitive domains such as healthcare, financial services, and government data management.
  arXiv  Detail & Related papers  (2024-07-09T17:42:26Z)
• Stable Neighbor Denoising for Source-free Domain Adaptive Segmentation [91.83820250747935]
  Pseudo-label noise is mainly contained in unstable samples in which predictions of most pixels undergo significant variations during self-training. We introduce the Stable Neighbor Denoising (SND) approach, which effectively discovers highly correlated stable and unstable samples. SND consistently outperforms state-of-the-art methods in various SFUDA semantic segmentation settings.
  arXiv  Detail & Related papers  (2024-06-10T21:44:52Z)
• Amplitude-Varying Perturbation for Balancing Privacy and Utility in Federated Learning [86.08285033925597]
  This paper presents a new DP perturbation mechanism with a time-varying noise amplitude to protect the privacy of federated learning. We derive an online refinement of the series to prevent FL from premature convergence resulting from excessive perturbation noise. The contribution of the new DP mechanism to the convergence and accuracy of privacy-preserving FL is corroborated, compared to the state-of-the-art Gaussian noise mechanism with a persistent noise amplitude.
  arXiv  Detail & Related papers  (2023-03-07T22:52:40Z)
• The role of noise in denoising models for anomaly detection in medical images [62.0532151156057]
  Pathological brain lesions exhibit diverse appearance in brain images. Unsupervised anomaly detection approaches have been proposed using only normal data for training. We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
  arXiv  Detail & Related papers  (2023-01-19T21:39:38Z)
• Improve Noise Tolerance of Robust Loss via Noise-Awareness [60.34670515595074]
  We propose a meta-learning method which is capable of adaptively learning a hyper parameter prediction function, called Noise-Aware-Robust-Loss-Adjuster (NARL-Adjuster for brevity) Four SOTA robust loss functions are attempted to be integrated with our algorithm, and comprehensive experiments substantiate the general availability and effectiveness of the proposed method in both its noise tolerance and performance.
  arXiv  Detail & Related papers  (2023-01-18T04:54:58Z)
• PulseImpute: A Novel Benchmark Task for Pulsative Physiological Signal Imputation [54.839600943189915]
  Mobile Health (mHealth) is the ability to use wearable sensors to monitor participant physiology at high frequencies during daily life to enable temporally-precise health interventions. Despite a rich imputation literature, existing techniques are ineffective for the pulsative signals which comprise many mHealth applications. We address this gap with PulseImpute, the first large-scale pulsative signal imputation challenge which includes realistic mHealth missingness models, an extensive set of baselines, and clinically-relevant downstream tasks.
  arXiv  Detail & Related papers  (2022-12-14T21:39:15Z)
• AMSER: Adaptive Multi-modal Sensing for Energy Efficient and Resilient eHealth Systems [5.04685484754788]
  Noisy inputs and motion artifacts during sensory data acquisition affect prediction accuracy and resilience of eHealth services. We propose a closed-loop monitoring and control framework for multi-modal eHealth applications, AMSER, that can mitigate garbage-in garbage-out. Our approach achieves up to 22% improvement in prediction accuracy and 5.6$times$ energy consumption reduction in the sensing phase.
  arXiv  Detail & Related papers  (2021-12-13T00:52:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.