Optimization and Application of Cloud-based Deep Learning Architecture for Multi-Source Data Prediction

• URL: http://arxiv.org/abs/2410.12642v2
• Date: Sat, 04 Jan 2025 00:29:01 GMT
• Title: Optimization and Application of Cloud-based Deep Learning Architecture for Multi-Source Data Prediction
• Abstract summary: This study develops a cloud-based deep learning system for early prediction of diabetes.<n>Early interventions based on predictions lead to a 37.5% reduction in diabetes incidence among the target population.
• Score: 7.447815488813559
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This study develops a cloud-based deep learning system for early prediction of diabetes, leveraging the distributed computing capabilities of the AWS cloud platform and deep learning technologies to achieve efficient and accurate risk assessment. The system utilizes EC2 p3.8xlarge GPU instances to accelerate model training, reducing training time by 93.2% while maintaining a prediction accuracy of 94.2%. With an automated data processing and model training pipeline built using Apache Airflow, the system can complete end-to-end updates within 18.7 hours. In clinical applications, the system demonstrates a prediction accuracy of 89.8%, sensitivity of 92.3%, and specificity of 95.1%. Early interventions based on predictions lead to a 37.5% reduction in diabetes incidence among the target population. The system's high performance and scalability provide strong support for large-scale diabetes prevention and management, showcasing significant public health value.

Related papers

• Ensemble of Convolutional Neural Networks for StrokePrediction: Towards Improved Diagnostic Accuracy [0.0]
  Brain stroke, known for its high mortality and incidence rates, poses significant health risks.<n>Recent advancements in deep learning have led to novel computer-aided diagnostic techniques for early stroke detection.<n>This study proposes an intelligent system that predicts potential strokes using eleven features, evaluated through seven supervised machine learning algorithms.
  arXiv  Detail & Related papers  (2026-08-25T16:09:53Z)
• Scalable Back-End for an AI-Based Diabetes Prediction Application [0.0]
  This paper details the development and evaluation of a scalable back-end system designed for a mobile diabetes prediction application.<n>The architecture leverages horizontal scaling, database sharding, and asynchronous communication via a message queue.<n>The system demonstrated the ability to handle up to 10,000 concurrent users without issues, validating its scalability.
  arXiv  Detail & Related papers  (2025-12-09T00:59:20Z)
• Resource-Efficient Automatic Software Vulnerability Assessment via Knowledge Distillation and Particle Swarm Optimization [8.132644507041922]
  We propose a novel resource-efficient framework that integrates knowledge distillation and particle swarm optimization to enable automated vulnerability assessment.<n>Our framework employs a two-stage approach: First, particle swarm optimization is utilized to optimize the architecture of a compact student model.<n>Second, knowledge distillation is applied to transfer critical vulnerability assessment knowledge from a large teacher model to the optimized student model.
  arXiv  Detail & Related papers  (2025-07-30T13:55:28Z)
• Enhancing Diabetic Retinopathy Classification Accuracy through Dual Attention Mechanism in Deep Learning [2.856144231792095]
  In this work, we combine global attention block (GAB) and category attention block (CAB) into the deep learning model.<n>Our proposed approach is based on an attention mechanism-based deep learning model that employs three pre-trained networks.<n>The proposed approach achieves competitive performance that is at par with recently reported works on DR classification.
  arXiv  Detail & Related papers  (2025-07-25T12:09:27Z)
• SPADE-S: A Sparsity-Robust Foundational Forecaster [31.818058575031888]
  SPADE-S is a robust forecasting architecture that significantly reduces magnitude- and sparsity-based systematic biases and improves overall prediction accuracy.<n>We show that SPADE-S can improve forecast accuracy by up to 15% depending on the quantile forecast and magnitude of the series.
  arXiv  Detail & Related papers  (2025-07-24T19:30:24Z)
• Enhanced Quantile Regression with Spiking Neural Networks for Long-Term System Health Prognostics [0.0]
  This paper presents a novel predictive maintenance framework centered on Enhanced Quantile Regression Neural Networks EQRNNs. We address the challenge of early failure detection through a hybrid approach that combines advanced neural architectures. The framework's effectiveness in processing complex, multi-modal sensor data while maintaining computational efficiency validates its applicability for Industry 4.0 manufacturing environments.
  arXiv  Detail & Related papers  (2025-01-09T09:11:40Z)
• RNN-Based Models for Predicting Seizure Onset in Epileptic Patients [0.0]
  The accuracy and false alarm rates of existing systems are often compromised by their dependence on static thresholds and basic Electroencephalogram (EEG) properties. A novel Recurrent Neural Network (RNN)-based method for seizure start prediction is proposed in the article to overcome these limitations.
  arXiv  Detail & Related papers  (2024-12-24T08:05:01Z)
• Hybrid Forecasting of Geopolitical Events [71.73737011120103]
  SAGE is a hybrid forecasting system that combines human and machine generated forecasts. The system aggregates human and machine forecasts weighting both for propinquity and based on assessed skill. We show that skilled forecasters who had access to machine-generated forecasts outperformed those who only viewed historical data.
  arXiv  Detail & Related papers  (2024-12-14T22:09:45Z)
• A Multi-Modal Non-Invasive Deep Learning Framework for Progressive Prediction of Seizures [10.250114060511134]
  This paper introduces an innovative framework designed for progressive (granular in time to onset) prediction of seizures. Our framework employs advanced Deep Learning (DL) techniques and uses personalized data from a network of non-invasive electroencephalogram (EEG) and electrocardiogram (ECG) sensors. Our model achieves 95% sensitivity, 98% specificity, and 97% accuracy, averaged among 29 patients.
  arXiv  Detail & Related papers  (2024-10-26T04:06:09Z)
• Accessible, At-Home Detection of Parkinson's Disease via Multi-task Video Analysis [3.1851272788128644]
  Existing AI-based Parkinson's Disease detection methods primarily focus on unimodal analysis of motor or speech tasks. We propose a novel Uncertainty-calibrated Fusion Network (UFNet) that leverages this multimodal data to enhance diagnostic accuracy. UFNet significantly outperformed single-task models in terms of accuracy, area under the ROC curve (AUROC), and sensitivity while maintaining non-inferior specificity.
  arXiv  Detail & Related papers  (2024-06-21T04:02:19Z)
• Predicting Lung Disease Severity via Image-Based AQI Analysis using Deep Learning Techniques [0.0]
  The study aims to forecast additional atmospheric pollutants like AQI, PM10, O3, CO, SO2, NO2 in addition to PM2.5 levels. The approach used in this paper uses VGG16 model for feature extraction in images and neural network for predicting AQI. The neural network model for predicting AQI achieved training accuracy of 88.54 % and testing accuracy of 87.44%.
  arXiv  Detail & Related papers  (2024-05-07T03:42:49Z)
• U-PASS: an Uncertainty-guided deep learning Pipeline for Automated Sleep Staging [61.6346401960268]
  We propose a machine learning pipeline called U-PASS tailored for clinical applications that incorporates uncertainty estimation at every stage of the process. We apply our uncertainty-guided deep learning pipeline to the challenging problem of sleep staging and demonstrate that it systematically improves performance at every stage.
  arXiv  Detail & Related papers  (2023-06-07T08:27:36Z)
• Towards Automated COVID-19 Presence and Severity Classification [2.3890320616869425]
  The presented approach follows state-of-theart techniques to aid medical professionals in these situations. The presented model achieves an AUC of 79.0% to predict COVID-19 severity, and 83.7% AUC to classify the presence of an infection.
  arXiv  Detail & Related papers  (2023-05-15T14:07:22Z)
• A Machine Learning Outlook: Post-processing of Global Medium-range Forecasts [0.0]
  Post-processing typically takes the outputs of a Numerical Weather Prediction (NWP) model and applies linear statistical techniques. We show that we can achieve accuracy improvements of up to 12% (RMSE) in a field such as temperature at 850hPa for a 7 day forecast. We discuss the challenges of using standard metrics such as root mean squared error (RMSE) or anomaly correlation coefficient (ACC)
  arXiv  Detail & Related papers  (2023-03-28T20:48:01Z)
• A Meta-Learning Approach to Predicting Performance and Data Requirements [163.4412093478316]
  We propose an approach to estimate the number of samples required for a model to reach a target performance. We find that the power law, the de facto principle to estimate model performance, leads to large error when using a small dataset. We introduce a novel piecewise power law (PPL) that handles the two data differently.
  arXiv  Detail & Related papers  (2023-03-02T21:48:22Z)
• DeepVol: Volatility Forecasting from High-Frequency Data with Dilated Causal Convolutions [53.37679435230207]
  We propose DeepVol, a model based on Dilated Causal Convolutions that uses high-frequency data to forecast day-ahead volatility. Our empirical results suggest that the proposed deep learning-based approach effectively learns global features from high-frequency data.
  arXiv  Detail & Related papers  (2022-09-23T16:13:47Z)
• Robust Trajectory Prediction against Adversarial Attacks [84.10405251683713]
  Trajectory prediction using deep neural networks (DNNs) is an essential component of autonomous driving systems. These methods are vulnerable to adversarial attacks, leading to serious consequences such as collisions. In this work, we identify two key ingredients to defend trajectory prediction models against adversarial attacks.
  arXiv  Detail & Related papers  (2022-07-29T22:35:05Z)
• SOUL: An Energy-Efficient Unsupervised Online Learning Seizure Detection Classifier [68.8204255655161]
  Implantable devices that record neural activity and detect seizures have been adopted to issue warnings or trigger neurostimulation to suppress seizures. For an implantable seizure detection system, a low power, at-the-edge, online learning algorithm can be employed to dynamically adapt to neural signal drifts. SOUL was fabricated in TSMC's 28 nm process occupying 0.1 mm2 and achieves 1.5 nJ/classification energy efficiency, which is at least 24x more efficient than state-of-the-art.
  arXiv  Detail & Related papers  (2021-10-01T23:01:20Z)
• UNITE: Uncertainty-based Health Risk Prediction Leveraging Multi-sourced Data [81.00385374948125]
  We present UNcertaInTy-based hEalth risk prediction (UNITE) model. UNITE provides accurate disease risk prediction and uncertainty estimation leveraging multi-sourced health data. We evaluate UNITE on real-world disease risk prediction tasks: nonalcoholic fatty liver disease (NASH) and Alzheimer's disease (AD) UNITE achieves up to 0.841 in F1 score for AD detection, up to 0.609 in PR-AUC for NASH detection, and outperforms various state-of-the-art baselines by up to $19%$ over the best baseline.
  arXiv  Detail & Related papers  (2020-10-22T02:28:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.