Optimization of Transformer heart disease prediction model based on particle swarm optimization algorithm

• URL: http://arxiv.org/abs/2412.02801v3
• Date: Tue, 07 Jan 2025 10:09:18 GMT
• Title: Optimization of Transformer heart disease prediction model based on particle swarm optimization algorithm
• Authors: Jingyuan Yi, Peiyang Yu, Tianyi Huang, Zeqiu Xu,
• Abstract summary: This paper proposes an improved Transformer model to improve the accuracy of heart disease prediction.<n>We first use three mainstream machine learning classification algorithms - decision tree, random forest and XGBoost.<n>The results show that the random forest model had the best performance in predicting the classification of heart disease, with an accuracy of 92.2%.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Aiming at the latest particle swarm optimization algorithm, this paper proposes an improved Transformer model to improve the accuracy of heart disease prediction and provide a new algorithm idea. We first use three mainstream machine learning classification algorithms - decision tree, random forest and XGBoost, and then output the confusion matrix of these three models. The results showed that the random forest model had the best performance in predicting the classification of heart disease, with an accuracy of 92.2%. Then, we apply the Transformer model based on particle swarm optimization (PSO) algorithm to the same dataset for classification experiment. The results show that the classification accuracy of the model is as high as 96.5%, 4.3 percentage points higher than that of random forest, which verifies the effectiveness of PSO in optimizing Transformer model. From the above research, we can see that particle swarm optimization significantly improves Transformer performance in heart disease prediction. Improving the ability to predict heart disease is a global priority with benefits for all humankind. Accurate prediction can enhance public health, optimize medical resources, and reduce healthcare costs, leading to healthier populations and more productive societies worldwide. This advancement paves the way for more efficient health management and supports the foundation of a healthier, more resilient global community.

Related papers

• Integrating Vision and Location with Transformers: A Multimodal Deep Learning Framework for Medical Wound Analysis [0.0]
  Deep learning (DL) has emerged as a powerful tool in wound diagnosis. A body map was also created to provide location data, which can help wound specialists label wound locations more effectively. The proposed model was able to achieve an accuracy of 0.8123 using image data and an accuracy of 0.8007 using a combination of image data and wound location.
  arXiv  Detail & Related papers  (2025-04-14T17:39:18Z)
• Enhancing Skin Cancer Diagnosis (SCD) Using Late Discrete Wavelet Transform (DWT) and New Swarm-Based Optimizers [0.0]
  Skin cancer stands out as one of the most life-threatening forms of cancer, with its danger amplified if not diagnosed and treated promptly.<n>Deep Learning has emerged as a powerful tool in the early detection and skin cancer diagnosis (SCD)<n>This paper proposes a novel approach to skin cancer detection, utilizing optimization techniques in conjunction with pre-trained networks and wavelet transformations.
  arXiv  Detail & Related papers  (2024-11-30T13:17:52Z)
• Randomized-Grid Search for Hyperparameter Tuning in Decision Tree Model to Improve Performance of Cardiovascular Disease Classification [0.0]
  Heart disease classification using machine learning (ML) algorithms such as Support Vector Machine(SVM), Na"ive Bayes(NB), Decision Trees (DTs) and Random Forests (RFs) are often hindered by overfitting.<n>Grid Search, though exhaustive, but, it is computationally expensive and inefficient, particularly with high-dimensional data.<n>Rational-Grid Search, though exhaustive, but, it is computationally expensive and inefficient, particularly with high-dimensional data.
  arXiv  Detail & Related papers  (2024-11-27T11:10:28Z)
• PredFormer: Transformers Are Effective Spatial-Temporal Predictive Learners [65.93130697098658]
  This paper proposes PredFormer, a pure transformer-based framework for predictive learning. With its recurrent-free, transformer-based design, PredFormer is both simple and efficient. experiments on synthetic and real-world datasets demonstrate that PredFormer achieves state-the-art performance.
  arXiv  Detail & Related papers  (2024-10-07T03:52:06Z)
• Brain Tumor Classification on MRI in Light of Molecular Markers [61.77272414423481]
  Co-deletion of the 1p/19q gene is associated with clinical outcomes in low-grade gliomas. This study aims to utilize a specially MRI-based convolutional neural network for brain cancer detection.
  arXiv  Detail & Related papers  (2024-09-29T07:04:26Z)
• Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimation [68.75387874066647]
  We propose an Uncertainty-Aware testing-time optimization framework for 3D human pose estimation. Our approach outperforms the previous best result by a large margin of 4.5% on Human3.6M.
  arXiv  Detail & Related papers  (2024-02-04T04:28:02Z)
• An Improved Grey Wolf Optimization Algorithm for Heart Disease Prediction [5.489867271342724]
  We present a unique solution to challenges in medical image processing by incorporating an adaptive curve grey wolf optimization (ACGWO) algorithm into neural network backpropagation. Our technique surpasses ten other methods, achieving 86.8% accuracy, indicating its potential for efficient heart disease prediction in the clinical setting.
  arXiv  Detail & Related papers  (2024-01-22T03:07:24Z)
• Dataset Optimization for Chronic Disease Prediction with Bio-Inspired Feature Selection [0.32634122554913997]
  The study contributes to the advancement of predictive analytics in the realm of chronic diseases. The potential impact of this work extends to early intervention, precision medicine, and improved patient outcomes.
  arXiv  Detail & Related papers  (2023-12-17T18:18:34Z)
• Gradual Optimization Learning for Conformational Energy Minimization [69.36925478047682]
  Gradual Optimization Learning Framework (GOLF) for energy minimization with neural networks significantly reduces the required additional data. Our results demonstrate that the neural network trained with GOLF performs on par with the oracle on a benchmark of diverse drug-like molecules.
  arXiv  Detail & Related papers  (2023-11-05T11:48:08Z)
• A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks [65.34977803841007]
  Predictive coding networks are neuroscience-inspired models with roots in both Bayesian statistics and neuroscience. We show how by simply changing the temporal scheduling of the update rule for the synaptic weights leads to an algorithm that is much more efficient and stable than the original one.
  arXiv  Detail & Related papers  (2022-11-16T00:11:04Z)
• Cervical Cytology Classification Using PCA & GWO Enhanced Deep Features Selection [1.990876596716716]
  Cervical cancer is one of the most deadly and common diseases among women worldwide. We propose a fully automated framework that utilizes Deep Learning and feature selection. The framework is evaluated on three publicly available benchmark datasets.
  arXiv  Detail & Related papers  (2021-06-09T08:57:22Z)
• Resource Planning for Hospitals Under Special Consideration of the COVID-19 Pandemic: Optimization and Sensitivity Analysis [87.31348761201716]
  Crises like the COVID-19 pandemic pose a serious challenge to health-care institutions. BaBSim.Hospital is a tool for capacity planning based on discrete event simulation. We aim to investigate and optimize these parameters to improve BaBSim.Hospital.
  arXiv  Detail & Related papers  (2021-05-16T12:38:35Z)
• AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights [53.8489656709356]
  Normalization techniques are a boon for modern deep learning. It is often overlooked, however, that the additional introduction of momentum results in a rapid reduction in effective step sizes for scale-invariant weights. In this paper, we verify that the widely-adopted combination of the two ingredients lead to the premature decay of effective step sizes and sub-optimal model performances.
  arXiv  Detail & Related papers  (2020-06-15T08:35:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.