Bug Severity Prediction in Software Projects Using Supervised Machine Learning Models

• URL: http://arxiv.org/abs/2603.00004v1
• Date: Fri, 09 Jan 2026 05:06:43 GMT
• Title: Bug Severity Prediction in Software Projects Using Supervised Machine Learning Models
• Abstract summary: This study compares different classifiers based on supervised machine learning algorithms for predicting bug severity levels.<n>Models were evaluated in terms of accuracy, precision, recall, F1 score, (AUC-ROC) and confusion matrix.
• Score: 0.0
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Bug severity prediction is important in software maintenance, because it helps the development teams to prioritize bugs that have a significant impact on the operation, stability and security of the system. In large software projects bug repositories will grow at very rapid rate making classification of severity manual work labourious and unreliable and prone to human biasness. Many efforts have thus been dedicated on automated ways of severity prediction in the literature of software engineering research.This study compares different classifiers that are based on supervised machine learning algorithms for predicting bug severity levels using historical repository data from Eclipse Bugzilla. Evaluated methods range from linear classifiers, gradient boosting trees, distance method and transformer-based models, and text features, which are obtained from tokenization, TF-IDF, and n-grams and imbalance correction methods. Models were evaluated in terms of accuracy, precision, recall, F1 score, (AUC-ROC) and confusion matrix. Ensemble tree methods and DistilBERT achieved the top overall accuracy, while linear models performed best in recall of critical bugs which indicates some precision-recall tradeoff in imbalanced severity prediction. These findings provide useful actionable insight in choosing algorithms for automated bug triage, which can improve the quality of software through effective scalable prioritization. Keywords: Bug severity prediction, Supervised machine learning, Classification models, Software quality assurance, Historical bug data, Predictive analytics.

Related papers

• Bug Priority Change Prediction: An Exploratory Study on Apache Software [7.264561489832595]
  We propose a novel two-phase bug report priority change prediction method based on bug fixing evolution features and class imbalance handling strategy.<n>To evaluate the performance of our method, we conducted experiments on a bug dataset constructed from 32 non-trivial Apache projects.
  arXiv  Detail & Related papers  (2025-12-10T00:59:51Z)
• BugPilot: Complex Bug Generation for Efficient Learning of SWE Skills [59.003563837981886]
  High quality bugs are key to training the next generation of language model based software engineering (SWE) agents.<n>We introduce a novel method for synthetic generation of difficult and diverse bugs.
  arXiv  Detail & Related papers  (2025-10-22T17:58:56Z)
• Bug Destiny Prediction in Large Open-Source Software Repositories through Sentiment Analysis and BERT Topic Modeling [3.481985817302898]
  We leverage features available before a bug is resolved to enhance predictive accuracy.<n>Our methodology incorporates sentiment analysis to derive both an emotionality score and a sentiment classification.<n>Results demonstrate that sentiment analysis serves as a valuable predictor of a bug's eventual outcome.
  arXiv  Detail & Related papers  (2025-04-22T15:18:14Z)
• Learning to Solve and Verify: A Self-Play Framework for Code and Test Generation [69.62857948698436]
  Recent advances in large language models (LLMs) have improved their performance on coding benchmarks.<n>However, improvement is plateauing due to the exhaustion of readily available high-quality data.<n>We propose Sol-Ver, a self-play solver-verifier framework that jointly improves a single model's code and test generation capacity.
  arXiv  Detail & Related papers  (2025-02-20T18:32:19Z)
• Focused-DPO: Enhancing Code Generation Through Focused Preference Optimization on Error-Prone Points [51.40935517552926]
  We introduce Focused-DPO, a framework that enhances code generation by directing preference optimization towards critical error-prone areas.<n>By focusing on error-prone points, Focused-DPO advances the accuracy and functionality of model-generated code.
  arXiv  Detail & Related papers  (2025-02-17T06:16:02Z)
• Feature Importance in the Context of Traditional and Just-In-Time Software Defect Prediction Models [5.1868909177638125]
  This study developed defect prediction models incorporating the traditional and the Just-In-Time approaches from the publicly available dataset of the Apache Camel project. A multi-layer deep learning algorithm was applied to these datasets in comparison with machine learning algorithms. The deep learning algorithm achieved accuracies of 80% and 86%, with the area under receiving operator curve (AUC) scores of 66% and 78% for traditional and Just-In-Time defect prediction, respectively.
  arXiv  Detail & Related papers  (2024-11-07T22:49:39Z)
• Method-Level Bug Severity Prediction using Source Code Metrics and LLMs [0.628122931748758]
  We investigate source code metrics, source code representation using large language models (LLMs), and their combination in predicting bug severity labels. Our results suggest that Decision Tree and Random Forest models outperform other models regarding our several evaluation metrics. CodeBERT finetuning improves the bug severity prediction results significantly in the range of 29%-140% for several evaluation metrics.
  arXiv  Detail & Related papers  (2023-09-06T14:38:07Z)
• Explainable Software Defect Prediction from Cross Company Project Metrics Using Machine Learning [5.829545587965401]
  This study focuses on developing defect prediction models that apply various machine learning algorithms. One notable issue in existing defect prediction studies is the lack of transparency in the developed models.
  arXiv  Detail & Related papers  (2023-06-14T17:46:08Z)
• Learning Sample Difficulty from Pre-trained Models for Reliable Prediction [55.77136037458667]
  We propose to utilize large-scale pre-trained models to guide downstream model training with sample difficulty-aware entropy regularization. We simultaneously improve accuracy and uncertainty calibration across challenging benchmarks.
  arXiv  Detail & Related papers  (2023-04-20T07:29:23Z)
• On The Effectiveness of One-Class Support Vector Machine in Different Defect Prediction Scenarios [7.592094566354553]
  Defect prediction aims at identifying software components that are likely to cause faults before a software is made available to the end-user. Previous studies show that One-Class Support Vector Machine (OCSVM) can outperform two-class classifiers for within-project defect prediction. We investigate whether learning from one class only is sufficient to produce effective defect prediction model in two other different scenarios.
  arXiv  Detail & Related papers  (2022-02-24T12:57:14Z)
• Leveraging Unlabeled Data to Predict Out-of-Distribution Performance [63.740181251997306]
  Real-world machine learning deployments are characterized by mismatches between the source (training) and target (test) distributions. In this work, we investigate methods for predicting the target domain accuracy using only labeled source data and unlabeled target data. We propose Average Thresholded Confidence (ATC), a practical method that learns a threshold on the model's confidence, predicting accuracy as the fraction of unlabeled examples.
  arXiv  Detail & Related papers  (2022-01-11T23:01:12Z)
• ALT-MAS: A Data-Efficient Framework for Active Testing of Machine Learning Algorithms [58.684954492439424]
  We propose a novel framework to efficiently test a machine learning model using only a small amount of labeled test data. The idea is to estimate the metrics of interest for a model-under-test using Bayesian neural network (BNN)
  arXiv  Detail & Related papers  (2021-04-11T12:14:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.