SQAPlanner: Generating Data-InformedSoftware Quality Improvement Plans
- URL: http://arxiv.org/abs/2102.09687v1
- Date: Fri, 19 Feb 2021 00:17:28 GMT
- Title: SQAPlanner: Generating Data-InformedSoftware Quality Improvement Plans
- Authors: Dilini Rajapaksha, Chakkrit Tantithamthavorn, Jirayus Jiarpakdee,
Christoph Bergmeir, John Grundy, and Wray Buntine
- Abstract summary: We develop and evaluate an information visualization for our SQAPlanner approach.
We find that 80% of our survey respondents perceived that our visualization is more actionable.
- Score: 10.032135866890384
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Software Quality Assurance (SQA) planning aims to define proactive plans,
such as defining maximum file size, to prevent the occurrence of software
defects in future releases. To aid this, defect prediction models have been
proposed to generate insights as the most important factors that are associated
with software quality. Such insights that are derived from traditional defect
models are far from actionable-i.e., practitioners still do not know what they
should do or avoid to decrease the risk of having defects, and what is the risk
threshold for each metric. A lack of actionable guidance and risk threshold can
lead to inefficient and ineffective SQA planning processes. In this paper, we
investigate the practitioners' perceptions of current SQA planning activities,
current challenges of such SQA planning activities, and propose four types of
guidance to support SQA planning. We then propose and evaluate our AI-Driven
SQAPlanner approach, a novel approach for generating four types of guidance and
their associated risk thresholds in the form of rule-based explanations for the
predictions of defect prediction models. Finally, we develop and evaluate an
information visualization for our SQAPlanner approach. Through the use of
qualitative survey and empirical evaluation, our results lead us to conclude
that SQAPlanner is needed, effective, stable, and practically applicable. We
also find that 80% of our survey respondents perceived that our visualization
is more actionable. Thus, our SQAPlanner paves a way for novel research in
actionable software analytics-i.e., generating actionable guidance on what
should practitioners do and not do to decrease the risk of having defects to
support SQA planning.
Related papers
- Know Where You're Uncertain When Planning with Multimodal Foundation Models: A Formal Framework [54.40508478482667]
We present a comprehensive framework to disentangle, quantify, and mitigate uncertainty in perception and plan generation.
We propose methods tailored to the unique properties of perception and decision-making.
We show that our uncertainty disentanglement framework reduces variability by up to 40% and enhances task success rates by 5% compared to baselines.
arXiv Detail & Related papers (2024-11-03T17:32:00Z) - Causal Reasoning in Software Quality Assurance: A Systematic Review [11.887059800587672]
This study provides a systematic review of the scientific literature on causal reasoning for SQA.
Fault localization is the activity where causal reasoning is more exploited, especially in the web services/microservices domain.
tools to favour their application are appearing at a fast pace - most of them after 2021.
arXiv Detail & Related papers (2024-08-30T10:34:11Z) - Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness [34.77182116081535]
Integrated task and motion planning (TAMP) has proven to be a valuable approach to generalizable long-horizon robotic manipulation and navigation problems.
These assumptions limit the ability of the planner to gather information and make decisions that are risk-aware.
We propose a strategy for TAMP with Uncertainty and Risk Awareness (TAMPURA) that is capable of efficiently solving long-horizon planning problems with initial-state and action outcome uncertainty.
arXiv Detail & Related papers (2024-03-15T16:42:14Z) - Learning Logic Specifications for Policy Guidance in POMDPs: an
Inductive Logic Programming Approach [57.788675205519986]
We learn high-quality traces from POMDP executions generated by any solver.
We exploit data- and time-efficient Indu Logic Programming (ILP) to generate interpretable belief-based policy specifications.
We show that learneds expressed in Answer Set Programming (ASP) yield performance superior to neural networks and similar to optimal handcrafted task-specifics within lower computational time.
arXiv Detail & Related papers (2024-02-29T15:36:01Z) - Uncertainty-aware Language Modeling for Selective Question Answering [107.47864420630923]
We present an automatic large language model (LLM) conversion approach that produces uncertainty-aware LLMs.
Our approach is model- and data-agnostic, is computationally-efficient, and does not rely on external models or systems.
arXiv Detail & Related papers (2023-11-26T22:47:54Z) - Human-in-the-loop online just-in-time software defect prediction [6.35776510153759]
We propose Human-In-The-Loop (HITL) O-JIT-SDP that integrates feedback from SQA staff to enhance the prediction process.
We also introduce a performance evaluation framework that utilizes a k-fold distributed bootstrap method along with the Wilcoxon signed-rank test.
These advancements hold the potential to significantly enhance the value of O-JIT-SDP for industrial applications.
arXiv Detail & Related papers (2023-08-25T23:40:08Z) - Uncertainty-Driven Action Quality Assessment [67.20617610820857]
We propose a novel probabilistic model, named Uncertainty-Driven AQA (UD-AQA), to capture the diversity among multiple judge scores.
We generate the estimation of uncertainty for each prediction, which is employed to re-weight AQA regression loss.
Our proposed method achieves competitive results on three benchmarks including the Olympic events MTL-AQA and FineDiving, and the surgical skill JIGSAWS datasets.
arXiv Detail & Related papers (2022-07-29T07:21:15Z) - Temporal-Difference Value Estimation via Uncertainty-Guided Soft Updates [110.92598350897192]
Q-Learning has proven effective at learning a policy to perform control tasks.
estimation noise becomes a bias after the max operator in the policy improvement step.
We present Unbiased Soft Q-Learning (UQL), which extends the work of EQL from two action, finite state spaces to multi-action, infinite state Markov Decision Processes.
arXiv Detail & Related papers (2021-10-28T00:07:19Z) - Risk Conditioned Neural Motion Planning [14.018786843419862]
Risk-bounded motion planning is an important yet difficult problem for safety-critical tasks.
We propose an extension of soft actor critic model to estimate the execution risk of a plan through a risk critic.
We show the advantage of our model in terms of both computational time and plan quality, compared to a state-of-the-art mathematical programming baseline.
arXiv Detail & Related papers (2021-08-04T05:33:52Z) - Task-Specific Normalization for Continual Learning of Blind Image
Quality Models [105.03239956378465]
We present a simple yet effective continual learning method for blind image quality assessment (BIQA)
The key step in our approach is to freeze all convolution filters of a pre-trained deep neural network (DNN) for an explicit promise of stability.
We assign each new IQA dataset (i.e., task) a prediction head, and load the corresponding normalization parameters to produce a quality score.
The final quality estimate is computed by black a weighted summation of predictions from all heads with a lightweight $K$-means gating mechanism.
arXiv Detail & Related papers (2021-07-28T15:21:01Z) - Machine Learning Techniques for Software Quality Assurance: A Survey [5.33024001730262]
We discuss various approaches in both fault prediction and test case prioritization.
Recent studies deep learning algorithms for fault prediction help to bridge the gap between programs' semantics and fault prediction features.
arXiv Detail & Related papers (2021-04-29T00:37:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.