SQuaD: The Software Quality Dataset

• URL: http://arxiv.org/abs/2511.11265v1
• Date: Fri, 14 Nov 2025 12:57:22 GMT
• Title: SQuaD: The Software Quality Dataset
• Abstract summary: The Software Quality dataset (SQuaD) is a time-aware collection of software quality metrics extracted from 450 mature open-source projects across diverse ecosystems.<n>By integrating nine state-of-the-art static analysis tools, SQuaD unifies over 700 unique metrics at method, class, file, and project levels.
• Score: 3.9861000060030993
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Software quality research increasingly relies on large-scale datasets that measure both the product and process aspects of software systems. However, existing resources often focus on limited dimensions, such as code smells, technical debt, or refactoring activity, thereby restricting comprehensive analyses across time and quality dimensions. To address this gap, we present the Software Quality Dataset (SQuaD), a multi-dimensional, time-aware collection of software quality metrics extracted from 450 mature open-source projects across diverse ecosystems, including Apache, Mozilla, FFmpeg, and the Linux kernel. By integrating nine state-of-the-art static analysis tools, i.e., SonarQube, CodeScene, PMD, Understand, CK, JaSoMe, RefactoringMiner, RefactoringMiner++, and PyRef, our dataset unifies over 700 unique metrics at method, class, file, and project levels. Covering a total of 63,586 analyzed project releases, SQuaD also provides version control and issue-tracking histories, software vulnerability data (CVE/CWE), and process metrics proven to enhance Just-In-Time (JIT) defect prediction. The SQuaD enables empirical research on maintainability, technical debt, software evolution, and quality assessment at unprecedented scale. We also outline emerging research directions, including automated dataset updates and cross-project quality modeling to support the continuous evolution of software analytics. The dataset is publicly available on ZENODO (DOI: 10.5281/zenodo.17566690).

Related papers

• From Metrics to Improvement: A Lifecycle-Aware LLM Feedback Framework for Research Software Quality [8.460186703921934]
  Research software is often developed by researchers with limited software engineering expertise.<n>This can lead to quality issues that hinder maintainability, reuse, and sustainability.<n>We propose a lifecycle-aware framework that integrates quantitative software quality assessment with Large Language Model (LLM)-based code refinement.
  arXiv  Detail & Related papers  (2026-08-24T11:28:26Z)
• DeNovoSWE: Scaling Long-Horizon Environments for Generating Entire Repositories from Scratch [89.87798465720181]
  We introduce textbfDeNovoSWE, a large-scale dataset for whole-repository generation.<n>DeNovoSWE comprises 4,818 high-quality instances, where each instance requires generating a complete repository from documentation.<n>Fine-tuning Qwen3-30B-A3B on DeNovoSWE substantially improves long-horizon SWE performance, raising its score on the challenging BeyondSWE-Doc2Repo benchmark from 5.8% to 47.2%.
  arXiv  Detail & Related papers  (2026-06-09T11:37:15Z)
• Immersion in the GitHub Universe: Scaling Coding Agents to Mastery [60.359983359258955]
  ScaleSWE is an automated, sandboxed multi agent workflow designed to construct high quality SWE data at scale.<n>The system coordinates three specialized agents for environment setup, test creation, and problem description synthesis to process 6 million pull requests across 5200 repositories.
  arXiv  Detail & Related papers  (2026-02-10T15:30:19Z)
• Advances and Frontiers of LLM-based Issue Resolution in Software Engineering: A Comprehensive Survey [59.3507264893654]
  Issue resolution is a complex Software Engineering task integral to real-world development.<n> benchmarks like SWE-bench revealed this task as profoundly difficult for large language models.<n>This paper presents a systematic survey of this emerging domain.
  arXiv  Detail & Related papers  (2026-01-15T18:55:03Z)
• OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Value [74.80873109856563]
  OpenDataArena (ODA) is a holistic and open platform designed to benchmark the intrinsic value of post-training data.<n>ODA establishes a comprehensive ecosystem comprising four key pillars: (i) a unified training-evaluation pipeline that ensures fair, open comparisons across diverse models; (ii) a multi-dimensional scoring framework that profiles data quality along tens of distinct axes; and (iii) an interactive data lineage explorer to visualize dataset genealogy and dissect component sources.
  arXiv  Detail & Related papers  (2025-12-16T03:33:24Z)
• VeriSciQA: An Auto-Verified Dataset for Scientific Visual Question Answering [53.662676566188175]
  A key bottleneck lies in the lack of public, large-scale, high-quality Scientific Visual Question Answering (SVQA) datasets.<n>We propose a verification-centric Generate-then-Verify framework that first generates QA pairs with figure-associated textual context.<n>We instantiate this framework to curate VeriSciQA, a dataset of 20,351 QA pairs spanning 20 scientific domains and 12 figure types.
  arXiv  Detail & Related papers  (2025-11-25T04:14:52Z)
• Uncovering Scientific Software Sustainability through Community Engagement and Software Quality Metrics [0.0]
  This paper explores the sustainability of scientific open-source software (Sci-OSS) projects hosted on GitHub.<n>We map sustainability to repository metrics from the literature and mined data from ten prominent Sci-OSS projects.<n>Our visualization and analysis methods offer researchers, funders, and developers key insights into long-term software sustainability.
  arXiv  Detail & Related papers  (2025-11-11T05:34:27Z)
• Identity resolution of software metadata using Large Language Models [0.0]
  This article presents an evaluation of instruction-tuned large language models for the task of software metadata identity resolution.<n>We benchmarked multiple models against a human-annotated gold standard, examined their behavior on ambiguous cases, and introduced an agreement-based proxy for high-confidence automated decisions.
  arXiv  Detail & Related papers  (2025-05-29T14:47:31Z)
• Evolution analysis of software quality metrics in an open-source java project: A case study on TestNG [0.0]
  This study analyzes the evolution of software quality metrics in five successive versions of the open-source Java testing framework TestNG.<n>The results indicate that TestNG has matured into a more stable and maintainable framework, reflecting ongoing development, and architectural improvements.
  arXiv  Detail & Related papers  (2025-05-28T21:34:27Z)
• Thinking Longer, Not Larger: Enhancing Software Engineering Agents via Scaling Test-Time Compute [61.00662702026523]
  We propose a unified Test-Time Compute scaling framework that leverages increased inference-time instead of larger models.<n>Our framework incorporates two complementary strategies: internal TTC and external TTC.<n>We demonstrate our textbf32B model achieves a 46% issue resolution rate, surpassing significantly larger models such as DeepSeek R1 671B and OpenAI o1.
  arXiv  Detail & Related papers  (2025-03-31T07:31:32Z)
• Comparative Analysis of Quantum and Classical Support Vector Classifiers for Software Bug Prediction: An Exploratory Study [8.214986715680737]
  We investigate the practical application of Quantum Support Vectors (QSVC) for detecting buggy software commits.<n>Our technique addresses large datasets in QSVC algorithms by dividing them into smaller subsets.<n>We propose an aggregation method to combine predictions from these models to detect the entire test dataset.
  arXiv  Detail & Related papers  (2025-01-08T18:53:50Z)
• The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources [100.23208165760114]
  Foundation model development attracts a rapidly expanding body of contributors, scientists, and applications.<n>To help shape responsible development practices, we introduce the Foundation Model Development Cheatsheet.
  arXiv  Detail & Related papers  (2024-06-24T15:55:49Z)
• Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study [72.24266814625685]
  We explore the performance of large language models (LLMs) across the entire software development lifecycle with DevEval.<n>DevEval features four programming languages, multiple domains, high-quality data collection, and carefully designed and verified metrics for each task.<n> Empirical studies show that current LLMs, including GPT-4, fail to solve the challenges presented within DevEval.
  arXiv  Detail & Related papers  (2024-03-13T15:13:44Z)
• "Project smells" -- Experiences in Analysing the Software Quality of ML Projects with mllint [6.0141405230309335]
  We introduce the novel concept of project smells which consider deficits in project management as a more holistic perspective on software quality. An open-source static analysis tool mllint was also implemented to help detect and mitigate these. Our findings indicate a need for context-aware static analysis tools, that fit the needs of the project at its current stage of development.
  arXiv  Detail & Related papers  (2022-01-20T15:52:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.