Evolution analysis of software quality metrics in an open-source java project: A case study on TestNG

• URL: http://arxiv.org/abs/2505.22884v1
• Date: Wed, 28 May 2025 21:34:27 GMT
• Title: Evolution analysis of software quality metrics in an open-source java project: A case study on TestNG
• Abstract summary: This study analyzes the evolution of software quality metrics in five successive versions of the open-source Java testing framework TestNG.<n>The results indicate that TestNG has matured into a more stable and maintainable framework, reflecting ongoing development, and architectural improvements.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Software quality is critical in modern software engineering, especially in large and evolving codebases. This study analyzes the evolution of software quality metrics in five successive versions of the open-source Java testing framework TestNG. Using the static analysis tool Understand, eleven key object-oriented metrics, including cyclomatic complexity, class coupling, and lines of code, were extracted for each version. Statistical and visual analyses reveal structural trends over time. The results indicate that TestNG has matured into a more stable and maintainable framework, reflecting ongoing development, refactoring, and architectural improvements. This study provides insights into design evolution and offers recommendations for maintaining code quality in similar projects.

Related papers

• From Metrics to Improvement: A Lifecycle-Aware LLM Feedback Framework for Research Software Quality [8.460186703921934]
  Research software is often developed by researchers with limited software engineering expertise.<n>This can lead to quality issues that hinder maintainability, reuse, and sustainability.<n>We propose a lifecycle-aware framework that integrates quantitative software quality assessment with Large Language Model (LLM)-based code refinement.
  arXiv  Detail & Related papers  (2026-08-24T11:28:26Z)
• Advances and Frontiers of LLM-based Issue Resolution in Software Engineering: A Comprehensive Survey [59.3507264893654]
  Issue resolution is a complex Software Engineering task integral to real-world development.<n> benchmarks like SWE-bench revealed this task as profoundly difficult for large language models.<n>This paper presents a systematic survey of this emerging domain.
  arXiv  Detail & Related papers  (2026-01-15T18:55:03Z)
• SQuaD: The Software Quality Dataset [3.9861000060030993]
  The Software Quality dataset (SQuaD) is a time-aware collection of software quality metrics extracted from 450 mature open-source projects across diverse ecosystems.<n>By integrating nine state-of-the-art static analysis tools, SQuaD unifies over 700 unique metrics at method, class, file, and project levels.
  arXiv  Detail & Related papers  (2025-11-14T12:57:22Z)
• Uncovering Scientific Software Sustainability through Community Engagement and Software Quality Metrics [0.0]
  This paper explores the sustainability of scientific open-source software (Sci-OSS) projects hosted on GitHub.<n>We map sustainability to repository metrics from the literature and mined data from ten prominent Sci-OSS projects.<n>Our visualization and analysis methods offer researchers, funders, and developers key insights into long-term software sustainability.
  arXiv  Detail & Related papers  (2025-11-11T05:34:27Z)
• Designing Empirical Studies on LLM-Based Code Generation: Towards a Reference Framework [0.3568466510804538]
  We propose a theoretical framework for designing and reporting empirical studies on large language models (LLMs)-based code generation.<n>The framework is grounded in both our prior experience conducting such experiments and a comparative analysis of key similarities and differences among recent studies.<n>It organizes evaluation around core components such as problem sources, quality attributes, and metrics, supporting structured and systematic experimentation.
  arXiv  Detail & Related papers  (2025-10-04T16:15:54Z)
• LoCoBench: A Benchmark for Long-Context Large Language Models in Complex Software Engineering [85.58151741052616]
  LoCoBench is a benchmark specifically designed to evaluate long-context LLMs in realistic, complex software development scenarios.<n>Our benchmark provides 8,000 evaluation scenarios systematically generated across 10 programming languages.<n>LoCoBench introduces 8 task categories that capture essential long-context understanding capabilities.
  arXiv  Detail & Related papers  (2025-09-11T16:55:04Z)
• Rookie Mistakes: Measuring Software Quality in Student Projects to Guide Educational Enhancement [1.7482569079741024]
  We apply a static analysis pipeline to assess software quality, combining SonarQube and ArchUnit to detect code smells and architectural anti-patterns.<n>Our findings highlight recurring quality issues and offer concrete evidence of the challenges students face at this stage.
  arXiv  Detail & Related papers  (2025-07-15T19:37:23Z)
• CORE: Benchmarking LLMs Code Reasoning Capabilities through Static Analysis Tasks [12.465309397733249]
  Large language models (LLMs) have been widely adopted across diverse software engineering domains.<n>These applications require understanding beyond surface-level code patterns.<n>Existing benchmarks primarily evaluate end-to-end outcomes, such as whether code is correctly repaired or generated.
  arXiv  Detail & Related papers  (2025-07-03T01:35:58Z)
• Centrality Change Proneness: an Early Indicator of Microservice Architectural Degradation [48.55946052680251]
  The study of temporal networks has emerged as a way to describe and analyze evolving networks.<n>Previous research has explored how software metrics such as size, complexity, and quality are related to microservice centrality.<n>This study investigates whether temporal centrality metrics can provide insight into the early detection of architectural degradation.
  arXiv  Detail & Related papers  (2025-06-09T12:22:12Z)
• BinMetric: A Comprehensive Binary Analysis Benchmark for Large Language Models [50.17907898478795]
  We introduce BinMetric, a benchmark designed to evaluate the performance of large language models on binary analysis tasks.<n>BinMetric comprises 1,000 questions derived from 20 real-world open-source projects across 6 practical binary analysis tasks.<n>Our empirical study on this benchmark investigates the binary analysis capabilities of various state-of-the-art LLMs, revealing their strengths and limitations in this field.
  arXiv  Detail & Related papers  (2025-05-12T08:54:07Z)
• Codev-Bench: How Do LLMs Understand Developer-Centric Code Completion? [60.84912551069379]
  We present the Code-Development Benchmark (Codev-Bench), a fine-grained, real-world, repository-level, and developer-centric evaluation framework. Codev-Agent is an agent-based system that automates repository crawling, constructs execution environments, extracts dynamic calling chains from existing unit tests, and generates new test samples to avoid data leakage.
  arXiv  Detail & Related papers  (2024-10-02T09:11:10Z)
• Code-Survey: An LLM-Driven Methodology for Analyzing Large-Scale Codebases [3.8153349016958074]
  We introduce Code-Survey, the first LLM-driven methodology designed to explore and analyze large-scales. By carefully designing surveys, Code-Survey transforms unstructured data, such as commits, emails, into organized, structured, and analyzable datasets. This enables quantitative analysis of complex software evolution and uncovers valuable insights related to design, implementation, maintenance, reliability, and security.
  arXiv  Detail & Related papers  (2024-09-24T17:08:29Z)
• Insights into Deep Learning Refactoring: Bridging the Gap Between Practices and Expectations [13.084553746852382]
  Deep learning software has become progressively complex as the software evolves. The insight of code in the context of deep learning is still unclear. Research and the development of related tools are crucial for improving project maintainability and code quality.
  arXiv  Detail & Related papers  (2024-05-08T07:35:14Z)
• Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study [72.24266814625685]
  We explore the performance of large language models (LLMs) across the entire software development lifecycle with DevEval.<n>DevEval features four programming languages, multiple domains, high-quality data collection, and carefully designed and verified metrics for each task.<n> Empirical studies show that current LLMs, including GPT-4, fail to solve the challenges presented within DevEval.
  arXiv  Detail & Related papers  (2024-03-13T15:13:44Z)
• Geometric Deep Learning for Computer-Aided Design: A Survey [76.3325417461511]
  Geometric Deep Learning techniques have become a transformative force in the field of Computer-Aided Design.<n>The ability to process the CAD designs represented by geometric data and to analyze their encoded features enables the identification of similarities.<n>This survey offers a comprehensive overview of learning-based methods in computer-aided design across various categories.
  arXiv  Detail & Related papers  (2024-02-27T17:11:35Z)
• Exploring Precision and Recall to assess the quality and diversity of LLMs [82.21278402856079]
  We introduce a novel evaluation framework for Large Language Models (LLMs) such as textscLlama-2 and textscMistral. This approach allows for a nuanced assessment of the quality and diversity of generated text without the need for aligned corpora.
  arXiv  Detail & Related papers  (2024-02-16T13:53:26Z)
• State-Of-The-Practice in Quality Assurance in Java-Based Open Source Software Development [3.4800665691198565]
  We investigate whether and how quality assurance approaches are being used in conjunction in the development of 1,454 popular open source software projects on GitHub. Our study indicates that typically projects do not follow all quality assurance practices together with high intensity. In general, our study provides a deeper understanding of how existing quality assurance approaches are currently being used in Java-based open source software development.
  arXiv  Detail & Related papers  (2023-06-16T07:43:11Z)
• "Project smells" -- Experiences in Analysing the Software Quality of ML Projects with mllint [6.0141405230309335]
  We introduce the novel concept of project smells which consider deficits in project management as a more holistic perspective on software quality. An open-source static analysis tool mllint was also implemented to help detect and mitigate these. Our findings indicate a need for context-aware static analysis tools, that fit the needs of the project at its current stage of development.
  arXiv  Detail & Related papers  (2022-01-20T15:52:24Z)
• The Linear Arrangement Library. A new tool for research on syntactic dependency structures [1.611401281366893]
  We present a new open-source tool, the Linear Arrangement Library (LAL) LAL caters to the needs of, especially, inexperienced programmers. It enables the calculation of metrics on single syntactic dependency structures, treebanks, and collection of treebanks.
  arXiv  Detail & Related papers  (2021-12-05T08:48:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.