A Comprehensive Study of Native Code Bugs in Python Applications

• URL: http://arxiv.org/abs/2608.29851v1
• Date: Sun, 30 Aug 2026 15:30:07 GMT
• Title: A Comprehensive Study of Native Code Bugs in Python Applications
• Abstract summary: Python applications often integrate native code components written in a lower-level programming language like C.<n>This multilingual construction brings various benefits such as greater performance efficiency and easier interoperability with diverse runtime environments.<n>However, bugs in the native code (i.e., native code bugs) also constitute a major additional challenge to the quality of the Python applications as a whole.
• Score: 24.46519800257897
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The impact of Python applications has been evidenced by their widespread presence in some of the most impactful software domains, such as machine learning frameworks and scientific computing platforms. These applications often integrate native code components written in a lower-level programming language like C. This multilingual construction brings various benefits such as greater performance efficiency and easier interoperability with diverse runtime environments. However, bugs in the native code (i.e., native code bugs), which are usually stealthy, also constitute a major additional challenge to the quality of the Python applications as a whole. Yet despite existing relevant studies, there remains a lack of comprehensive understanding of native code bugs in Python applications. In this paper, we aim to mitigate this knowledge gap through the first in-depth study of such bugs, dissecting their common symptoms, introducing locations, manifestation characteristics, root causes, and fixes. Based on our extensive automated and manual analyses of 216 native code bugs in real-world Python projects on GitHub, we obtained novel findings about and new insights into the occurrence mechanisms and resolution strategies of those bugs.

Related papers

• Large Language Models for Code Generation from Multilingual Prompts: A Curated Benchmark and a Study on Code Quality [45.28284966022665]
  We study how the language used to describe programming tasks affects the source code generated by GPT-4o mini, DeepSeek, and Claude.<n>We translate and manually curate the original English prompts into Chinese, Hindi, Spanish, and Italian.<n>We evaluate the generated code using multiple dimensions, including functional correctness through test pass rates, structural quality using established code metrics, and issues detected by static analysis tools.
  arXiv  Detail & Related papers  (2026-07-16T10:35:25Z)
• Bugs in the Shadows: Static Detection of Faulty Python Refactorings [44.115219601924856]
  Python's dynamic type system poses significant challenges for automated code transformations.<n>Our analysis uncovered 29 bugs across four types from a total of 1,152 attempts.<n>These results highlight the need to improve the robustness of current Python tools to ensure the correctness of automated code transformations.
  arXiv  Detail & Related papers  (2025-07-01T18:03:56Z)
• PyResBugs: A Dataset of Residual Python Bugs for Natural Language-Driven Fault Injection [5.383910843560784]
  PyResBugs is a curated dataset of residual bugs from major Python frameworks.<n>Each bug is paired with its corresponding fault-free (fixed) version and annotated with multi-level natural language (NL) descriptions.
  arXiv  Detail & Related papers  (2025-05-09T04:39:09Z)
• CRUXEval-X: A Benchmark for Multilingual Code Reasoning, Understanding and Execution [50.1875460416205]
  The CRUXEVAL-X code reasoning benchmark contains 19 programming languages.<n>It comprises at least 600 subjects for each language, along with 19K content-consistent tests in total.<n>Even a model trained solely on Python can achieve at most 34.4% Pass@1 in other languages.
  arXiv  Detail & Related papers  (2024-08-23T11:43:00Z)
• Towards Understanding the Challenges of Bug Localization in Deep Learning Systems [2.608075651391582]
  We conduct a large-scale empirical study to better understand the challenges of localizing bugs in deep-learning systems.<n>First, we determine the bug localization performance of four existing techniques using 2,365 bugs from deep-learning systems and 2,913 from traditional software.<n>Second, we evaluate how different bug types in deep learning systems impact bug localization.
  arXiv  Detail & Related papers  (2024-02-01T21:17:42Z)
• An Empirical Study on Bugs Inside PyTorch: A Replication Study [10.848682558737494]
  We characterize bugs in the PyTorch library, a very popular deep learning framework. Our results highlight that PyTorch bugs are more like traditional software projects bugs, than related to deep learning characteristics.
  arXiv  Detail & Related papers  (2023-07-25T19:23:55Z)
• A Static Evaluation of Code Completion by Large Language Models [65.18008807383816]
  Execution-based benchmarks have been proposed to evaluate functional correctness of model-generated code on simple programming problems. static analysis tools such as linters, which can detect errors without running the program, haven't been well explored for evaluating code generation models. We propose a static evaluation framework to quantify static errors in Python code completions, by leveraging Abstract Syntax Trees.
  arXiv  Detail & Related papers  (2023-06-05T19:23:34Z)
• An Empirical Study of Fault Localization in Python Programs [4.366130138560774]
  This paper is the first multi-family large-scale empirical study of fault localization on real-world Python programs and faults. We use Zou et al.'s recent large-scale empirical study of fault localization in Java as the basis of our study. The results replicate for Python several results known about Java, and shed light on whether Python's peculiarities affect the capabilities of fault localization.
  arXiv  Detail & Related papers  (2023-05-31T13:21:30Z)
• BigIssue: A Realistic Bug Localization Benchmark [89.8240118116093]
  BigIssue is a benchmark for realistic bug localization. We provide a general benchmark with a diversity of real and synthetic Java bugs. We hope to advance the state of the art in bug localization, in turn improving APR performance and increasing its applicability to the modern development cycle.
  arXiv  Detail & Related papers  (2022-07-21T20:17:53Z)
• Measuring Coding Challenge Competence With APPS [54.22600767666257]
  We introduce APPS, a benchmark for code generation. Our benchmark includes 10,000 problems, which range from having simple one-line solutions to being substantial algorithmic challenges. Recent models such as GPT-Neo can pass approximately 15% of the test cases of introductory problems.
  arXiv  Detail & Related papers  (2021-05-20T17:58:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.