Challenges and Design Considerations for Finding CUDA Bugs Through GPU-Native Fuzzing

• URL: http://arxiv.org/abs/2603.05725v1
• Date: Thu, 05 Mar 2026 22:26:36 GMT
• Title: Challenges and Design Considerations for Finding CUDA Bugs Through GPU-Native Fuzzing
• Abstract summary: We study the key challenges of ensuring memory safety on heterogeneous systems.<n>We show that, while the number of exploitable bugs in heterogeneous systems rises every year, current mitigation methods often rely on unfaithful translations.
• Score: 8.147859459325387
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Modern computing is shifting from homogeneous CPU-centric systems to heterogeneous systems with closely integrated CPUs and GPUs. While the CPU software stack has benefited from decades of memory safety hardening, the GPU software stack remains dangerously immature. This discrepancy presents a critical ethical challenge: the world's most advanced AI and scientific workloads are increasingly deployed on vulnerable hardware components. In this paper, we study the key challenges of ensuring memory safety on heterogeneous systems. We show that, while the number of exploitable bugs in heterogeneous systems rises every year, current mitigation methods often rely on unfaithful translations, i.e., converting GPU programs to run on CPUs for testing, which fails to capture the architectural differences between CPUs and GPUs. We argue that the faithfulness of the program behavior is at the core of secure and reliable heterogeneous systems design. To ensure faithfulness, we discuss several design considerations of a GPU-native fuzzing pipeline for CUDA programs.

Related papers

• Towards Standardized Evaluation of GPU Memory Safety with GMSBench [9.227375465245993]
  We present GMSBench, a GPU memory safety benchmark designed to evaluate a broad range of memory safety violations.<n>GMSBench comprises 149 self-contained tests spanning spatial, temporal, and errors.<n>We demonstrate the utility of GMSBench by evaluating Compute Sanitizer, a widely used GPU memory error detection tool.
  arXiv  Detail & Related papers  (2026-09-08T15:11:57Z)
• GPU Acceleration of Learning With Errors KEMs Using OpenACC for Post-Quantum Cryptography [0.0]
  Key Encapsulation Mechanism (KEM) based on plain Learning with Errors (LWE) problem.<n>Implementation achieves significant acceleration across all tested GPU platforms.<n>Results highlight the effectiveness of GPU acceleration for computationally demanding LWE-based cryptographic workloads.
  arXiv  Detail & Related papers  (2026-05-31T13:01:18Z)
• CUDAHercules: Benchmarking Hardware-Aware Expert-level CUDA Optimization for LLMs [45.52512820646709]
  We introduce Hercules, a benchmark that evaluates generated against end-to-end human-expert SOTA systems.<n>We show that automated programming remains far from fully solved and requires stronger hardware reasoning, better tool use, and training objectives.
  arXiv  Detail & Related papers  (2026-05-08T20:35:27Z)
• Understand and Accelerate Memory Processing Pipeline for Disaggregated LLM Inference [45.78442013449325]
  Large language models rely on efficient long-context processing and generation mechanisms to support complex reasoning.<n>We show that these optimizations can be unified into a four-step memory processing pipeline: Prepare Memory, Compute Relevancy, Retrieval, and Apply to Inference.<n>Motivated by this insight, we argue that textbfheterogeneous systems are well-suited to accelerate memory processing and thus end-to-end inference.
  arXiv  Detail & Related papers  (2026-03-30T21:03:39Z)
• CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation [51.72529978689561]
  Agent is a large-scale agentic reinforcement learning system that develops kernel expertise through three components.<n>Agent delivers 100%, 100%, and 92% faster rate over torchcompile on KernelBench.
  arXiv  Detail & Related papers  (2026-02-27T18:58:05Z)
• GPU-Accelerated Algorithms for Graph Vector Search: Taxonomy, Empirical Study, and Research Directions [54.570944939061555]
  We present a comprehensive study of GPU-accelerated graph-based vector search algorithms.<n>We establish a detailed taxonomy of GPU optimization strategies and clarify the mapping between algorithmic tasks and hardware execution units.<n>Our findings offer clear guidelines for designing scalable and robust GPU-powered approximate nearest neighbor search systems.
  arXiv  Detail & Related papers  (2026-02-10T16:18:04Z)
• Scaling Behaviors of Evolutionary Algorithms on GPUs: When Does Parallelism Pay Off? [43.96509049196842]
  Evolutionary algorithms (EAs) are increasingly implemented on graphics processing units (GPUs) to leverage parallel processing capabilities for enhanced efficiency.<n>We investigate how GPU parallelism alters the behavior of EAs beyond simple acceleration metrics.<n>Our results reveal that the impact of GPU acceleration is highly heterogeneous and depends strongly on algorithmic structure.
  arXiv  Detail & Related papers  (2026-01-26T12:55:21Z)
• CuFuzz: Hardening CUDA Programs through Transformation and Fuzzing [12.40365281970697]
  CuFuzz is a novel compiler-runtime co-design solution to extend state-of-the-art CPU fuzzing tools.<n>CuFuzz transforms GPU programs into CPU programs using compiler IR-level transformations.<n>CuFuzz uncovered 122 security vulnerabilities in widely used benchmarks.
  arXiv  Detail & Related papers  (2026-01-03T03:02:47Z)
• Scalable GPU-Based Integrity Verification for Large Machine Learning Models [4.301162531343759]
  We present a security framework that strengthens distributed machine learning by standardizing integrity protections across CPU and GPU platforms.<n>Our approach co-locates integrity verification directly with large ML model execution on GPU accelerators.<n>We provide a hardware-agnostic foundation that enterprise teams can deploy regardless of their underlying CPU and GPU infrastructures.
  arXiv  Detail & Related papers  (2025-10-27T23:45:21Z)
• NVIDIA GPU Confidential Computing Demystified [23.473530599624937]
  GPU Confidential Computing was introduced as part of the NVIDIA Hopper Architecture, extending the trust boundary beyond traditional CPU-based confidential computing.<n>For end users, transitioning to GPU-CC mode is seamless, requiring no modifications to existing AI applications.<n>The lack of transparency presents significant challenges for security researchers seeking a deeper understanding of GPU-CC's architecture and operational mechanisms.
  arXiv  Detail & Related papers  (2025-07-03T16:31:07Z)
• Confidential Computing on Heterogeneous CPU-GPU Systems: Survey and Future Directions [21.66522545303459]
  In recent years, the widespread informatization and rapid data explosion have increased the demand for high-performance heterogeneous systems. The combination of CPU and GPU is particularly popular due to its versatility. Advances in privacy-preserving techniques, especially hardware-based Trusted Execution Environments (TEEs) offer effective protection for GPU applications.
  arXiv  Detail & Related papers  (2024-08-21T13:14:45Z)
• FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs [57.12856172329322]
  We envision a decentralized system unlocking the potential vast untapped consumer-level GPU. This system faces critical challenges, including limited CPU and GPU memory, low network bandwidth, the variability of peer and device heterogeneity.
  arXiv  Detail & Related papers  (2023-09-03T13:27:56Z)
• The Architectural Implications of Distributed Reinforcement Learning on CPU-GPU Systems [45.479582612113205]
  We show how to improve the performance and power efficiency of RL training on CPU-GPU systems. We quantify the overall hardware utilization on a state-of-the-art distributed RL training framework. We also introduce a new system design metric, CPU/GPU ratio, and show how to find the optimal balance between CPU and GPU resources.
  arXiv  Detail & Related papers  (2020-12-08T04:50:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.