CuFuzz: Hardening CUDA Programs through Transformation and Fuzzing
- URL: http://arxiv.org/abs/2601.01048v1
- Date: Sat, 03 Jan 2026 03:02:47 GMT
- Title: CuFuzz: Hardening CUDA Programs through Transformation and Fuzzing
- Abstract summary: CuFuzz is a novel compiler-runtime co-design solution to extend state-of-the-art CPU fuzzing tools.<n>CuFuzz transforms GPU programs into CPU programs using compiler IR-level transformations.<n>CuFuzz uncovered 122 security vulnerabilities in widely used benchmarks.
- Score: 12.40365281970697
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: GPUs have gained significant popularity over the past decade, extending beyond their original role in graphics rendering. This evolution has brought GPU security and reliability to the forefront of concerns. Prior research has shown that CUDA's lack of memory safety can lead to serious vulnerabilities. While fuzzing is effective for finding such bugs on CPUs, equivalent tools for GPUs are lacking due to architectural differences and lack of built-in error detection. In this paper, we propose CuFuzz, a novel compiler-runtime co-design solution to extend state-of-the-art CPU fuzzing tools to GPU programs. CuFuzz transforms GPU programs into CPU programs using compiler IR-level transformations to enable effective fuzz testing. To the best of our knowledge, CuFuzz is the first mechanism to bring fuzzing support to CUDA, addressing a critical gap in GPU security research. By leveraging CPU memory error detectors such as Address Sanitizer, CuFuzz aims to uncover memory safety bugs and related correctness vulnerabilities in CUDA code, enhancing the security and reliability of GPU-accelerated applications. To ensure high fuzzing throughput, we introduce two compiler-runtime co-optimizations tailored for GPU code: Partial Representative Execution (PREX) and Access-Index Preserving Pruning (AXIPrune), achieving average throughput improvements of 32x with PREX and an additional 33% gain with AXIPrune on top of PREX-optimized code. Together, these optimizations can yield up to a 224.31x speedup. In our fuzzing campaigns, CuFuzz uncovered 122 security vulnerabilities in widely used benchmarks.
Related papers
- Towards Standardized Evaluation of GPU Memory Safety with GMSBench [9.227375465245993]
We present GMSBench, a GPU memory safety benchmark designed to evaluate a broad range of memory safety violations.<n>GMSBench comprises 149 self-contained tests spanning spatial, temporal, and errors.<n>We demonstrate the utility of GMSBench by evaluating Compute Sanitizer, a widely used GPU memory error detection tool.
arXiv Detail & Related papers (2026-09-08T15:11:57Z) - GPU Acceleration of Learning With Errors KEMs Using OpenACC for Post-Quantum Cryptography [0.0]
Key Encapsulation Mechanism (KEM) based on plain Learning with Errors (LWE) problem.<n>Implementation achieves significant acceleration across all tested GPU platforms.<n>Results highlight the effectiveness of GPU acceleration for computationally demanding LWE-based cryptographic workloads.
arXiv Detail & Related papers (2026-05-31T13:01:18Z) - CUDAHercules: Benchmarking Hardware-Aware Expert-level CUDA Optimization for LLMs [45.52512820646709]
We introduce Hercules, a benchmark that evaluates generated against end-to-end human-expert SOTA systems.<n>We show that automated programming remains far from fully solved and requires stronger hardware reasoning, better tool use, and training objectives.
arXiv Detail & Related papers (2026-05-08T20:35:27Z) - CUDABeaver: Benchmarking LLM-Based Automated CUDA Debugging [18.460942231908376]
We introduceBEAVER, a benchmark for evaluating programs produced during real failing workspaces.<n>Each task provides the broken candidate, native build/test commands, raw error evidence, and a single file.<n>We show that protocol-aware evaluation gives a more faithful view of performance-loss tolerance.
arXiv Detail & Related papers (2026-05-08T20:24:32Z) - Hunting CUDA Bugs at Scale with cuFuzz [2.0745580313629097]
GPU programs are prone to memory-safety and bugs that evade static analysis.<n>While fuzz-testing, combined with dynamic error checking tools, offers a plausible solution, it remains underutilized for GPUs.<n>We present cuFuzz, the first instrument and first NV-oriented fuzzer that makes fuzzing practical.
arXiv Detail & Related papers (2026-03-12T22:06:11Z) - Challenges and Design Considerations for Finding CUDA Bugs Through GPU-Native Fuzzing [8.147859459325387]
We study the key challenges of ensuring memory safety on heterogeneous systems.<n>We show that, while the number of exploitable bugs in heterogeneous systems rises every year, current mitigation methods often rely on unfaithful translations.
arXiv Detail & Related papers (2026-03-05T22:26:36Z) - CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation [51.72529978689561]
Agent is a large-scale agentic reinforcement learning system that develops kernel expertise through three components.<n>Agent delivers 100%, 100%, and 92% faster rate over torchcompile on KernelBench.
arXiv Detail & Related papers (2026-02-27T18:58:05Z) - Outrunning LLM Cutoffs: A Live Kernel Crash Resolution Benchmark for All [57.23434868678603]
Live-kBench is an evaluation framework for self-evolving benchmarks that scrapes and evaluates agents on freshly discovered kernel bugs.<n> kEnv is an agent-agnostic crash-resolution environment for kernel compilation, execution, and feedback.<n>Using kEnv, we benchmark three state-of-the-art agents, showing that they resolve 74% of crashes on the first attempt.
arXiv Detail & Related papers (2026-02-02T19:06:15Z) - Scaling Behaviors of Evolutionary Algorithms on GPUs: When Does Parallelism Pay Off? [43.96509049196842]
Evolutionary algorithms (EAs) are increasingly implemented on graphics processing units (GPUs) to leverage parallel processing capabilities for enhanced efficiency.<n>We investigate how GPU parallelism alters the behavior of EAs beyond simple acceleration metrics.<n>Our results reveal that the impact of GPU acceleration is highly heterogeneous and depends strongly on algorithmic structure.
arXiv Detail & Related papers (2026-01-26T12:55:21Z) - ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation [5.103450268268085]
ParaCodex is an HPC-engineer workflow that turns a Codex-based agent into an autonomous OpenMP offload system.<n>We evaluate translation from serial CPU kernels to OpenMP offload kernels on HeCBench, Rodinia, and NAS.<n>We achieve geometric-mean speedups of 3x on HeCBench and 5x on Rodinia, and outperforming a zero-shot Codex baseline on all suites.
arXiv Detail & Related papers (2026-01-07T19:04:53Z) - HipKittens: Fast and Furious AMD Kernels [36.63732085611713]
We study the programming primitives that lead to performant AMD AI kernels.<n>We provide the first detailed study of the programming primitives that lead to performant AMD AI kernels.<n>These findings help pave the way for a single, tile-based software layer for high-performance AI kernels.
arXiv Detail & Related papers (2025-11-11T10:36:18Z) - xMem: A CPU-Based Approach for Accurate Estimation of GPU Memory in Deep Learning Training Workloads [2.2991119948183525]
estimation of how much GPU memory a job will require is fundamental to enabling advanced scheduling and GPU sharing.<n>We propose xMem, a novel framework that leverages CPU-only dynamic analysis to accurately estimate peak GPU memory requirements.<n>The analysis of 5209 runs, which includes ANOVA and Monte Carlo results, highlights xMem's benefits.
arXiv Detail & Related papers (2025-10-23T23:16:27Z) - cubic: CUDA-accelerated 3D Bioimage Computing [42.83541173560835]
We introduce cubic, an open-source Python library that augmenting widely used SciPy and scikit-image APIs with GPU-accelerated alternatives.<n> cubic's API is device-agnostic and dispatches operations to GPU when data reside on the device and otherwise executes on CPU.<n>We evaluate cubic both by benchmarking individual operations and by reproducing existing deconvolution and segmentation pipelines.
arXiv Detail & Related papers (2025-10-15T22:22:06Z) - CrashFixer: A crash resolution agent for the Linux kernel [58.152358195983155]
This work builds upon kGym, which shares a benchmark for system-level Linux kernel bugs and a platform to run experiments on the Linux kernel.<n>This paper introduces CrashFixer, the first LLM-based software repair agent that is applicable to Linux kernel bugs.
arXiv Detail & Related papers (2025-04-29T04:18:51Z) - HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading [79.38548165722229]
HEADINFER offloads the KV cache to CPU RAM while avoiding the need to fully store the KV cache for any transformer layer on the GPU.<n>We demonstrate HEADINFER maintains computational efficiency while significantly reducing memory footprint.
arXiv Detail & Related papers (2025-02-18T06:26:05Z) - Cheddar: A Swift Fully Homomorphic Encryption Library Designed for GPU Architectures [2.613335121517245]
Fully homomorphic encryption (FHE) frees cloud computing from privacy concerns by enabling secure computation on encrypted data.<n>We present Cheddar, a high-performance FHE library for GPU, achieving substantial speedups over previous GPU implementations.
arXiv Detail & Related papers (2024-07-17T23:49:18Z) - SIP: Autotuning GPU Native Schedules via Stochastic Instruction Perturbation [0.0]
Large language models (LLMs) have become a significant workload since their appearance.
They are also computationally expensive as they have billions of parameters and are trained with massive amounts of data.
Recent works have developed dedicated kernels for LLM training and inference instead of relying on compilergenerated ones, so that hardware resources are as fully utilized as possible.
arXiv Detail & Related papers (2024-03-25T15:26:50Z) - Kernel methods through the roof: handling billions of points efficiently [94.31450736250918]
Kernel methods provide an elegant and principled approach to nonparametric learning, but so far could hardly be used in large scale problems.
Recent advances have shown the benefits of a number of algorithmic ideas, for example combining optimization, numerical linear algebra and random projections.
Here, we push these efforts further to develop and test a solver that takes full advantage of GPU hardware.
arXiv Detail & Related papers (2020-06-18T08:16:25Z) - GEVO: GPU Code Optimization using Evolutionary Computation [12.9965710635562]
GEVO is a tool for discovering optimization opportunities and tuning the performance of GPU kernels in the LLVM representation.
GEVO improves execution time of the GPU programs in the Rodinia benchmark suite and the machine learning models, SVM and ResNet18, on NVIDIA Tesla P100.
GEVO achieves 1.79X kernel performance improvement on image classification using ResNet18/CIFAR-10, with less than 1% model accuracy reduction.
arXiv Detail & Related papers (2020-04-17T09:36:17Z) - Faster than FAST: GPU-Accelerated Frontend for High-Speed VIO [46.20949184826173]
This work focuses on the applicability of efficient low-level, GPU hardware-specific instructions to improve on existing computer vision algorithms.
Especially non-maxima suppression and the subsequent feature selection are prominent contributors to the overall image processing latency.
arXiv Detail & Related papers (2020-03-30T14:16:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.