Computing Floating-Point Errors by Injecting Perturbations
- URL: http://arxiv.org/abs/2507.08467v1
- Date: Fri, 11 Jul 2025 10:19:14 GMT
- Title: Computing Floating-Point Errors by Injecting Perturbations
- Abstract summary: Floating-point programs form the foundation of modern science and engineering.<n> floating-point errors widely exist, but only a subset of inputs may trigger significant errors in floating-point programs.<n>We propose PI-detector to computing floating-point errors effectively and efficiently.
- Score: 10.580959733598519
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Floating-point programs form the foundation of modern science and engineering, providing the essential computational framework for a wide range of applications, such as safety-critical systems, aerospace engineering, and financial analysis. Floating-point errors can lead to severe consequences. Although floating-point errors widely exist, only a subset of inputs may trigger significant errors in floating-point programs. Therefore, it is crucial to determine whether a given input could produce such errors. Researchers tend to take the results of high-precision floating-point programs as oracles for detecting floating-point errors, which introduces two main limitations: (1) difficulty of implementation and (2) prolonged execution time. The two recent tools, ATOMU and FPCC, can partially address these issues. However, ATOMU suffers from false positives; while FPCC, though eliminating false positives, operates at a considerably slower speed. To address these two challenges, we propose a novel approach named PI-detector to computing floating-point errors effectively and efficiently. Our approach is based on the observation that floating-point errors stem from large condition numbers in atomic operations (such as addition and subtraction), which then propagate and accumulate. PI-detector injects small perturbations into the operands of individual atomic operations within the program and compares the outcomes of the original program with the perturbed version to compute floating-point errors. We evaluate PI-detector with datasets from ATOMU and HSED, as well as a complex linear system-solving program. Experimental results demonstrate that PI-detector can perform efficient and accurate floating-point error computation.
Related papers
- FPScan: An Automated Constraint-Based Analyzer for Floating-Point Anomaly Detection [0.0]
FPScan is a novel tool to formally define and detect catastrophic cancellation and absorption in floating-point programs.<n>Our approach starts with a custom static analyzer based on abstract interpretation to infer the order of magnitude of all program variables.<n>Off-the-shelf SMT solver is used to determine whether the program exhibits any of these critical numerical pitfalls.
arXiv Detail & Related papers (2026-09-07T13:41:01Z) - A Mathematics-Guided Approach to Floating-Point Error Detection [9.800281082826567]
Floating-point program errors can lead to severe consequences, particularly in critical domains such as military applications.<n>We propose a novel method, named MGDE, to detect error-inducing inputs based on mathematical guidance.<n>By employing the Newton-Raphson method, which exhibits quadratic convergence properties, we achieve highly effective and efficient results.
arXiv Detail & Related papers (2025-10-11T07:38:14Z) - Give Me FP32 or Give Me Death? Challenges and Solutions for Reproducible Reasoning [54.970571745690634]
This work presents the first systematic investigation into how numerical precision affects Large Language Models inference.<n>We develop a lightweight inference pipeline, dubbed LayerCast, that stores weights in 16-bit precision but performs all computations in FP32.<n>Inspired by this, we develop a lightweight inference pipeline, dubbed LayerCast, that stores weights in 16-bit precision but performs all computations in FP32.
arXiv Detail & Related papers (2025-06-11T08:23:53Z) - Fast MLE and MAPE-Based Device Activity Detection for Grant-Free Access via PSCA and PSCA-Net [13.076905065264091]
Fast and accurate device activity is the critical challenge in grant-free access for supporting massive machine-type communications.<n>We propose new maximum likelihood estimation (MLE) based device activity detection methods.<n>We present a deep unrolling neural network implementation called PSCA-Net to further reduce the computation time.
arXiv Detail & Related papers (2025-03-19T14:31:09Z) - An Efficient Outlier Detection Algorithm for Data Streaming [51.56874851156008]
Traditional outlier detection methods, such as the Local Outlier Factor (LOF) algorithm, struggle with real-time data.<n>We propose a novel approach to enhance the efficiency of LOF algorithms for online anomaly detection, named the Efficient Incremental LOF (EILOF) algorithm.<n>The EILOF algorithm not only significantly reduces computational costs, but also systematically improves detection accuracy when the number of additional points increases.
arXiv Detail & Related papers (2025-01-02T05:12:43Z) - DELA: A Novel Approach for Detecting Errors Induced by Large Atomic Condition Numbers [10.580959733598519]
Most numerical errors stem from large condition numbers in atomic operations, which then propagate and accumulate.<n>Our approach is based on the observation that most numerical errors stem from large condition numbers in atomic operations.<n> DELA injects small perturbations into the results of individual atomic operations within the program and compares the outcomes of the original program with the perturbed version to detect errors.
arXiv Detail & Related papers (2024-12-30T08:56:46Z) - Impacts of floating-point non-associativity on reproducibility for HPC and deep learning applications [0.0]
Run to run variability in parallel programs caused by floating-point non-associativity has been known to significantly affect algorithms.
We investigate the statistical properties of floating-point non-associativity within modern parallel programming models.
We examine the recently-added deterministic options in PyTorch within the context of GPU deployment for deep learning.
arXiv Detail & Related papers (2024-08-09T16:07:37Z) - SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid Registration [76.40993825836222]
We propose SPARE, a novel formulation that utilizes a symmetrized point-to-plane distance for robust non-rigid registration.
The proposed method greatly improves the accuracy of non-rigid registration problems and maintains relatively high solution efficiency.
arXiv Detail & Related papers (2024-05-30T15:55:04Z) - Fast Flux-Activated Leakage Reduction for Superconducting Quantum
Circuits [84.60542868688235]
leakage out of the computational subspace arising from the multi-level structure of qubit implementations.
We present a resource-efficient universal leakage reduction unit for superconducting qubits using parametric flux modulation.
We demonstrate that using the leakage reduction unit in repeated weight-two stabilizer measurements reduces the total number of detected errors in a scalable fashion.
arXiv Detail & Related papers (2023-09-13T16:21:32Z) - Efficient Simulation of Leakage Errors in Quantum Error Correcting Codes Using Tensor Network Methods [0.196629787330046]
We present a computationally efficient simulation methodology for studying leakage errors in quantum error correcting codes (QECCs)<n>Our approach enables the simulation of various leakage processes, including thermal noise and coherent errors, without approximations.<n>By leveraging the small amount of entanglement generated during the error correction process, we are able to study large systems, up to a few hundred qudits, over many code cycles.
arXiv Detail & Related papers (2023-08-16T07:36:33Z) - Efficient Error Certification for Physics-Informed Neural Networks [25.712851771991218]
We introduce $partial$-CROWN: a general, efficient and scalable post-training framework to bound PINN residual errors.
We demonstrate its effectiveness in obtaining certificates tight by applying it to two classically studied PINNs and two more challenging ones with real-world applications.
arXiv Detail & Related papers (2023-05-17T12:19:43Z) - Fast and Accurate Error Simulation for CNNs against Soft Errors [64.54260986994163]
We present a framework for the reliability analysis of Conal Neural Networks (CNNs) via an error simulation engine.
These error models are defined based on the corruption patterns of the output of the CNN operators induced by faults.
We show that our methodology achieves about 99% accuracy of the fault effects w.r.t. SASSIFI, and a speedup ranging from 44x up to 63x w.r.t.FI, that only implements a limited set of error models.
arXiv Detail & Related papers (2022-06-04T19:45:02Z) - Measuring NISQ Gate-Based Qubit Stability Using a 1+1 Field Theory and
Cycle Benchmarking [50.8020641352841]
We study coherent errors on a quantum hardware platform using a transverse field Ising model Hamiltonian as a sample user application.
We identify inter-day and intra-day qubit calibration drift and the impacts of quantum circuit placement on groups of qubits in different physical locations on the processor.
This paper also discusses how these measurements can provide a better understanding of these types of errors and how they may improve efforts to validate the accuracy of quantum computations.
arXiv Detail & Related papers (2022-01-08T23:12:55Z) - AQD: Towards Accurate Fully-Quantized Object Detection [94.06347866374927]
We propose an Accurate Quantized object Detection solution, termed AQD, to get rid of floating-point computation.
Our AQD achieves comparable or even better performance compared with the full-precision counterpart under extremely low-bit schemes.
arXiv Detail & Related papers (2020-07-14T09:07:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.