A statistical approach for finding property-access errors
- URL: http://arxiv.org/abs/2306.08741v1
- Date: Wed, 14 Jun 2023 20:50:12 GMT
- Title: A statistical approach for finding property-access errors
- Abstract summary: We study the problem of finding incorrect property accesses in JavaScript where objects do not have a fixed layout.
Since referencing a non-existent property is not an error in JavaScript, accidental accesses to non-existent properties can go undetected.
We propose a two-phase approach for detecting property access errors based on the observation that, in practice, most property accesses will be correct.
- Score: 2.4171019220503402
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We study the problem of finding incorrect property accesses in JavaScript
where objects do not have a fixed layout, and properties (including methods)
can be added, overwritten, and deleted freely throughout the lifetime of an
object. Since referencing a non-existent property is not an error in
JavaScript, accidental accesses to non-existent properties (caused, perhaps, by
a typo or by a misunderstanding of API documentation) can go undetected without
thorough testing, and may manifest far from the source of the problem. We
propose a two-phase approach for detecting property access errors based on the
observation that, in practice, most property accesses will be correct. First a
large number of property access patterns is collected from an extensive corpus
of real-world JavaScript code, and a statistical analysis is performed to
identify anomalous usage patterns. Specific instances of these patterns may not
be bugs (due, e.g., dynamic type checks), so a local data-flow analysis filters
out instances of anomalous property accesses that are safe and leaves only
those likely to be actual bugs. We experimentally validate our approach,
showing that on a set of 100 concrete instances of anomalous property accesses,
the approach achieves a precision of 82% with a recall of 90%, making it
suitable for practical use. We also conducted an experiment to determine how
effective the popular VSCode code completion feature is at suggesting object
properties, and found that, while it never suggested an incorrect property
(precision of 100%), it failed to suggest the correct property in 62 out of 80
cases (recall of 22.5%). This shows that developers cannot rely on VSCode's
code completion alone to ensure that all property accesses are valid.
Related papers
- From Blind Edits to Verified Repair: Building Trustworthy User-Side LLM Agents for Web Accessibility [0.5872014229110213]
A Chrome extension extracts a page's style sheets, condenses them to fit a local model's context window, and injects the result reversibly into the live page.<n>A dual-condition protocol measures harm as carefully as benefit, applied to six small open-weight models (7B to 14B) on ten violation-rich and ten highly accessible live sites.<n>A verified repair instrument pairs a trilingual seeded-violation benchmark with an audit-inject-verify loop that accepts a change only if violations strictly decrease.
arXiv Detail & Related papers (2026-07-26T17:21:24Z) - AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents [83.37969790806069]
LLM agent failures are difficult to debug because the step where an error surfaces is often not the one that caused it.<n>We present Agent DebuggerX, an open-source framework that organizes debug as a closed loop of Detect, Attribute, Recover, and Rerun.<n>At its core, Deep Debugger performs multi-turn root-cause diagnosis through global trajectory understanding.
arXiv Detail & Related papers (2026-07-21T06:21:13Z) - Analyzing Training-Free Corruption Detection for Object Detection Datasets [38.81744741217717]
We analyze the applicability of feature-space-based approaches for detecting annotation errors in object detection datasets.<n>We show that such approaches reliably expose semantic mislabel, while positional errors remain difficult to detect.
arXiv Detail & Related papers (2026-06-09T10:17:45Z) - From Exploration to Specification: LLM-Based Property Generation for Mobile App Testing [15.240612891177884]
PropGen is an automated approach for generating properties for Android apps.<n>PropGen identifies and executes valid app functionalities, generate valid properties, and repair most imprecise ones.<n>We found 25 previously unknown functional bugs in the latest versions of the subject apps.
arXiv Detail & Related papers (2026-04-15T04:33:53Z) - Detecting and Correcting Hallucinations in LLM-Generated Code via Deterministic AST Analysis [11.687400527666476]
This paper investigates whether a deterministic, static-analysis framework can reliably detect textitand auto-correct KCHs.<n>We propose a post-processing framework that parses generated code into an Abstract Syntax Tree (AST) and validates it against a dynamically-generated Knowledge Base (KB)<n>This non-executing approach uses deterministic rules to find and fix both API and identifier-level conflicts.
arXiv Detail & Related papers (2026-01-27T02:16:37Z) - Fine-Grained 1-Day Vulnerability Detection in Binaries via Patch Code Localization [12.73365645156957]
1-day vulnerabilities in binaries have become a major threat to software security.
patch presence test is one of the effective ways to detect the vulnerability.
We propose a novel approach named PLocator, which leverages stable values from both the patch code and its context.
arXiv Detail & Related papers (2025-01-29T04:35:37Z) - Measuring the Influence of Incorrect Code on Test Generation [22.168699378889148]
We show that tests generated for incorrect code experience a 47% worse bug detection rate.
Improvements of +18% in accuracy, +4% coverage, and +34% in bug detection can be achieved by providing natural language code descriptions.
arXiv Detail & Related papers (2024-09-14T15:17:34Z) - Bayesian Detector Combination for Object Detection with Crowdsourced Annotations [49.43709660948812]
Acquiring fine-grained object detection annotations in unconstrained images is time-consuming, expensive, and prone to noise.
We propose a novel Bayesian Detector Combination (BDC) framework to more effectively train object detectors with noisy crowdsourced annotations.
BDC is model-agnostic, requires no prior knowledge of the annotators' skill level, and seamlessly integrates with existing object detection models.
arXiv Detail & Related papers (2024-07-10T18:00:54Z) - Automatic Defect Detection in Sewer Network Using Deep Learning Based Object Detector [0.0]
A dataset with 14.7 km of various sewer pipes was annotated.
An object detector (EfficientDet-D0) was trained for automatic defect detection.
It was able to detect 83% of defects in the test set; out of the missing 17%, only 0.77% are very severe defects.
arXiv Detail & Related papers (2024-04-09T11:13:36Z) - FineWAVE: Fine-Grained Warning Verification of Bugs for Automated Static Analysis Tools [18.927121513404924]
Automated Static Analysis Tools (ASATs) have evolved over time to assist in detecting bugs.
Previous research efforts have explored learning-based methods to validate the reported warnings.
We propose FineWAVE, a learning-based approach that verifies bug-sensitive warnings at a fine-grained granularity.
arXiv Detail & Related papers (2024-03-24T06:21:35Z) - RESTRuler: Towards Automatically Identifying Violations of RESTful
Design Rules in Web APIs [3.4711214580685557]
We present RESTRuler, a Java-based open-source tool that uses static analysis to detect design rule violations in OpenAPI descriptions.
For robustness, RESTRuler successfully analyzed 99% of the used real-world OpenAPI definitions.
For performance efficiency, the tool performed well for the majority of files and could analyze 84% in less than 23 seconds with low CPU and RAM usage.
arXiv Detail & Related papers (2024-02-21T11:25:22Z) - Yuga: Automatically Detecting Lifetime Annotation Bugs in the Rust Language [15.164423552903571]
Security vulnerabilities have been reported in Rust projects, often attributed to the use of "unsafe" Rust code.
These vulnerabilities, in part, arise from incorrect lifetime annotations on function signatures.
Existing tools fail to detect these bugs, primarily because such bugs are rare, challenging to detect through dynamic analysis.
We devise a novel static analysis tool, Yuga, to detect potential lifetime annotation bugs.
arXiv Detail & Related papers (2023-10-12T17:05:03Z) - SalienDet: A Saliency-based Feature Enhancement Algorithm for Object
Detection for Autonomous Driving [160.57870373052577]
We propose a saliency-based OD algorithm (SalienDet) to detect unknown objects.
Our SalienDet utilizes a saliency-based algorithm to enhance image features for object proposal generation.
We design a dataset relabeling approach to differentiate the unknown objects from all objects in training sample set to achieve Open-World Detection.
arXiv Detail & Related papers (2023-05-11T16:19:44Z) - Black-box Dataset Ownership Verification via Backdoor Watermarking [67.69308278379957]
We formulate the protection of released datasets as verifying whether they are adopted for training a (suspicious) third-party model.
We propose to embed external patterns via backdoor watermarking for the ownership verification to protect them.
Specifically, we exploit poison-only backdoor attacks ($e.g.$, BadNets) for dataset watermarking and design a hypothesis-test-guided method for dataset verification.
arXiv Detail & Related papers (2022-08-04T05:32:20Z) - ObjectSeeker: Certifiably Robust Object Detection against Patch Hiding
Attacks via Patch-agnostic Masking [95.6347501381882]
Object detectors are found to be vulnerable to physical-world patch hiding attacks.
We propose ObjectSeeker as a framework for building certifiably robust object detectors.
arXiv Detail & Related papers (2022-02-03T19:34:25Z) - Slender Object Detection: Diagnoses and Improvements [74.40792217534]
In this paper, we are concerned with the detection of a particular type of objects with extreme aspect ratios, namely textbfslender objects.
For a classical object detection method, a drastic drop of $18.9%$ mAP on COCO is observed, if solely evaluated on slender objects.
arXiv Detail & Related papers (2020-11-17T09:39:42Z) - Empirical Upper Bound, Error Diagnosis and Invariance Analysis of Modern
Object Detectors [47.64219291655723]
We employ 2 state-of-the-art object detection benchmarks, and analyze more than 15 models over 4 large scale datasets.
We find that models generate a lot of boxes on empty regions and that context is more important for detecting small objects than larger ones.
arXiv Detail & Related papers (2020-04-05T06:19:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.