World of Bugs: A Platform for Automated Bug Detection in 3D Video Games
- URL: http://arxiv.org/abs/2206.11037v1
- Date: Tue, 21 Jun 2022 10:52:03 GMT
- Title: World of Bugs: A Platform for Automated Bug Detection in 3D Video Games
- Authors: Benedict Wilkins, Kostas Stathis
- Abstract summary: We present World of Bugs, an open platform that aims to support Automated Bug Detection research in video games.
Key feature is a growing collection of common video game bugs that may be used for training and evaluating ABD approaches.
- Score: 1.370633147306388
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: We present World of Bugs (WOB), an open platform that aims to support
Automated Bug Detection (ABD) research in video games. We discuss some open
problems in ABD and how they relate to the platform's design, arguing that
learning-based solutions are required if further progress is to be made. The
platform's key feature is a growing collection of common video game bugs that
may be used for training and evaluating ABD approaches.
Related papers
- SADAS: A Dialogue Assistant System Towards Remediating Norm Violations
in Bilingual Socio-Cultural Conversations [56.31816995795216]
Socially-Aware Dialogue Assistant System (SADAS) is designed to ensure that conversations unfold with respect and understanding.
Our system's novel architecture includes: (1) identifying the categories of norms present in the dialogue, (2) detecting potential norm violations, (3) evaluating the severity of these violations, and (4) implementing targeted remedies to rectify the breaches.
arXiv Detail & Related papers (2024-01-29T08:54:21Z) - Finding the Needle in a Haystack: Detecting Bug Occurrences in Gameplay
Videos [10.127506928281413]
We present an automated approach that uses machine learning to predict whether a segment of a gameplay video contains a depiction of a bug.
We analyzed 4,412 segments of 198 gameplay videos to predict whether a segment contains an instance of a bug.
Our approach is effective at detecting segments of a video that contain bugs, achieving a high F1 score of 0.88, outperforming the current state-of-the-art technique for bug classification.
arXiv Detail & Related papers (2023-11-18T01:14:18Z) - Weak Supervision for Label Efficient Visual Bug Detection [0.0]
Traditional testing methods, limited by resources, face difficulties in addressing the plethora of potential bugs.
We propose a novel method, utilizing unlabeled gameplay and domain-specific augmentations to generate datasets & self-supervised objectives.
Our methodology uses weak-supervision to scale datasets for the crafted objectives and facilitates both autonomous and interactive weak-supervision.
arXiv Detail & Related papers (2023-09-20T06:00:02Z) - Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectors [3.39487428163997]
We show that large language models can identify which event is buggy in a sequence of textual descriptions of events from a game.
Our results show promising results for employing language models to detect video game bugs.
arXiv Detail & Related papers (2022-10-05T18:44:35Z) - BigIssue: A Realistic Bug Localization Benchmark [89.8240118116093]
BigIssue is a benchmark for realistic bug localization.
We provide a general benchmark with a diversity of real and synthetic Java bugs.
We hope to advance the state of the art in bug localization, in turn improving APR performance and increasing its applicability to the modern development cycle.
arXiv Detail & Related papers (2022-07-21T20:17:53Z) - Inspector: Pixel-Based Automated Game Testing via Exploration,
Detection, and Investigation [116.41186277555386]
Inspector is a game testing agent that can be easily applied to different games without deep integration with games.
Inspector is based on purely pixel inputs and comprises three key modules: game space explorer, key object detector, and human-like object investigator.
Experiment results demonstrate the effectiveness of Inspector in exploring game space, detecting key objects, and investigating objects.
arXiv Detail & Related papers (2022-07-18T04:49:07Z) - Learning to Identify Perceptual Bugs in 3D Video Games [1.370633147306388]
We show that it is possible to identify a range of perceptual bugs using learning-based methods.
World of Bugs (WOB) is an open platform for testing ABD methods in 3D game environments.
arXiv Detail & Related papers (2022-02-25T18:50:11Z) - CCPT: Automatic Gameplay Testing and Validation with
Curiosity-Conditioned Proximal Trajectories [65.35714948506032]
The Curiosity-Conditioned Proximal Trajectories (CCPT) method combines curiosity and imitation learning to train agents to explore.
We show how CCPT can explore complex environments, discover gameplay issues and design oversights in the process, and recognize and highlight them directly to game designers.
arXiv Detail & Related papers (2022-02-21T09:08:33Z) - 3DB: A Framework for Debugging Computer Vision Models [105.45042148499323]
3DB allows users to discover vulnerabilities in computer vision systems.
3DB captures and generalizes many analyses from prior work.
We find that the insights generated by the system transfer to the physical world.
arXiv Detail & Related papers (2021-06-07T17:16:12Z) - OpenHoldem: An Open Toolkit for Large-Scale Imperfect-Information Game
Research [82.09426894653237]
OpenHoldem is an integrated toolkit for large-scale imperfect-information game research using NLTH.
OpenHoldem makes three main contributions to this research direction: 1) a standardized evaluation protocol for thoroughly evaluating different NLTH AIs, 2) three publicly available strong baselines for NLTH AI, and 3) an online testing platform with easy-to-use APIs for public NLTH AI evaluation.
arXiv Detail & Related papers (2020-12-11T07:24:08Z) - A Metric Learning Approach to Anomaly Detection in Video Games [1.1602089225841632]
We develop State-State Siamese Networks (S3N) as an efficient deep metric learning approach to anomaly detection.
We show by empirical evaluation on a series of Atari games, that S3N is able to learn a meaningful embedding.
arXiv Detail & Related papers (2020-05-20T17:23:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.