Enemy Spotted: in-game gun sound dataset for gunshot classification and localization

• URL: http://arxiv.org/abs/2210.05917v1
• Date: Wed, 12 Oct 2022 04:36:56 GMT
• Title: Enemy Spotted: in-game gun sound dataset for gunshot classification and localization
• Authors: Junwoo Park, Youngwoo Cho, Gyuhyeon Sim, Hojoon Lee, Jaegul Choo
• Abstract summary: Gun sounds can be obtained from an FPS game that is designed to mimic real-world warfare. The BGG dataset consists of 37 different types of firearms, distances, and directions between the sound source and a receiver. We demonstrate that the accuracy of real-world firearm classification and localization tasks can be enhanced by utilizing the BGG dataset.
• Score: 27.554240980052025
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Recently, deep learning-based methods have drawn huge attention due to their simple yet high performance without domain knowledge in sound classification and localization tasks. However, a lack of gun sounds in existing datasets has been a major obstacle to implementing a support system to spot criminals from their gunshots by leveraging deep learning models. Since the occurrence of gunshot is rare and unpredictable, it is impractical to collect gun sounds in the real world. As an alternative, gun sounds can be obtained from an FPS game that is designed to mimic real-world warfare. The recent FPS game offers a realistic environment where we can safely collect gunshot data while simulating even dangerous situations. By exploiting the advantage of the game environment, we construct a gunshot dataset, namely BGG, for the firearm classification and gunshot localization tasks. The BGG dataset consists of 37 different types of firearms, distances, and directions between the sound source and a receiver. We carefully verify that the in-game gunshot data has sufficient information to identify the location and type of gunshots by training several sound classification and localization baselines on the BGG dataset. Afterward, we demonstrate that the accuracy of real-world firearm classification and localization tasks can be enhanced by utilizing the BGG dataset.

Related papers

• Learning 3D Perception from Others' Predictions [64.09115694891679]
  We investigate a new scenario to construct 3D object detectors: learning from the predictions of a nearby unit that is equipped with an accurate detector. For example, when a self-driving car enters a new area, it may learn from other traffic participants whose detectors have been optimized for that area.
  arXiv  Detail & Related papers  (2024-10-03T16:31:28Z)
• Active shooter detection and robust tracking utilizing supplemental synthetic data [6.719034568121972]
  Gun violence in the United States has led to a focus on developing systems to improve public safety. One approach is to detect and track shooters, which would help prevent or mitigate the impact of violent incidents. We propose detecting shooters as a whole, rather than just guns, which would allow for improved tracking robustness.
  arXiv  Detail & Related papers  (2023-09-06T21:58:58Z)
• Distribution-Aware Calibration for Object Detection with Noisy Bounding Boxes [58.2797274877934]
  We propose DIStribution-aware CalibratiOn (DISCO) to model the spatial distribution of proposals for calibrating supervision signals. Three distribution-aware techniques are developed to improve classification, localization, and interpretability.
  arXiv  Detail & Related papers  (2023-08-23T09:20:05Z)
• Ammunition Component Classification Using Deep Learning [0.8808993671472349]
  Ammo scrap containing energetics is considered to be potentially dangerous and should be separated before the recycling process. We have gathered a dataset of ammunition components with the goal of applying artificial intelligence for classifying safe and unsafe scrap pieces automatically.
  arXiv  Detail & Related papers  (2022-08-26T20:42:39Z)
• YouTube-GDD: A challenging gun detection dataset with rich contextual information [5.956046069509441]
  This work presents a new challenging dataset called YouTube Gun Detection dataset (YouTube-GDD) Our dataset is collected from 343 high-definition YouTube videos and contains 5000 well-chosen images, in which 16064 instances of gun and 9046 instances of person are annotated. To build a baseline for gun detection, we evaluate YOLOv5 on YouTube-GDD and analyze the influence of additional related annotated information on gun detection.
  arXiv  Detail & Related papers  (2022-03-08T14:55:10Z)
• A Gun Detection Dataset and Searching for Embedded Device Solutions [1.2149550080095914]
  We publish a dataset with 51K annotated gun images for gun detection and other 51K cropped gun chip images for gun classification. To our knowledge, this is the largest dataset for the study of gun detection. We also study to search for solutions for gun detection in embedded edge device (camera) and a gun/non-gun classification on a cloud server.
  arXiv  Detail & Related papers  (2021-05-03T17:58:45Z)
• Multimodal Attention Fusion for Target Speaker Extraction [108.73502348754842]
  We propose a novel attention mechanism for multi-modal fusion and its training methods. Our proposals improve signal to distortion ratio (SDR) by 1.0 dB over conventional fusion mechanisms on simulated data.
  arXiv  Detail & Related papers  (2021-02-02T05:59:35Z)
• Discriminative Sounding Objects Localization via Self-supervised Audiovisual Matching [87.42246194790467]
  We propose a two-stage learning framework to perform self-supervised class-aware sounding object localization. We show that our model is superior in filtering out silent objects and pointing out the location of sounding objects of different classes.
  arXiv  Detail & Related papers  (2020-10-12T05:51:55Z)
• Sound of Guns: Digital Forensics of Gun Audio Samples meets Artificial Intelligence [0.7734726150561086]
  We introduce a novel technique that requires zero knowledge about the recording setup and is completely agnostic to the relative positions of both the microphone and shooter. Our solution can identify the category, caliber, and model of the gun, reaching over 90% accuracy on a dataset composed of 3655 samples.
  arXiv  Detail & Related papers  (2020-04-15T09:12:45Z)
• Know Your Surroundings: Exploiting Scene Information for Object Tracking [181.1750279330811]
  Current state-of-the-art trackers only rely on a target appearance model in order to localize the object in each frame. We propose a novel tracking architecture which can utilize scene information for tracking.
  arXiv  Detail & Related papers  (2020-03-24T17:59:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.