Urban Rhapsody: Large-scale exploration of urban soundscapes
- URL: http://arxiv.org/abs/2205.13064v1
- Date: Wed, 25 May 2022 22:02:36 GMT
- Title: Urban Rhapsody: Large-scale exploration of urban soundscapes
- Authors: Joao Rulff, Fabio Miranda, Maryam Hosseini, Marcos Lage, Mark
Cartwright, Graham Dove, Juan Bello, Claudio T. Silva
- Abstract summary: Noise is one of the primary quality-of-life issues in urban environments.
Low-cost sensors can be deployed to monitor ambient noise levels at high temporal resolutions.
The amount of data they produce and the complexity of these data pose significant analytical challenges.
We propose Urban Rhapsody, a framework that combines state-of-the-art audio representation, machine learning, and visual analytics.
- Score: 12.997538969557649
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Noise is one of the primary quality-of-life issues in urban environments. In
addition to annoyance, noise negatively impacts public health and educational
performance. While low-cost sensors can be deployed to monitor ambient noise
levels at high temporal resolutions, the amount of data they produce and the
complexity of these data pose significant analytical challenges. One way to
address these challenges is through machine listening techniques, which are
used to extract features in attempts to classify the source of noise and
understand temporal patterns of a city's noise situation. However, the
overwhelming number of noise sources in the urban environment and the scarcity
of labeled data makes it nearly impossible to create classification models with
large enough vocabularies that capture the true dynamism of urban soundscapes
In this paper, we first identify a set of requirements in the yet unexplored
domain of urban soundscape exploration. To satisfy the requirements and tackle
the identified challenges, we propose Urban Rhapsody, a framework that combines
state-of-the-art audio representation, machine learning, and visual analytics
to allow users to interactively create classification models, understand noise
patterns of a city, and quickly retrieve and label audio excerpts in order to
create a large high-precision annotated database of urban sound recordings. We
demonstrate the tool's utility through case studies performed by domain experts
using data generated over the five-year deployment of a one-of-a-kind sensor
network in New York City.
Related papers
- LoRaWAN Based Dynamic Noise Mapping with Machine Learning for Urban Noise Enforcement [8.010966370223985]
Static noise maps depicting long-term noise levels over wide areas are valuable urban planning assets for municipalities.
Non-traffic noise sources with transient behavior, which people complain frequently, are usually ignored by static maps.
We propose here a dynamic noise mapping approach using the data collected via low-power wide-area network (LPWAN) based internet of things (IoT) infrastructure.
arXiv Detail & Related papers (2024-07-30T21:40:12Z) - Towards better visualizations of urban sound environments: insights from interviews [1.2599533416395765]
We analyze the need for the representations of sound sources, by identifying the urban stakeholders for whom such representations are assumed to be of importance.
Three distinct use of sound source representations emerged in this study: noise-related complaints for industrials and specialized citizens, soundscape quality assessment for citizens, and guidance for urban planners.
Findings reveal diverse perspectives for the use of visualizations, which should use indicators adapted to the target audience, and enable data accessibility.
arXiv Detail & Related papers (2024-06-11T07:39:48Z) - Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark [65.79402756995084]
Real Acoustic Fields (RAF) is a new dataset that captures real acoustic room data from multiple modalities.
RAF is the first dataset to provide densely captured room acoustic data.
arXiv Detail & Related papers (2024-03-27T17:59:56Z) - Explainable Artificial Intelligence driven mask design for
self-supervised seismic denoising [0.0]
Self-supervised coherent noise suppression methods require extensive knowledge of the noise statistics.
We propose the use of explainable artificial intelligence approaches to see inside the black box that is the denoising network.
We show that a simple averaging of the Jacobian contributions over a number of randomly selected input pixels, provides an indication of the most effective mask.
arXiv Detail & Related papers (2023-07-13T11:02:55Z) - Realistic Noise Synthesis with Diffusion Models [68.48859665320828]
Deep image denoising models often rely on large amount of training data for the high quality performance.
We propose a novel method that synthesizes realistic noise using diffusion models, namely Realistic Noise Synthesize Diffusor (RNSD)
RNSD can incorporate guided multiscale content, such as more realistic noise with spatial correlations can be generated at multiple frequencies.
arXiv Detail & Related papers (2023-05-23T12:56:01Z) - Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware
Adversarial Training [50.018580462619425]
We propose a novel framework, namely Pixel-level Noise-aware Generative Adrial Network (PNGAN)
PNGAN employs a pre-trained real denoiser to map the fake and real noisy images into a nearly noise-free solution space.
For better noise fitting, we present an efficient architecture Simple Multi-versa-scale Network (SMNet) as the generator.
arXiv Detail & Related papers (2022-04-06T14:09:02Z) - Removing Noise from Extracellular Neural Recordings Using Fully
Convolutional Denoising Autoencoders [62.997667081978825]
We propose a Fully Convolutional Denoising Autoencoder, which learns to produce a clean neuronal activity signal from a noisy multichannel input.
The experimental results on simulated data show that our proposed method can improve significantly the quality of noise-corrupted neural signals.
arXiv Detail & Related papers (2021-09-18T14:51:24Z) - Methodological Foundation of a Numerical Taxonomy of Urban Form [62.997667081978825]
We present a method for numerical taxonomy of urban form derived from biological systematics.
We derive homogeneous urban tissue types and, by determining overall morphological similarity between them, generate a hierarchical classification of urban form.
After framing and presenting the method, we test it on two cities - Prague and Amsterdam.
arXiv Detail & Related papers (2021-04-30T12:47:52Z) - Urban Space Insights Extraction using Acoustic Histogram Information [13.808053718325628]
We study the implementation of low-cost analogue sound sensors to detect outdoor activities and estimate the raining period in an urban residential area.
The analogue sound sensors are transmitted to the cloud every 5 minutes in histogram format, which consists of sound data sampled every 100ms (10Hz)
arXiv Detail & Related papers (2020-12-10T07:21:34Z) - A Flow Base Bi-path Network for Cross-scene Video Crowd Understanding in
Aerial View [93.23947591795897]
In this paper, we strive to tackle the challenges and automatically understand the crowd from the visual data collected from drones.
To alleviate the background noise generated in cross-scene testing, a double-stream crowd counting model is proposed.
To tackle the crowd density estimation problem under extreme dark environments, we introduce synthetic data generated by game Grand Theft Auto V(GTAV)
arXiv Detail & Related papers (2020-09-29T01:48:24Z) - SONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Context [32.84541094143274]
We present a dataset for urban sound tagging withtemporal information.
This dataset provides the opportunity to investigate how metadata can aid in the prediction of the urban sound tags.
arXiv Detail & Related papers (2020-09-11T01:19:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.