Dynamic Error-bounded Lossy Compression (EBLC) to Reduce the Bandwidth
Requirement for Real-time Vision-based Pedestrian Safety Applications
- URL: http://arxiv.org/abs/2002.03742v1
- Date: Wed, 29 Jan 2020 17:21:51 GMT
- Title: Dynamic Error-bounded Lossy Compression (EBLC) to Reduce the Bandwidth
Requirement for Real-time Vision-based Pedestrian Safety Applications
- Authors: Mizanur Rahman, Mhafuzul Islam, Jon C. Calhoun and Mashrur Chowdhury
- Abstract summary: Video compression can impair real-time constraints of an ITS application, such as video-based real-time pedestrian detection.
We develop a real-time error-bounded lossy compression (EBLC) strategy to dynamically change the video compression level depending on different environmental conditions.
- Score: 6.152873761869356
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: As camera quality improves and their deployment moves to areas with limited
bandwidth, communication bottlenecks can impair real-time constraints of an ITS
application, such as video-based real-time pedestrian detection. Video
compression reduces the bandwidth requirement to transmit the video but
degrades the video quality. As the quality level of the video decreases, it
results in the corresponding decreases in the accuracy of the vision-based
pedestrian detection model. Furthermore, environmental conditions (e.g., rain
and darkness) alter the compression ratio and can make maintaining a high
pedestrian detection accuracy more difficult. The objective of this study is to
develop a real-time error-bounded lossy compression (EBLC) strategy to
dynamically change the video compression level depending on different
environmental conditions in order to maintain a high pedestrian detection
accuracy. We conduct a case study to show the efficacy of our dynamic EBLC
strategy for real-time vision-based pedestrian detection under adverse
environmental conditions. Our strategy selects the error tolerances dynamically
for lossy compression that can maintain a high detection accuracy across a
representative set of environmental conditions. Analyses reveal that our
strategy increases pedestrian detection accuracy up to 14% and reduces the
communication bandwidth up to 14x for adverse environmental conditions compared
to the same conditions but without our dynamic EBLC strategy. Our dynamic EBLC
strategy is independent of detection models and environmental conditions
allowing other detection models and environmental conditions to be easily
incorporated in our strategy.
Related papers
- Snapshot Compressed Imaging Based Single-Measurement Computer Vision for Videos [12.322783570127756]
Snapshot imaging (SCI) is a promising technique for capturing high-speed video at low bandwidth and low power.
SCI also faces challenges in low-lighting photon-limited and low-signal-to-noise-ratio image conditions.
We propose a novel Compressive Denoising Autoencoder (CompDAE) using the STFormer architecture as the backbone.
arXiv Detail & Related papers (2025-01-25T08:20:30Z) - RL-RC-DoT: A Block-level RL agent for Task-Aware Video Compression [68.31184784672227]
In modern applications such as autonomous driving, an overwhelming majority of videos serve as input for AI systems performing tasks.
It is therefore useful to optimize the encoder for a downstream task instead of for image quality.
Here, we address this challenge by controlling the Quantization Parameters (QPs) at the macro-block level to optimize the downstream task.
arXiv Detail & Related papers (2025-01-21T15:36:08Z) - Rethinking High-speed Image Reconstruction Framework with Spike Camera [48.627095354244204]
Spike cameras generate continuous spike streams to capture high-speed scenes with lower bandwidth and higher dynamic range than traditional RGB cameras.
We introduce a novel spike-to-image reconstruction framework SpikeCLIP that goes beyond traditional training paradigms.
Our experiments on real-world low-light datasets demonstrate that SpikeCLIP significantly enhances texture details and the luminance balance of recovered images.
arXiv Detail & Related papers (2025-01-08T13:00:17Z) - Deep Learning-Based Image Compression for Wireless Communications: Impacts on Reliability,Throughput, and Latency [41.77014570882275]
In wireless communications, efficient image transmission must balance reliability, throughput, and latency.
We investigate two state-of-the-art learning-based models: the hyperprior model and Vector Quantized Generative Adversarial Network (VQGAN)
We propose progressive versions of both models, enabling partial image transmission and decoding under imperfect channel conditions.
arXiv Detail & Related papers (2024-11-16T01:14:55Z) - Evaluation of Video-Based rPPG in Challenging Environments: Artifact Mitigation and Network Resilience [1.6637373649145606]
Video-based remote photoplethysmography (r) has emerged as a promising technology for non-contact vital sign monitoring.
However, the accurate measurement of vital signs in real-world scenarios faces several challenges.
arXiv Detail & Related papers (2024-05-02T12:21:51Z) - No-frills Temporal Video Grounding: Multi-Scale Neighboring Attention
and Zoom-in Boundary Detection [52.03562682785128]
Temporal video grounding aims to retrieve the time interval of a language query from an untrimmed video.
A significant challenge in TVG is the low "Semantic Noise Ratio (SNR)", which results in worse performance with lower SNR.
We propose a no-frills TVG model that consists of two core modules, namely multi-scale neighboring attention and zoom-in boundary detection.
arXiv Detail & Related papers (2023-07-20T04:12:10Z) - StreamYOLO: Real-time Object Detection for Streaming Perception [84.2559631820007]
We endow the models with the capacity of predicting the future, significantly improving the results for streaming perception.
We consider multiple velocities driving scene and propose Velocity-awared streaming AP (VsAP) to jointly evaluate the accuracy.
Our simple method achieves the state-of-the-art performance on Argoverse-HD dataset and improves the sAP and VsAP by 4.7% and 8.2% respectively.
arXiv Detail & Related papers (2022-07-21T12:03:02Z) - DNN-Driven Compressive Offloading for Edge-Assisted Semantic Video
Segmentation [7.9955920576321615]
This paper introduces STAC, a uniform compression scheme tailored for edge-assisted semantic segmentation.
We show that STAC can save up to 20.95% of bandwidth without losing accuracy, compared to the state-of-the-art algorithm.
arXiv Detail & Related papers (2022-03-28T03:49:57Z) - Vision in adverse weather: Augmentation using CycleGANs with various
object detectors for robust perception in autonomous racing [70.16043883381677]
In autonomous racing, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres.
In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions.
We introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors.
arXiv Detail & Related papers (2022-01-10T10:02:40Z) - CANS: Communication Limited Camera Network Self-Configuration for
Intelligent Industrial Surveillance [8.360870648463653]
Realtime and intelligent video surveillance via camera networks involve computation-intensive vision detection tasks with massive video data.
Multiple video streams compete for limited communication resources on the link between edge devices and camera networks.
An adaptive camera network self-configuration method (CANS) of video surveillance is proposed to cope with multiple video streams of heterogeneous quality of service.
arXiv Detail & Related papers (2021-09-13T01:54:33Z) - Energy-Efficient Model Compression and Splitting for Collaborative
Inference Over Time-Varying Channels [52.60092598312894]
We propose a technique to reduce the total energy bill at the edge device by utilizing model compression and time-varying model split between the edge and remote nodes.
Our proposed solution results in minimal energy consumption and $CO$ emission compared to the considered baselines.
arXiv Detail & Related papers (2021-06-02T07:36:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.