REVIVE: A Multi-Modal Framework for Vandalism Detection and Recovery in Autonomous Vehicles
- URL: http://arxiv.org/abs/2607.05649v1
- Date: Mon, 06 Jul 2026 21:25:41 GMT
- Title: REVIVE: A Multi-Modal Framework for Vandalism Detection and Recovery in Autonomous Vehicles
- Abstract summary: This paper presents the Recovery and Enhancement of Vandalized Images for Vision Excellence (REVIVE) framework.<n>It integrates binary VOA detection, (2) multi-class VOA pattern identification, (3) EfficientNet-based U-Net segmentation, and (4) type-aware recovery.<n>On 500 tracked clean/vandalized image pairs, unrecovered VOAs reduce YOLOv8l object-detection recall to 0.588, while direct pixel replacement restores recall to 0.967 and F1-score to 0.970.
- Score: 0.6445605125467572
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Autonomous vehicles (AVs) face increasing threats from vandalism-induced occlusion attacks (VOAs) that compromise camera-based perception. While detection frameworks can identify vandalized images, restoring camera-stream utility after physical occlusion remains underexplored. This paper presents present the Recovery and Enhancement of Vandalized Images for Vision Excellence (REVIVE) framework, a vandalism recovery pipeline integrating: (1) binary VOA detection, (2) multi-class VOA pattern identification, (3) EfficientNet-based U-Net segmentation, and (4) type-aware recovery using Bootstrapping Language-Image Pre-training (BLIP)-guided Stable Diffusion inpainting, direct pixel replacement, or adaptive median filtering. Stable Diffusion shows variable reconstruction performance (per-pattern SSIM 0.667-0.867, PSNR 15.4-26.7dB) across VOA patterns, while aligned direct pixel replacement achieves near-identical reconstruction under the aligned-reference condition. On 500 tracked clean/vandalized image pairs, unrecovered VOAs reduce YOLOv8l object-detection recall to 0.588, while direct pixel replacement restores recall to 0.967 and F1-score to 0.970 under that aligned-reference condition. LaMa, Telea, and Navier-Stokes baselines improve image similarity but provide more limited downstream detection recovery, and Stable Diffusion is treated as an asynchronous recovery branch subject to a quality gate rather than a blocking real-time perception step. We evaluate a reference-available quality gate that filters recovered candidates before downstream use: without it, type-aware routing degrades per-image recall to 0.304, whereas with it, recall returns to 0.608, at or above the unrecovered baseline, ensuring the forwarded stream is never worse than the unrecovered frame. REVIVE therefore, provides a structured recovery framework from VOAs in AVs.
Related papers
- Restore What Matters: Lessons from Joint Restoration and Recognition [72.91692240810536]
Recognition pipelines typically adopt a restore-then-recognize workflow, yet decades of experience show that generating visually pleasing images seldom to improved recognition.<n>We propose a Joint Restoration-for-Recognition paradigm: restore only what downstream tasks truly require, with task signals dictating where, how much, and whether restoration is necessary.<n>We conclude that better-looking images are neither necessary nor sufficient; restoration modules must be task-driven, selective, and physically aware.
arXiv Detail & Related papers (2026-09-12T08:08:08Z) - Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring [55.57242007016976]
Continuous emotion control in text-to-image generation requires a model to improve affective alignment without changing the objects, layout, or scene described by the prompt.<n>Existing supervised emotion-injection methods often optimize feature-space proxies and may therefore exhibit emotion-semantic drift.<n>We address this problem with a flow-matching image-generation framework that combines continuous valence-arousal conditioning, Group Relative Policy Optimization, and a neutral semantic anchor.
arXiv Detail & Related papers (2026-09-11T13:24:35Z) - DRIFT: Removing Diffusion Watermarks by Deflecting the Generative Trajectory [9.706332101916248]
Diffusion watermarking embeds verifiable signals into the generative process.<n>We propose DRIFT, a black-box attack that combines partial forward diffusion with reverse resampling.<n>Across nine watermarks spanning three paradigms, DRIFT achieves 98-100% attack success and the best image quality.
arXiv Detail & Related papers (2026-09-08T03:54:17Z) - Restoring Without Forgetting: Continual Learning Across Image Degradations [6.288045889067255]
Recent progress in image restoration has converged on all-in-one architectures that jointly handle multiple degradations within a single network.<n>In practice, degradations are encountered sequentially as field-deployed systems progressively face new environmental conditions.<n>We formulate multi-degradation image restoration as a continual domain-incremental learning problem.
arXiv Detail & Related papers (2026-08-24T20:04:18Z) - Bend the Basics: Degradation-Aware Deformable Tokenization for All-in-One Image Restoration [72.64498743287601]
All-in-one image restoration seeks a single model that can recover images degraded by diverse and spatially non-uniform corruptions.<n>We present Flexible Image Transformer (FIT) that explicitly models degradation awareness across the entire pipeline.<n>FIT achieves state-of-the-art performance with 30.72 dB average PSNR on the five-degradation setting and 32.83 dB on the three-degradation setting, outperforming recent unified restoration methods by +0.5$sim$1.1 dB.
arXiv Detail & Related papers (2026-08-07T05:44:31Z) - Coupled Continuous-Discrete Generation for Scene Text Image Super-Resolution [51.31474187379532]
Scene text image super-resolution (STISR) aims to recover visually plausible appearance while preserving character semantics from degraded inputs.<n>We present DualTSR, a unified framework that formulates STISR as coupled continuous-discrete generation.<n> Conditional flow matching restores continuous image latents, while absorbing-state discrete diffusion reconstructs text tokens.
arXiv Detail & Related papers (2026-08-05T06:57:30Z) - Gaussian Process Prior Variational Autoencoder for Endoscopic Videos [6.831828660437534]
Video sequences are routinely degraded by specular reflections, motion artifacts, and missing frames.<n>We introduce a Gaussian Process Prior Variational Autoencoder (GPVAE) framework for endoscopic video restoration.<n>On the C3VDv2 colonoscopy dataset, the best GPVAE variants reduced image reconstruction RMSE by 21.9% on average.
arXiv Detail & Related papers (2026-06-18T08:03:55Z) - Where to Refine, When to Stop: Rethinking Redundancy via Latent Discrepancy for Efficient Visual Autoregressive Generation [50.139984798361375]
We propose a training-free framework that removes redundancy via latent discrepancy.<n> LD-Pruning substantially reduces inference while maintaining high generation quality, achieving up to 2.35x speedup on Infinity-8B.
arXiv Detail & Related papers (2026-05-29T19:34:39Z) - Restoration-Aligned Generative Flow Models for Blind Motion Deblurring [57.425021485907756]
We present DeFlow, a framework that resolves misalignment by reformulating the flow trajectory itself.<n>Under this formulation, the standard flow matching loss naturally takes the form of a residual loss.<n>Experiments on GoPro, HIDE, RealBlur, and RWBI demonstrate that DeFlow achieves strong restoration fidelity and perceptual realism.
arXiv Detail & Related papers (2026-05-09T10:05:51Z) - SoLAR: Error-Resilient Streamable Long-Horizon Free-Viewpoint Video Reconstruction with Anchor Activation and Latent Recalibration [57.159190580279585]
Motivated by bit allocation theory, we analyze dynamic-anchor-based volumetric video representation within a rate-distortion optimization framework.<n>We propose textbfSoLAR, which is the first error-resilient streamable FVV framework that maintains stable reconstruction quality on long sequences.
arXiv Detail & Related papers (2026-05-08T06:48:59Z) - UniV2D: Bridging Visual Restoration and Semantic Perception for Underwater Salient Object Detection [71.83097731030254]
We propose a Unified Vision-to-Detection Network (UniV2D) to jointly optimize visual restoration and salient object detection.<n>UniV2D introduces a semantic-driven learning paradigm: high-level saliency semantics actively guide the restoration process.<n>It significantly outperforms state-of-the-art methods in both quantitative and qualitative evaluations.
arXiv Detail & Related papers (2026-05-08T02:31:45Z) - Compositional-Degradation UAV Image Restoration: Conditional Decoupled MoE Network and A Benchmark [27.358052049742764]
UAV images are critical for applications such as large-area mapping, infrastructure inspection, and emergency response.<n>In real-world flight environments, a single image is often affected by multiple degradation factors, including rain, haze, and noise.<n>We propose DAME-Net, a Degradation-Aware Mixture-of-Experts Network that decouples explicit degradation perception from degradation-conditioned reconstruction.
arXiv Detail & Related papers (2026-04-10T13:27:39Z) - D3R-Net: Dual-Domain Denoising Reconstruction Network for Robust Industrial Anomaly Detection [0.0]
Unsupervised anomaly detection (UAD) is a key ingredient of automated visual inspection in modern manufacturing.<n>We introduce D3R-Net, a Dual-Domain Denoising Reconstruction framework that couples a self-supervised 'healing' task with frequency-aware regularization.<n>In addition to the spatial mean squared error, we employ a Fast Fourier Transform (FFT) magnitude loss that encourages consistency in the frequency domain.
arXiv Detail & Related papers (2026-01-27T23:21:59Z) - Learning to Restore Multi-Degraded Images via Ingredient Decoupling and Task-Aware Path Adaptation [51.10017611491389]
Real-world images often suffer from multiple coexisting degradations, such as rain, noise, and haze coexisting in a single image.<n>We propose an adaptive multi-degradation image restoration network that reconstructs images by leveraging decoupled representations of degradation ingredients.<n>The resulting tightly integrated architecture, termed IMDNet, is extensively validated through experiments.
arXiv Detail & Related papers (2025-11-07T01:50:36Z) - Delving into Cascaded Instability: A Lipschitz Continuity View on Image Restoration and Object Detection Synergy [95.93943805282868]
Lipschitz-regularized object detection (LROD)<n>We propose Lipschitz-regularized YOLO (LR-YOLO), a framework that integrates image restoration directly into the detector's feature learning.<n> experiments on haze and low-light benchmarks demonstrate that LR-YOLO consistently improves detection stability, optimization smoothness, and overall accuracy.
arXiv Detail & Related papers (2025-10-28T09:41:42Z) - CapRecover: A Cross-Modality Feature Inversion Attack Framework on Vision Language Models [11.201984255831126]
CapRecover recovers high-level semantic content, such as labels or captions, directly from intermediate features without image reconstruction.<n>We introduce a simple yet effective protection method: adding random noise to intermediate features at each layer and removing the noise in the next layer.
arXiv Detail & Related papers (2025-07-30T16:42:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.