Strictly Causal Streaming Video Anomaly Detection with a Theoretically-Grounded State-Space Core

• URL: http://arxiv.org/abs/2608.24810v1
• Date: Tue, 25 Aug 2026 16:52:32 GMT
• Title: Strictly Causal Streaming Video Anomaly Detection with a Theoretically-Grounded State-Space Core
• Abstract summary: We introduce a causal streaming anomaly detector with no lookahead and no clip buffering.<n>Its temporal core is a diagonal linear state space recurrence with an input and state dependent decay gate.<n>We derive a closed form relationship between the recurrence decay spectrum and both detection delay and the shortest anomaly it can reliably capture.
• Score: 2.648500779572419
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent work has applied Mamba style state space models (SSMs) to video anomaly detection, yet existing approaches still rely on buffering clips or windows internally, lack a theoretical account of how temporal memory relates to detection latency, and benchmark efficiency only through GPU throughput rather than the edge hardware these methods are intended to target. We introduce a strictly causal streaming anomaly detector whose fixed size state is updated in O(1) time and memory per incoming frame, with no lookahead and no clip buffering. Its temporal core is a diagonal linear state space recurrence with an input and state dependent decay gate, trained self supervised through causal next embedding prediction on a frozen visual backbone. We derive a closed form relationship between the recurrence decay spectrum and both detection delay and the shortest anomaly it can reliably capture, then validate empirically on UCSD Ped2 and CUHK Avenue. The settling delay bound predicted from the learned base decay (57 to 59 frames) sits far above the measured detection delay (1.6 and 18.4 frames), showing that the event boundary gate, not the base decay, governs responsiveness. We further report end to end latency and throughput measured directly on Apple M3 Pro hardware, 0.74 ms and 0.77 ms per frame (over 1300 FPS), rather than simulated GPU numbers. With an untuned initial configuration the method reaches 67.9 percent and 70.2 percent frame level AUC on Ped2 and Avenue, trailing prior non causal SSM baselines in accuracy. Ablations over decay rate, state size, and gating reveal that the gate contribution is dataset size dependent, hurting accuracy on the smaller Ped2 training set but helping on the larger Avenue one. Closing this accuracy gap and extending evaluation to a third, larger benchmark are immediate next steps.

Related papers

• TriCalRAG: A Three-Strategy, Retrieval-Augmented Benchmark for On-Premise LLM-Based Root Cause Analysis in AIOps [1.8136615181861766]
  Cloud-hosted large language models (LLMs) are increasingly used for root cause analysis (RCA) in AIOps pipelines.<n>They introduce data privacy risk, network latency, and per-query cost that scale poorly with production log volumes.<n>We presentRAG, a benchmark evaluating open-weights served locally via vLLM against a classical LSTM-based log anomaly detector.
  arXiv  Detail & Related papers  (2026-09-13T19:52:46Z)
• The Low Frequency Trap: Video Language Models Fail at Simple Event Bookkeeping [70.07961857926377]
  We introduce trace-grounded parametric profiling for event counting in three controlled video tasks.<n>Across 2,190 videos, we vary event count N and frequency F while holding rendering fixed.<n>At an 80% reliability threshold, Gemini 3.6 Flash reliably counts persistent state transitions up to 12 events at 0.5 and 1.0 Hz, yet demonstrates no reliable positive-count region for transient blinking events.
  arXiv  Detail & Related papers  (2026-08-06T17:57:06Z)
• NaviCache: Test-Time Self-Calibration Caching for Video Generation [82.90113757454375]
  NaviCache is a test-time self-calibration method for Video Diffusion Models.<n>It bridges the fundamental domain gap and the non-stationary nature of diffusion.<n>It provides a theoretically grounded mechanism for error-bounded skipping.
  arXiv  Detail & Related papers  (2026-06-25T09:28:12Z)
• Temporal Backtracking Search for Test-time Generative Video Reasoning [51.4821857044108]
  generative video reasoning remains bottlenecked by a single-shot paradigm.<n>We introduce Temporal Backtracking Search (TBS), which shifts the search space to the temporal axis.<n>In a strict out-of-distribution setting, TBS achieves 22.7%, with every solved episode stemming from a restarted branch.
  arXiv  Detail & Related papers  (2026-06-11T19:41:18Z)
• VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference [2.538209532048867]
  We present a unified framework that combines deformable attention with causal temporal modeling to detect anomalies in video surveillance footage.<n>We evaluate our framework on VigilFormer, ShanghaiTech, and CUHK Avenue, at 41.5 FPS on a single GPU, recently outperforming weakly-supervised methods in both accuracy and speed.
  arXiv  Detail & Related papers  (2026-05-31T14:27:57Z)
• Delay-Adaptive Speculation Control for Low-Latency Edge-Cloud LLM Inference [20.720083078911486]
  In distributed edge-clouds, draft length must be controlled online.<n>We show that the optimal draft length is a finite delay-monotone threshold.<n>We implement the method on a real edge-cloud testbed with a Jetson Orin Nano Super edge node and an3090 Ti cloud node.
  arXiv  Detail & Related papers  (2026-05-17T07:15:30Z)
• Early Failure Detection and Intervention in Video Diffusion Models [26.52125777621677]
  We propose an early failure detection and diagnostic intervention pipeline for latent T2V diffusion models.<n>For detection, we design a Real-time Inspection (RI) module that converts latents into intermediate video previews.<n>Experiments on CogVideoX-5B and Wan2.1-1.3B demonstrate consistency gains on VBench with up to 2.64 times less time overhead.
  arXiv  Detail & Related papers  (2026-03-15T10:32:41Z)
• LE-NeuS: Latency-Efficient Neuro-Symbolic Video Understanding via Adaptive Temporal Verification [14.954035477725276]
  We present LE-NeuS, a latency-efficient neuro-symbolic framework that preserves the accuracy benefits of temporal logic-guided video understanding.<n>On LongVideoBench and Video-MME benchmarks, LE-NeuS reduces the latency gap from 90x to approximately 10x while maintaining >10% accuracy gains on temporally complex queries.
  arXiv  Detail & Related papers  (2026-02-26T23:28:13Z)
• TCUQ: Single-Pass Uncertainty Quantification from Temporal Consistency with Streaming Conformal Calibration for TinyML [0.0]
  TCUQ is a single pass, label free uncertainty monitor for streaming TinyML.<n>It converts short horizon temporal consistency captured via lightweight signals on posteriors.<n>A streaming conformal layer turns this score into a budgeted accept/abstain rule.
  arXiv  Detail & Related papers  (2025-08-18T13:12:14Z)
• Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Prediction [61.17654438176999]
  We propose a novel and robust unsupervised video anomaly detection method by frame prediction with proper design. Our proposed method obtains the frame-level AUROC score of 88.3% on the CUHK Avenue dataset.
  arXiv  Detail & Related papers  (2020-11-05T11:34:12Z)
• Real-Time Anomaly Detection in Edge Streams [49.26098240310257]
  We propose MIDAS, which focuses on detecting microcluster anomalies, or suddenly arriving groups of suspiciously similar edges. We further propose MIDAS-F, to solve the problem by which anomalies are incorporated into the algorithm's internal states. Experiments show that MIDAS-F has significantly higher accuracy than MIDAS.
  arXiv  Detail & Related papers  (2020-09-17T17:59:27Z)
• Towards Streaming Perception [70.68520310095155]
  We present an approach that coherently integrates latency and accuracy into a single metric for real-time online perception. The key insight behind this metric is to jointly evaluate the output of the entire perception stack at every time instant. We focus on the illustrative tasks of object detection and instance segmentation in urban video streams, and contribute a novel dataset with high-quality and temporally-dense annotations.
  arXiv  Detail & Related papers  (2020-05-21T01:51:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.