HALLELUAI: A Hallucination-Aware AI System for Ultra-Realistic Image-to-Video Generation at Scale
- URL: http://arxiv.org/abs/2607.22959v1
- Date: Sat, 25 Jul 2026 00:02:37 GMT
- Title: HALLELUAI: A Hallucination-Aware AI System for Ultra-Realistic Image-to-Video Generation at Scale
- Abstract summary: HALLELUAI is an end-to-end system that moderates and regenerates image-to-video outputs to meet expert-level creative standards.<n>It delivers ultra-realistic videos with consistent end-user quality of experience (QoE) at scale.
- Score: 1.069856137457197
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: AI-generated video is increasingly used across marketing, product storytelling, and creative workflows, yet automated; high-precision quality control remains a major constraint to scaling production. We present HALLELUAI, an end-to-end system that moderates and regenerates image-to-video outputs to meet expert-level creative standards and deliver ultra-realistic videos with consistent end-user quality of experience (QoE) at scale. The system integrates a video moderation module that evaluates frame-level aesthetics, temporal motion fidelity, and fine-grained hallucination risks relative to the source image, with an agentic regeneration module that iteratively fixes failures through prompt refinement, controlled camera adjustments, targeted model or image switching, and structured retry strategies. The moderation logic is aligned with domain-specific creative guidelines and produces granular, machine-actionable feedback that directly drives regeneration. In human-in-the-loop evaluations with creative experts, HALLELUAI shows strong alignment and reliably outputs ultra-realistic, production-grade videos suitable for product and marketing placements at scale. This framework advances trustworthy AI generated video content by enforcing visual realism, brand safety, and strict input-image fidelity while enabling image-to-video generation at scale.
Related papers
- Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence [73.39562379177796]
LingBot-Video is a DiT-based video pretraining paradigm specifically tailored for embodied intelligence.<n>From the data perspective, we construct a data profiling engine that augments standard internet videos with extensive robot-oriented footage.<n>From the training perspective, we develop a multi-dimensional reward system to enforce the alignment regarding physical rationality and task completion.
arXiv Detail & Related papers (2026-07-08T17:33:40Z) - EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generation [59.569634087474185]
We introduce EvalVerse, a comprehensive, pipeline-aware, and expert-calibrated evaluation framework.<n>First, we organize domain knowledge into an evaluation taxonomy aligned with the professional filmmaking workflow.<n>Second, we distill human expert judgments into a curated dataset with large-scale human annotations.<n>Third, we inject this knowledge into Vision-Language Models (VLMs) through an expert-calibrated fine-tuning strategy.
arXiv Detail & Related papers (2026-05-22T06:22:21Z) - DreaMontage: Arbitrary Frame-Guided One-Shot Video Generation [29.691765692687756]
DreaMontage is a comprehensive framework designed for arbitrary frame-guided generation.<n>It is capable of synthesizing seamless, expressive, and long-duration one-shot videos from diverse user-provided inputs.
arXiv Detail & Related papers (2025-12-24T16:00:15Z) - CreativeVR: Diffusion-Prior-Guided Approach for Structure and Motion Restoration in Generative and Real Videos [17.81372151946937]
CreativeVR is a diffusion-prior-guided video restoration framework for AI-generated (AIGC) and real videos with severe structural and temporal artifacts.<n>Our deep-adapter-based method exposes a single precision knob that controls how strongly the model follows the input.<n>CreativeVR achieves state-of-the-art results on videos with severe artifacts and performs competitively on standard video restoration benchmarks.
arXiv Detail & Related papers (2025-12-12T22:03:14Z) - MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restoration [62.929029990341796]
Real-world videos often suffer from complex degradations, such as noise, compression artifacts, and low-light distortions.<n>We propose MoA-VR, which mimics the reasoning and processing procedures of human professionals through three coordinated agents.<n>Specifically, we construct a large-scale and high-resolution video degradation recognition benchmark and build a vision-language model (VLM) driven degradation identifier.
arXiv Detail & Related papers (2025-10-09T17:42:51Z) - Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Model [8.866376599966353]
We decompose the visual quality of AIGVs into three dimensions: technical quality, motion quality, and video semantics.<n>Considering the outstanding performance of large language models (LLMs) in various vision and language tasks, we introduce a LLM as the quality regression module.<n>Our proposed method achieved textbfsecond place in the NTIRE 2025 Quality Assessment of AI-Generated Content Challenge.
arXiv Detail & Related papers (2025-06-05T07:40:12Z) - LensCraft: Your Professional Virtual Cinematographer [12.512681517449868]
Digital creators, from indie filmmakers to animation studios, face a persistent bottleneck: translating their creative vision into precise camera movements.<n>LensCraft solves this problem by mimicking the expertise of a professional cinematographer, using a data-driven approach.<n>LensCraft achieves markedly lower computational complexity and faster inference while maintaining high output quality.
arXiv Detail & Related papers (2025-06-01T12:43:55Z) - RAGME: Retrieval Augmented Video Generation for Enhanced Motion Realism [73.38167494118746]
We propose a framework to improve the realism of motion in generated videos.<n>We advocate for the incorporation of a retrieval mechanism during the generation phase.<n>Our pipeline is designed to apply to any text-to-video diffusion model.
arXiv Detail & Related papers (2025-04-09T08:14:05Z) - ARCON: Advancing Auto-Regressive Continuation for Driving Videos [7.958859992610155]
This paper explores the use of Large Vision Models (LVMs) for video continuation.<n>We introduce ARCON, a scheme that alternates between generating semantic and RGB tokens, allowing the LVM to explicitly learn high-level structural video information.<n> Experiments in autonomous driving scenarios show that our model can consistently generate long videos.
arXiv Detail & Related papers (2024-12-04T22:53:56Z) - CinePreGen: Camera Controllable Video Previsualization via Engine-powered Diffusion [29.320516135326546]
CinePreGen is a visual previsualization system enhanced with engine-powered diffusion.
It features a novel camera and storyboard interface that offers dynamic control, from global to local camera adjustments.
arXiv Detail & Related papers (2024-08-30T17:16:18Z) - E2HQV: High-Quality Video Generation from Event Camera via
Theory-Inspired Model-Aided Deep Learning [53.63364311738552]
Bio-inspired event cameras or dynamic vision sensors are capable of capturing per-pixel brightness changes (called event-streams) in high temporal resolution and high dynamic range.
It calls for events-to-video (E2V) solutions which take event-streams as input and generate high quality video frames for intuitive visualization.
We propose textbfE2HQV, a novel E2V paradigm designed to produce high-quality video frames from events.
arXiv Detail & Related papers (2024-01-16T05:10:50Z) - Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World
Video Super-Resolution [65.91317390645163]
Upscale-A-Video is a text-guided latent diffusion framework for video upscaling.
It ensures temporal coherence through two key mechanisms: locally, it integrates temporal layers into U-Net and VAE-Decoder, maintaining consistency within short sequences.
It also offers greater flexibility by allowing text prompts to guide texture creation and adjustable noise levels to balance restoration and generation.
arXiv Detail & Related papers (2023-12-11T18:54:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.