HDRAgent: An Agentic Framework for Multi-Exposure HDR Imaging
- URL: http://arxiv.org/abs/2606.09110v1
- Date: Mon, 08 Jun 2026 07:00:56 GMT
- Title: HDRAgent: An Agentic Framework for Multi-Exposure HDR Imaging
- Abstract summary: Most existing multi-exposure HDR methods follow a fixed feed-forward reconstruction paradigm, making them prone to ghosting artifacts in complex dynamic scenes.<n>We propose HDRAgent, which adaptively selects reconstruction strategies according to the current scene conditions.<n>Experiments demonstrate that HDRAgent effectively reduces ghosting and local artifacts while achieving competitive or superior objective performance and visual quality.
- Score: 24.45994058813237
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most existing multi-exposure HDR methods follow a fixed feed-forward reconstruction paradigm, making them prone to ghosting artifacts in complex dynamic scenes. To address this issue, we propose HDRAgent, the first agent-driven framework for HDR imaging, which adaptively selects reconstruction strategies according to the current scene conditions. Specifically, to provide scene-specific prior knowledge, we introduce a fine-grained contextual knowledge matching (FCM) module. This module leverages multimodal large language model (MLLM)-derived scene perception to retrieve relevant historical cases and tool knowledge, organizing them into structured evidence for MLLM-based adaptive tool scheduling. In addition, we propose a perception--distortion feedback mechanism that transforms post-execution quality assessment and artifact diagnosis into structured feedback, which is accumulated in historical memory to help subsequent contextual knowledge refinement and strategy selection. Furthermore, considering that extreme motion can invalidate alignment methods, we design an agent-guided generative alignment strategy that uses MLLM-based dynamic-region parsing to reconstruct unreliable contents in non-reference frames under reference-frame guidance. Experiments demonstrate that HDRAgent effectively reduces ghosting and local artifacts while achieving competitive or superior objective performance and visual quality.
Related papers
- Multi-exposure HDR Imaging: A Review of Pixel-level and Feature-level Reconstruction Methods [19.515009974648535]
Multi-exposure is an efficient way to capture real-world high-dynamic-range ( HDR) scenes.<n>However, HDR imaging suffers from severe ghosting in dynamic scenes due to the temporal gap between sequential exposures.<n>In this article, we categorize the literature on two important topics on HDR imaging: multi-exposure fusion (MEF) and ghost removal.
arXiv Detail & Related papers (2026-08-25T06:05:20Z) - Leveraging Multimodal Large Language Models for All-in-One Image Restoration via a Mixture of Frequency Experts [9.395990800489828]
All-in-one image restoration seeks to recover clean images from inputs affected by diverse and unknown degradations.<n>Recent methods have shown strong performance by identifying degradation characteristics to guide the restoration process.<n>We propose a multimodal large language model (MLLM)-guided image restoration framework that exploits multimodal embeddings as guidance.
arXiv Detail & Related papers (2026-05-12T02:55:05Z) - DMAligner: Enhancing Image Alignment via Diffusion Model Based View Synthesis [63.59932602411222]
DMAligner is a diffusion-based framework for image alignment through alignment-oriented view synthesis.<n>We propose a Dynamics-aware Diffusion Training approach for learning conditional image generation.<n>We develop the Dynamic Scene Image Alignment (DSIA) dataset using Blender, which includes 1,033 indoor and outdoor scenes with over 30K image pairs tailored for image alignment.
arXiv Detail & Related papers (2026-02-26T14:00:07Z) - Wavelet-Domain Masked Image Modeling for Color-Consistent HDR Video Reconstruction [69.35623794013152]
High Dynamic Range (LDR) video reconstruction aims to recover fine brightness, color, and details from LDR videos.<n>Existing methods often suffer from color inaccuracies and temporal inconsistencies.<n>We propose WMNet, a novel HDR video reconstruction network that leverages Wavelet domain Masked Image Modeling.
arXiv Detail & Related papers (2026-02-07T06:19:23Z) - ReCALL: Recalibrating Capability Degradation for MLLM-based Composed Image Retrieval [64.14282916266998]
Composed Image Retrieval aims to retrieve target images based on a hybrid query comprising a reference image and a modification text.<n>We propose ReCALL, a model-agnostic framework that follows a diagnose-generate-refine pipeline.<n>Experiments on CIRR and FashionIQ show that ReCALL consistently recalibrates degraded capabilities and achieves state-of-the-art performance.
arXiv Detail & Related papers (2026-02-02T04:52:54Z) - HDR Image Reconstruction using an Unsupervised Fusion Model [0.0]
High Dynamic Range (Exposure) imaging aims to reproduce the wide range of brightness levels present in natural scenes.<n>We propose a deep learning-based multi-exposure fusion approach for HDR image generation.
arXiv Detail & Related papers (2025-10-21T17:43:22Z) - FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning [65.42201665046505]
Current video understanding models rely on fixed frame sampling strategies, processing predetermined visual inputs regardless of the specific reasoning requirements of each question.<n>This static approach limits their ability to adaptively gather visual evidence, leading to suboptimal performance on tasks that require broad temporal coverage or fine-grained spatial detail.<n>We introduce FrameMind, an end-to-end framework trained with reinforcement learning that enables models to dynamically request visual information during reasoning through Frame-Interleaved Chain-of-Thought (FiCOT)<n>Unlike traditional approaches, FrameMind operates in multiple turns where the model alternates between textual reasoning and active visual perception, using tools to extract
arXiv Detail & Related papers (2025-09-28T17:59:43Z) - Boosting HDR Image Reconstruction via Semantic Knowledge Transfer [45.738735520776004]
Leveraging scene-specific semantic priors offers a promising solution for restoring heavily degraded regions.<n>These priors are typically extracted from sRGB Standard Dynamic Range (SDR) images.<n>We propose a general framework that transfers semantic knowledge derived from SDR domain via self-distillation to boost existing HDR reconstruction.
arXiv Detail & Related papers (2025-03-19T16:01:27Z) - Reti-Diff: Illumination Degradation Image Restoration with Retinex-based
Latent Diffusion Model [59.08821399652483]
Illumination degradation image restoration (IDIR) techniques aim to improve the visibility of degraded images and mitigate the adverse effects of deteriorated illumination.
Among these algorithms, diffusion model (DM)-based methods have shown promising performance but are often burdened by heavy computational demands and pixel misalignment issues when predicting the image-level distribution.
We propose to leverage DM within a compact latent space to generate concise guidance priors and introduce a novel solution called Reti-Diff for the IDIR task.
Reti-Diff comprises two key components: the Retinex-based latent DM (RLDM) and the Retinex-guided transformer (RG
arXiv Detail & Related papers (2023-11-20T09:55:06Z) - HDR Reconstruction from Bracketed Exposures and Events [12.565039752529797]
Reconstruction of high-quality HDR images is at the core of modern computational photography.
We present a multi-modal end-to-end learning-based HDR imaging system that fuses bracketed images and event in the feature domain.
Our framework exploits the higher temporal resolution of events by sub-sampling the input event streams using a sliding window.
arXiv Detail & Related papers (2022-03-28T15:04:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.