Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing

• URL: http://arxiv.org/abs/2607.06136v1
• Date: Tue, 07 Jul 2026 10:52:10 GMT
• Title: Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing
• Abstract summary: This paper introduces UltraDiffEdit, a tuning-free image editing framework that extends latent diffusion models (LDMs) to ultrahigh resolutions.<n>We employ multi-patch encoding to preserve both edited and unedited visual details within the latent space.<n>We also introduce a patch-based hybrid sampling approach that captures local, intermediate, and global features, ensuring semantic coherence and enhancing fine detail during denoising.
• Score: 11.862248587214951
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent diffusion-based generative models have shown impressive performance in image generation and editing. However, due to memory limitations and the high cost of collecting high-resolution training images, existing methods are typically restricted to inputs with linear resolutions below 1K. In contrast, photos captured by modern mobile devices often reach linear resolutions up to 8K, revealing a significant gap between current capabilities and real-world demands. Simply upscaling low-resolution edited results often results in visually enlarged but blurry images that lack fine details. This paper introduces UltraDiffEdit, a novel, tuning-free image editing framework that extends off-the-shelf latent diffusion models (LDMs) to ultrahigh resolutions. UltraDiffEdit employs a multi-scale progressive editing strategy, iteratively blending high-resolution edited content with unedited areas in a coarse-to-fine manner. We employ multi-patch encoding to preserve both edited and unedited visual details within the latent space. To mitigate editing artifacts, our global-local consistency denoising technique consistently integrates edited and unedited latent features, ensuring smooth transition at editing boundaries from the latent representation to the final image. We also introduce a patch-based hybrid sampling approach that captures local, intermediate, and global features, ensuring semantic coherence and enhancing fine detail during denoising. We conduct extensive experiments demonstrating UltraDiffEdit's superior editing quality and flexibility: it can handle image resolutions up to 8K using only a single NVIDIA GeForce RTX 3090 GPU. The source code is publicly available at https://github.com/LonglongaaaGo/UltraDiffEdit.

Related papers

• HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editing [83.1290629939693]
  High-resolution image editing is essential for professional and creative applications.<n>Current approaches redundantly process the entire image canvas or rely on large-scale high-resolution datasets.<n>We introduce HierEdit, a region-aware hierarchical diffusion framework for efficient and scalable high-resolution image editing.
  arXiv  Detail & Related papers  (2026-05-17T07:14:15Z)
• EditCrafter: Tuning-free High-Resolution Image Editing via Pretrained Diffusion Model [15.14106323055504]
  We propose EditCrafter, a high-resolution image editing method that operates without tuning.<n>We leverage pretrained text-to-image (T2I) diffusion models to process images at resolutions significantly exceeding those used during training.
  arXiv  Detail & Related papers  (2026-04-11T16:12:27Z)
• Visual Autoregressive Modeling for Instruction-Guided Image Editing [97.04821896251681]
  We present a visual autoregressive framework that reframes image editing as a next-scale prediction problem.<n>VarEdit generates multi-scale target features to achieve precise edits.<n>It completes a $512times512$ editing in 1.2 seconds, making it 2.2$times$ faster than the similarly sized UltraEdit.
  arXiv  Detail & Related papers  (2025-08-21T17:59:32Z)
• Inverse-and-Edit: Effective and Fast Image Editing by Cycle Consistency Models [1.9389881806157316]
  In this work, we propose a novel framework that enhances image inversion using consistency models.<n>Our method introduces a cycle-consistency optimization strategy that significantly improves reconstruction accuracy.<n>We achieve state-of-the-art performance across various image editing tasks and datasets.
  arXiv  Detail & Related papers  (2025-06-23T20:34:43Z)
• IntrinsicEdit: Precise generative image manipulation in intrinsic space [53.404235331886255]
  We introduce a versatile, generative workflow that operates in an intrinsic-image latent space.<n>We address key challenges of identity preservation and intrinsic-channel entanglement.<n>We enable precise, efficient editing with automatic resolution of global illumination effects.
  arXiv  Detail & Related papers  (2025-05-13T18:24:15Z)
• Taming Rectified Flow for Inversion and Editing [57.3742655030493]
  Rectified-flow-based diffusion transformers like FLUX and OpenSora have demonstrated outstanding performance in the field of image and video generation.<n>Despite their robust generative capabilities, these models often struggle with inaccuracies.<n>We propose RF-r, a training-free sampler that effectively enhances inversion precision by mitigating the errors in the inversion process of rectified flow.
  arXiv  Detail & Related papers  (2024-11-07T14:29:02Z)
• TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models [53.757752110493215]
  We focus on a popular line of text-based editing frameworks - the edit-friendly'' DDPM-noise inversion approach. We analyze its application to fast sampling methods and categorize its failures into two classes: the appearance of visual artifacts, and insufficient editing strength. We propose a pseudo-guidance approach that efficiently increases the magnitude of edits without introducing new artifacts.
  arXiv  Detail & Related papers  (2024-08-01T17:27:28Z)
• FreeDiff: Progressive Frequency Truncation for Image Editing with Diffusion Models [44.26371926512843]
  We introduce a novel free approach that employs progressive $textbfFre$qu$textbfe$ncy truncation to refine the guidance of $textbfDiff$usion models for universal editing tasks. Our method achieves comparable results with state-of-the-art methods across a variety of editing tasks and on a diverse set of images.
  arXiv  Detail & Related papers  (2024-04-18T04:47:28Z)
• DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editing [66.43179841884098]
  Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. We propose DiffEditor to rectify two weaknesses in existing diffusion-based image editing. Our method can efficiently achieve state-of-the-art performance on various fine-grained image editing tasks.
  arXiv  Detail & Related papers  (2024-02-04T18:50:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.