TUDSR: Twice Upsampling-Diffusion for Higher Super-Resolution
- URL: http://arxiv.org/abs/2606.09608v1
- Date: Mon, 08 Jun 2026 15:18:04 GMT
- Title: TUDSR: Twice Upsampling-Diffusion for Higher Super-Resolution
- Abstract summary: TUDSR is a Twice Upsampling-Diffusion framework for higher image super-resolution.<n>It achieves state-of-the-art performance across multiple benchmarks.<n>Experiments further demonstrate that TUDSR-S generates high-quality images at the resolutions of $10242$ and even $20482$, significantly outperforming existing approaches.
- Score: 15.21755753128945
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Diffusion-based generative models have achieved remarkable success in real-world image super-resolution (SR). With tiled diffusion techniques, these models can produce high-resolution images that exceed their native-supported resolution. However, the quality of such high-resolution (e.g $2048^2$) outputs often remains extremely poor, primarily due to two factors we consider: the image upsampling ratio (e.g $\times8$) exceeding the model's native-supported upsampling ratio (e.g $\times4$), and the model's native-supported resolution. In practice, training a native high-resolution model requires larger architectures, which incur significant computational overhead and GPU memory costs, making it hard on limited-resource equipment. Thus, we present TUDSR, a Twice Upsampling-Diffusion framework for higher SR. The TUDSR framework mainly consists of two stages: the first involves training at $R$-resolution, and the second introduces a looped chunk-based training strategy at $NR$-resolution. Each stage adapts a one-step GAN architecture comprising a generator and a discriminator. Based on SD2.1-base, we develop TUDSR-S, which achieves state-of-the-art performance across multiple benchmarks. Extensive experiments further demonstrate that TUDSR-S generates high-quality images at the resolutions of $1024^2$ and even $2048^2$, significantly outperforming existing approaches. Code is available at https://github.com/wuer5/TUDSR.
Related papers
- Ultra-High-Definition Restoration Transformers with Correlation Matching Transformation [113.23094779244771]
UHDformer++ is a Transformer-based framework to solve Ultra-High-Definition (UHD) image restoration tasks.<n>It operates across four learning spaces: 1) a high-resolution space (HR) for multi-level feature extraction, 2) a low-resolution space (LR) for learning compact, representative features, 3) a super-resolution space (SR) for up low-resolution features from SR, and 4) a low-high fusion and reconstruction space (LHFR) for final image restoration.
arXiv Detail & Related papers (2026-08-18T20:41:27Z) - Efficient Difficulty-Aware Dynamic Routing for Diffusion-Based Real-World Image Super-Resolution [69.17533212524447]
We propose a Difficulty-aware Dynamic Routing ( DDR) strategy that overcomes the rigid, one-size-fits-all processing paradigm.<n>Specifically, we design a difficulty estimator to predict the restoration cost of each input image, enabling automatic assignment to a network of appropriate capacity.<n>Extensive experiments have demonstrated the superior efficiency and effectiveness of the proposed model compared to recent state-of-the-art methods.
arXiv Detail & Related papers (2026-07-17T07:49:05Z) - Enhancing Text-to-Image Generation via End-Edge Collaborative Hybrid Super-Resolution [6.015475364527398]
We propose an end-edge collaborative generation-enhancement framework.<n> Experiments show that our system reduces service latency by 33% compared with baselines.
arXiv Detail & Related papers (2026-01-21T07:55:37Z) - Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modeling [50.34513854725803]
Arbitrary-scale super-resolution (ASSR) aims to reconstruct high-resolution (HR) images from low-resolution (LR) inputs with arbitrary upsampling factors.<n>We propose a novel ContinuousSR framework with a Pixel-to-Gaussian paradigm, which explicitly reconstructs 2D continuous HR signals from LR images using Gaussian Splatting.
arXiv Detail & Related papers (2025-03-09T13:43:57Z) - Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolution [8.69908615905782]
Large-scale, pre-trained Text-to-Image (T2I) diffusion models have gained significant popularity in image generation tasks.
Most existing T2I diffusion models are trained with a resolution limit of 512x512, making scaling beyond this resolution an unresolved but necessary challenge for image Super-Resolution (SR)
We introduce a novel approach that, for the first time, enables these models to generate 2K, 4K, and even 8K images without any additional training.
arXiv Detail & Related papers (2024-11-18T21:32:49Z) - High-Resolution Frame Interpolation with Patch-based Cascaded Diffusion [44.52838839928787]
We introduce a patch-based cascaded pixel diffusion model for high resolution frame-to-frame processing.<n> HIFI excels at high-resolution images and complex repeated textures that require global context.<n>We introduce a new dataset, LaMoR, that focuses on particularly challenging cases.
arXiv Detail & Related papers (2024-10-15T17:59:04Z) - Co-learning Single-Step Diffusion Upsampler and Downsampler with Two Discriminators and Distillation [28.174638880324014]
Super-resolution (SR) aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts.<n>We propose a co-learning framework that jointly optimize a single-step diffusion-based upsampler and a learnable downsampler.
arXiv Detail & Related papers (2024-10-10T07:12:46Z) - Timestep-Aware Diffusion Model for Extreme Image Rescaling [47.89362819768323]
We propose a novel framework called Timestep-Aware Diffusion Model (TADM) for extreme image rescaling.<n>TADM performs rescaling operations in the latent space of a pre-trained autoencoder.<n>It effectively leverages powerful natural image priors learned by a pre-trained text-to-image diffusion model.
arXiv Detail & Related papers (2024-08-17T09:51:42Z) - DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance [11.44012694656102]
Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains.
Existing large-scale diffusion models are confined to generating images of up to 1K resolution.
We propose a novel progressive approach that fully utilizes generated low-resolution images to guide the generation of higher-resolution images.
arXiv Detail & Related papers (2024-06-26T16:10:31Z) - Hierarchical Patch Diffusion Models for High-Resolution Video Generation [50.42746357450949]
We develop deep context fusion, which propagates context information from low-scale to high-scale patches in a hierarchical manner.
We also propose adaptive computation, which allocates more network capacity and computation towards coarse image details.
The resulting model sets a new state-of-the-art FVD score of 66.32 and Inception Score of 87.68 in class-conditional video generation.
arXiv Detail & Related papers (2024-06-12T01:12:53Z) - ACDMSR: Accelerated Conditional Diffusion Models for Single Image
Super-Resolution [84.73658185158222]
We propose a diffusion model-based super-resolution method called ACDMSR.
Our method adapts the standard diffusion model to perform super-resolution through a deterministic iterative denoising process.
Our approach generates more visually realistic counterparts for low-resolution images, emphasizing its effectiveness in practical scenarios.
arXiv Detail & Related papers (2023-07-03T06:49:04Z) - Improved Transformer for High-Resolution GANs [69.42469272015481]
We introduce two key ingredients to Transformer to address this challenge.
We show in the experiments that the proposed HiT achieves state-of-the-art FID scores of 31.87 and 2.95 on unconditional ImageNet $128 times 128$ and FFHQ $256 times 256$, respectively.
arXiv Detail & Related papers (2021-06-14T17:39:49Z) - DDet: Dual-path Dynamic Enhancement Network for Real-World Image
Super-Resolution [69.2432352477966]
Real image super-resolution(Real-SR) focus on the relationship between real-world high-resolution(HR) and low-resolution(LR) image.
In this article, we propose a Dual-path Dynamic Enhancement Network(DDet) for Real-SR.
Unlike conventional methods which stack up massive convolutional blocks for feature representation, we introduce a content-aware framework to study non-inherently aligned image pair.
arXiv Detail & Related papers (2020-02-25T18:24:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.