Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior

• URL: http://arxiv.org/abs/2508.10779v1
• Date: Thu, 14 Aug 2025 16:04:39 GMT
• Title: Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior
• Authors: Zhenning Shi, Zizheng Yan, Yuhang Yu, Clara Xue, Jingyu Zhuang, Qi Zhang, Jinwei Chen, Tao Li, Qingnan Fan,
• Abstract summary: RefSR aims to restore a low-resolution (LR) image by utilizing the semantic and texture information from an additional reference high-resolution (reference HR) image.<n>Existing diffusion-based RefSR methods are typically built upon ControlNet.<n>We propose TriFlowSR, a novel framework that explicitly achieves pattern matching between the LR image and the reference HR image.
• Score: 16.01061302804634
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reference-based Image Super-Resolution (RefSR) aims to restore a low-resolution (LR) image by utilizing the semantic and texture information from an additional reference high-resolution (reference HR) image. Existing diffusion-based RefSR methods are typically built upon ControlNet, which struggles to effectively align the information between the LR image and the reference HR image. Moreover, current RefSR datasets suffer from limited resolution and poor image quality, resulting in the reference images lacking sufficient fine-grained details to support high-quality restoration. To overcome the limitations above, we propose TriFlowSR, a novel framework that explicitly achieves pattern matching between the LR image and the reference HR image. Meanwhile, we introduce Landmark-4K, the first RefSR dataset for Ultra-High-Definition (UHD) landmark scenarios. Considering the UHD scenarios with real-world degradation, in TriFlowSR, we design a Reference Matching Strategy to effectively match the LR image with the reference HR image. Experimental results show that our approach can better utilize the semantic and texture information of the reference HR image compared to previous methods. To the best of our knowledge, we propose the first diffusion-based RefSR pipeline for ultra-high definition landmark scenarios under real-world degradation. Our code and model will be available at https://github.com/nkicsl/TriFlowSR.

Related papers

• RASR: Retrieval-Augmented Super Resolution for Practical Reference-based Image Restoration [41.50858324338511]
  RefSR improves upon Single Image Super Resolution (SISR) by leveraging high-quality reference images to enhance texture fidelity and visual realism.<n>Existing RefSR approaches rely on manually curated target-reference image pairs.<n>We introduce Retrieval-Augmented Super Resolution (RASR), a new and practical RefSR paradigm that automatically retrieves semantically relevant high-resolution images from a reference database.
  arXiv  Detail & Related papers  (2025-08-13T03:05:20Z)
• Timestep-Aware Diffusion Model for Extreme Image Rescaling [47.89362819768323]
  We propose a novel framework called Timestep-Aware Diffusion Model (TADM) for extreme image rescaling.<n>TADM performs rescaling operations in the latent space of a pre-trained autoencoder.<n>It effectively leverages powerful natural image priors learned by a pre-trained text-to-image diffusion model.
  arXiv  Detail & Related papers  (2024-08-17T09:51:42Z)
• Detail-Enhancing Framework for Reference-Based Image Super-Resolution [8.899312174844725]
  We propose a Detail-Enhancing Framework (DEF) for reference-based super-resolution. Our proposed method achieves superior visual results while maintaining comparable numerical outcomes.
  arXiv  Detail & Related papers  (2024-05-01T10:27:22Z)
• A Feature Reuse Framework with Texture-adaptive Aggregation for Reference-based Super-Resolution [29.57364804554312]
  Reference-based super-resolution (RefSR) has gained considerable success in the field of super-resolution. We propose a feature reuse framework that guides the step-by-step texture reconstruction process. We introduce a single image feature embedding module and a texture-adaptive aggregation module.
  arXiv  Detail & Related papers  (2023-06-02T12:49:22Z)
• LMR: A Large-Scale Multi-Reference Dataset for Reference-based Super-Resolution [86.81241084950524]
  It is widely agreed that reference-based super-resolution (RefSR) achieves superior results by referring to similar high quality images, compared to single image super-resolution (SISR) Previous RefSR methods have all focused on single-reference image training, while multiple reference images are often available in testing or practical applications. We construct a large-scale, multi-reference super-resolution dataset, named LMR. It contains 112,142 groups of 300x300 training images, which is 10x of the existing largest RefSR dataset.
  arXiv  Detail & Related papers  (2023-03-09T01:07:06Z)
• SRTGAN: Triplet Loss based Generative Adversarial Network for Real-World Super-Resolution [13.897062992922029]
  An alternative solution called Single Image Super-Resolution (SISR) is a software-driven approach that aims to take a Low-Resolution (LR) image and obtain the HR image. We introduce a new triplet-based adversarial loss function that exploits the information provided in the LR image by using it as a negative sample. We propose to fuse the adversarial loss, content loss, perceptual loss, and quality loss to obtain Super-Resolution (SR) image with high perceptual fidelity.
  arXiv  Detail & Related papers  (2022-11-22T11:17:07Z)
• RZSR: Reference-based Zero-Shot Super-Resolution with Depth Guided Self-Exemplars [20.771851470271777]
  Single image super-resolution (SISR) has demonstrated outstanding performance in generating high-resolution (HR) images from low-resolution (LR) images. We propose an integrated solution, called reference-based zero-shot SR (RZSR)
  arXiv  Detail & Related papers  (2022-08-24T05:48:17Z)
• Reference-based Image Super-Resolution with Deformable Attention Transformer [62.71769634254654]
  RefSR aims to exploit auxiliary reference (Ref) images to super-resolve low-resolution (LR) images. This paper proposes a deformable attention Transformer, namely DATSR, with multiple scales. Experiments demonstrate that our DATSR achieves state-of-the-art performance on benchmark datasets.
  arXiv  Detail & Related papers  (2022-07-25T07:07:00Z)
• Memory-augmented Deep Unfolding Network for Guided Image Super-resolution [67.83489239124557]
  Guided image super-resolution (GISR) aims to obtain a high-resolution (HR) target image by enhancing the spatial resolution of a low-resolution (LR) target image under the guidance of a HR image. Previous model-based methods mainly takes the entire image as a whole, and assume the prior distribution between the HR target image and the HR guidance image. We propose a maximal a posterior (MAP) estimation model for GISR with two types of prior on the HR target image.
  arXiv  Detail & Related papers  (2022-02-12T15:37:13Z)
• MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolution [74.24676600271253]
  We propose the MASA network for RefSR, where two novel modules are designed to address these problems. The proposed Match & Extraction Module significantly reduces the computational cost by a coarse-to-fine correspondence matching scheme. The Spatial Adaptation Module learns the difference of distribution between the LR and Ref images, and remaps the distribution of Ref features to that of LR features in a spatially adaptive way.
  arXiv  Detail & Related papers  (2021-06-04T07:15:32Z)
• Best-Buddy GANs for Highly Detailed Image Super-Resolution [71.13466303340192]
  We consider the single image super-resolution (SISR) problem, where a high-resolution (HR) image is generated based on a low-resolution (LR) input. Most methods along this line rely on a predefined single-LR-single-HR mapping, which is not flexible enough for the SISR task. We propose best-buddy GANs (Beby-GAN) for rich-detail SISR. Relaxing the immutable one-to-one constraint, we allow the estimated patches to dynamically seek the best supervision.
  arXiv  Detail & Related papers  (2021-03-29T02:58:27Z)
• PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models [77.32079593577821]
  PULSE (Photo Upsampling via Latent Space Exploration) generates high-resolution, realistic images at resolutions previously unseen in the literature. Our method outperforms state-of-the-art methods in perceptual quality at higher resolutions and scale factors than previously possible.
  arXiv  Detail & Related papers  (2020-03-08T16:44:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.