RefGC-SR$^2$: Reference-guided Generated Content Super-Resolution and Refinement

• URL: http://arxiv.org/abs/2606.15158v1
• Date: Sat, 13 Jun 2026 07:04:36 GMT
• Title: RefGC-SR$^2$: Reference-guided Generated Content Super-Resolution and Refinement
• Abstract summary: We introduce a new task: reference-guided generated content super-resolution-refinement (RefGC-SR$2$)<n>The original HRRI is reused at the post-processing stage to recover lost details, refine generative artifacts, and upscale the output simultaneously.<n>We construct the first real-world triplet data generation pipeline for this RefGC-SR$2$ task, training a diptych-conditioned generator to synthesize paired low-quality anchors.
• Score: 12.971780703663754
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reference-guided generation (e.g., object compositing, customization) has progressed rapidly, yet current pipelines share a fundamental limitation: the object-centric high-resolution reference image (HRRI) provided by users is downsampled to a fixed low-resolution (LR) before being fed into the model, so the fine-grained details are discarded before the output is even produced. In addition, the generation step then introduces its own artifacts (e.g., identity distortion) on top of this loss. Existing reference-guided generated content refinement (RefGCR) methods can correct some of these artifacts but still operate in the LR domain; reference-guided super-resolution (RefSR) methods recover resolution but assume natural-image degradations and ignore the artifact distribution of generative pipelines. To address both gaps in a single formulation, we introduce a new task: reference-guided generated content super-resolution-refinement (RefGC-SR$^2$), where the original HRRI is reused at the post-processing stage to recover lost details, refine generative artifacts, and upscale the output simultaneously. We construct the first real-world triplet data generation pipeline for this RefGC-SR$^2$ task, training a diptych-conditioned generator to synthesize paired low-quality anchors that public pretrained models cannot provide. We further present a frequency-aware diffusion transformer model for RefGC-SR$^2$ that selectively injects fine details from the HRRI while removing generative artifacts. Extensive experiments demonstrate that our RefGC-SR$^2$ model successfully (i) refines the object identity faithfully with respect to the reference, and (ii) recovers high-resolution details, so that the final result is significantly higher quality and practically more usable compared to existing RefGCR and RefSR baselines.

Related papers

• When Latents Forget Pixels: Restoring Fidelity in Diffusion Transformer Super-Resolution [47.89708788628452]
  We propose a pixel-grounded super-resolution (PGSR) framework that preserves LR-observed pixel evidence before VAE compression and reuses it throughout restoration.<n>Experiments demonstrate that PGSR improves the realism--fidelity trade-off and produces more faithful, visually convincing results than existing latent generative SR approaches.
  arXiv  Detail & Related papers  (2026-08-10T05:24:39Z)
• CLEAR: Conflict-aware Learning via Evidence-guided Adaptive Routing for Unified Sparse-View 3D Gaussian Super-Resolution [80.43237927269575]
  We propose CLEAR as the first unified single-stage framework for Sparse-view 3D Gaussian Splatting Super-resolution.<n> CLEAR performs joint the optimization of authentic LR observations and external HR priors within a unified Gaussian representation.<n>Experiments on both synthetic and real-world $4times$ super-resolution benchmarks demonstrate that CLEAR consistently achieves state-of-the-art rendering quality.
  arXiv  Detail & Related papers  (2026-08-03T13:31:53Z)
• Detail Continuation over a Trustworthy Coarse Scale for Autoregressive Super-Resolution [11.303661953283894]
  Hallucination remains a persistent challenge in generative super-resolution.<n> division between preserving reliable coarse-scale information and restoring more uncertain fine details is often handled implicitly.<n>We propose textbfK2N, which reformulates VAR-based SR from full-path generation into a $k$-to-$N$ detail continuation process.
  arXiv  Detail & Related papers  (2026-08-03T07:29:53Z)
• RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution [26.50828843718706]
  RefReward-SR is a low-resolution (LR) reference-aware reward model for preference-aligned SR.<n>It assesses high-resolution (HR) reconstructions conditioned on LR inputs, treating the LR image as a semantic anchor.<n>Our framework achieves substantially better alignment with human judgments, producing reconstructions that preserve semantic consistency.
  arXiv  Detail & Related papers  (2026-03-25T11:20:51Z)
• RASR: Retrieval-Augmented Super Resolution for Practical Reference-based Image Restoration [41.50858324338511]
  RefSR improves upon Single Image Super Resolution (SISR) by leveraging high-quality reference images to enhance texture fidelity and visual realism.<n>Existing RefSR approaches rely on manually curated target-reference image pairs.<n>We introduce Retrieval-Augmented Super Resolution (RASR), a new and practical RefSR paradigm that automatically retrieves semantically relevant high-resolution images from a reference database.
  arXiv  Detail & Related papers  (2025-08-13T03:05:20Z)
• Controllable Reference Guided Diffusion with Local Global Fusion for Real World Remote Sensing Image Super Resolution [9.658727475375565]
  Super resolution techniques can enhance the spatial resolution of remote sensing images, enabling more efficient large scale earth observation applications.<n>Existing RefSR methods struggle with real world complexities, such as cross sensor resolution gap and significant land cover changes.<n>We propose CRefDiff, a novel controllable reference guided diffusion model for real world remote sensing image SR.
  arXiv  Detail & Related papers  (2025-06-30T12:45:28Z)
• Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modeling [50.34513854725803]
  Arbitrary-scale super-resolution (ASSR) aims to reconstruct high-resolution (HR) images from low-resolution (LR) inputs with arbitrary upsampling factors.<n>We propose a novel ContinuousSR framework with a Pixel-to-Gaussian paradigm, which explicitly reconstructs 2D continuous HR signals from LR images using Gaussian Splatting.
  arXiv  Detail & Related papers  (2025-03-09T13:43:57Z)
• Fortifying Fully Convolutional Generative Adversarial Networks for Image Super-Resolution Using Divergence Measures [17.517010701323823]
  Super-Resolution (SR) is a time-hallowed image processing problem. We introduce a fully-conversaal Generative Adrial Network (GAN)-based architecture for SR. We show that distinct convolutional features obtained at increasing depths of a GAN generator can be optimally combined by a set of learnable convex weights.
  arXiv  Detail & Related papers  (2024-04-09T13:19:43Z)
• Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model [59.08821399652483]
  Illumination degradation image restoration (IDIR) techniques aim to improve the visibility of degraded images and mitigate the adverse effects of deteriorated illumination. Among these algorithms, diffusion model (DM)-based methods have shown promising performance but are often burdened by heavy computational demands and pixel misalignment issues when predicting the image-level distribution. We propose to leverage DM within a compact latent space to generate concise guidance priors and introduce a novel solution called Reti-Diff for the IDIR task. Reti-Diff comprises two key components: the Retinex-based latent DM (RLDM) and the Retinex-guided transformer (RG
  arXiv  Detail & Related papers  (2023-11-20T09:55:06Z)
• A Feature Reuse Framework with Texture-adaptive Aggregation for Reference-based Super-Resolution [29.57364804554312]
  Reference-based super-resolution (RefSR) has gained considerable success in the field of super-resolution. We propose a feature reuse framework that guides the step-by-step texture reconstruction process. We introduce a single image feature embedding module and a texture-adaptive aggregation module.
  arXiv  Detail & Related papers  (2023-06-02T12:49:22Z)
• Reference-based Image Super-Resolution with Deformable Attention Transformer [62.71769634254654]
  RefSR aims to exploit auxiliary reference (Ref) images to super-resolve low-resolution (LR) images. This paper proposes a deformable attention Transformer, namely DATSR, with multiple scales. Experiments demonstrate that our DATSR achieves state-of-the-art performance on benchmark datasets.
  arXiv  Detail & Related papers  (2022-07-25T07:07:00Z)
• Robust Reference-based Super-Resolution via C2-Matching [77.51610726936657]
  Super-Resolution (Ref-SR) has recently emerged as a promising paradigm to enhance a low-resolution (LR) input image by introducing an additional high-resolution (HR) reference image. Existing Ref-SR methods mostly rely on implicit correspondence matching to borrow HR textures from reference images to compensate for the information loss in input images. We propose C2-Matching, which produces explicit robust matching crossing transformation and resolution.
  arXiv  Detail & Related papers  (2021-06-03T16:40:36Z)
• LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyond [75.37541439447314]
  Single image super-resolution (SISR) deals with a fundamental problem of upsampling a low-resolution (LR) image to its high-resolution (HR) version. This paper proposes a linearly-assembled pixel-adaptive regression network (LAPAR) to strike a sweet spot of deep model complexity and resulting SISR quality.
  arXiv  Detail & Related papers  (2021-05-21T15:47:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.