FreeTransformSR: Efficient Lightweight Image Super-Resolution via Free Low-Rank Learnable Transform

• URL: http://arxiv.org/abs/2609.05912v2
• Date: Thu, 10 Sep 2026 07:46:23 GMT
• Title: FreeTransformSR: Efficient Lightweight Image Super-Resolution via Free Low-Rank Learnable Transform
• Abstract summary: Single image super-resolution aims to reconstruct high-resolution images from low-resolution inputs.<n>This paper proposes FreeTransformSR, a novel lightweight super-resolution network based on a channel-wise free low-rank learnable transform.<n>Experiments on five benchmark datasets demonstrate that FreeTransformSR achieves competitive PSNR/SSIM performance with significantly fewer parameters and FLOPs.
• Score: 0.549402648081308
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Single image super-resolution aims to reconstruct high-resolution images from low-resolution inputs. This paper proposes FreeTransformSR, a novel lightweight super-resolution network based on a channel-wise free low-rank learnable transform. The transform learns task-adaptive basis functions in a data-driven manner, enabling adaptive feature modulation with minimal parameter overhead. To further enhance high-frequency detail recovery, we introduce a local feature modulation branch that complements transform-domain processing with depthwise convolution. In addition, a soft complexity adaptive module dynamically fuses the outputs of local convolution and window self-attention branches through a lightweight gating network, adaptively adjusting the fusion ratio based on regional texture characteristics. An adaptive intensity modulation strategy is also incorporated to adjust transform-domain response strength at the sample level, enabling the network to dynamically adjust processing intensity according to input features. Extensive experiments on five benchmark datasets demonstrate that FreeTransformSR achieves competitive PSNR/SSIM performance with significantly fewer parameters and FLOPs. Specifically, FreeTransformSR achieves 32.41 dB on BSD100 x2 and 27.00 dB on Urban100 x4 with only 595K parameters, while delivering faster inference speed than competing methods, making it well-suited for deployment in resource-constrained scenarios. Source code is available at: https://github.com/HJiLi/FreeTransformSR.

Related papers

• Ultra-High-Definition Restoration Transformers with Correlation Matching Transformation [113.23094779244771]
  UHDformer++ is a Transformer-based framework to solve Ultra-High-Definition (UHD) image restoration tasks.<n>It operates across four learning spaces: 1) a high-resolution space (HR) for multi-level feature extraction, 2) a low-resolution space (LR) for learning compact, representative features, 3) a super-resolution space (SR) for up low-resolution features from SR, and 4) a low-high fusion and reconstruction space (LHFR) for final image restoration.
  arXiv  Detail & Related papers  (2026-08-18T20:41:27Z)
• LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution [73.85089704122315]
  We propose a minimalist framework that performs Video Super-Resolution (VSR) using a frozen Transformer with a lightweight State-Aware Adapter.<n> LiteVSR achieves competitive restoration quality with only 11.25% trainable parameters and 12 GPU-hours of training on a single A100, while maintaining fast sampling (down to a single step) compatibility.
  arXiv  Detail & Related papers  (2026-06-08T09:23:42Z)
• WaveHiT-SR: Hierarchical Wavelet Network for Efficient Image Super-Resolution [44.55918322585521]
  We propose a new approach by embedding the wavelet transform within a hierarchical transformer framework, called (WaveHiT-SR)<n>By progressively reconstructing high-resolution images through hierarchical processing, the network reduces computational complexity without sacrificing performance.<n>Our refined versions of SwinIR-Light, SwinIR-NG, and SRFormer-Light deliver cutting-edge SR results, achieving higher efficiency with fewer parameters, lower FLOPs, and faster speeds.
  arXiv  Detail & Related papers  (2025-08-27T14:37:50Z)
• Dual-domain Modulation Network for Lightweight Image Super-Resolution [26.992373105057684]
  Lightweight image super-resolution (SR) aims to reconstruct high-resolution images from low-resolution images under limited computational costs.<n>Existing frequency-based SR methods cannot balance the reconstruction of overall structures and high-frequency parts.<n>We show that introducing both wavelet and Fourier information allows our model to consider both high-frequency features and overall SR structure reconstruction while reducing costs.
  arXiv  Detail & Related papers  (2025-03-13T04:59:46Z)
• AdaptSR: Low-Rank Adaptation for Efficient and Scalable Real-World Super-Resolution [50.584551250242235]
  AdaptSR is a low-rank adaptation framework that efficiently repurposes bi-cubic-trained SR models for real-world tasks.<n>Our experiments demonstrate that AdaptSR outperforms GAN and diffusion-based SR methods by up to 4 dB in PSNR and 2% in perceptual scores on real SR benchmarks.
  arXiv  Detail & Related papers  (2025-03-10T18:03:18Z)
• Frequency-Aware Vision Transformers for High-Fidelity Super-Resolution of Earth System Models [0.0]
  Super-resolution methods tend to exhibit spectral bias, reconstructing low-frequency content more readily than valuable high-frequency details.<n>We introduce two frequency-aware frameworks: the Vision Transformer-Tuned Sinusoidal Implicit Representation (ViSIR) and the Vision Transformer Fourier Representation Network (ViFOR)<n>The results establish ViFOR as a state-of-the-art, scalable solution for climate data downscaling.
  arXiv  Detail & Related papers  (2025-02-18T01:52:41Z)
• Unifying Dimensions: A Linear Adaptive Approach to Lightweight Image Super-Resolution [6.857919231112562]
  Window-based transformers have demonstrated outstanding performance in super-resolution tasks. They exhibit higher computational complexity and inference latency than convolutional neural networks. We construct a convolution-based Transformer framework named the linear adaptive mixer network (LAMNet)
  arXiv  Detail & Related papers  (2024-09-26T07:24:09Z)
• Transforming Image Super-Resolution: A ConvFormer-based Efficient Approach [58.57026686186709]
  We introduce the Convolutional Transformer layer (ConvFormer) and propose a ConvFormer-based Super-Resolution network (CFSR) CFSR inherits the advantages of both convolution-based and transformer-based approaches. Experiments demonstrate that CFSR strikes an optimal balance between computational cost and performance.
  arXiv  Detail & Related papers  (2024-01-11T03:08:00Z)
• Spatially-Adaptive Feature Modulation for Efficient Image Super-Resolution [90.16462805389943]
  We develop a spatially-adaptive feature modulation (SAFM) mechanism upon a vision transformer (ViT)-like block. Proposed method is $3times$ smaller than state-of-the-art efficient SR methods.
  arXiv  Detail & Related papers  (2023-02-27T14:19:31Z)
• Deep Adaptive Inference Networks for Single Image Super-Resolution [72.7304455761067]
  Single image super-resolution (SISR) has witnessed tremendous progress in recent years owing to the deployment of deep convolutional neural networks (CNNs) In this paper, we take a step forward to address this issue by leveraging the adaptive inference networks for deep SISR (AdaDSR) Our AdaDSR involves an SISR model as backbone and a lightweight adapter module which takes image features and resource constraint as input and predicts a map of local network depth.
  arXiv  Detail & Related papers  (2020-04-08T10:08:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.