PF-Trans: Physics-Embedded Frequency-Aware Transformer for Spectral Reconstruction

• URL: http://arxiv.org/abs/2606.10373v1
• Date: Tue, 09 Jun 2026 03:34:34 GMT
• Title: PF-Trans: Physics-Embedded Frequency-Aware Transformer for Spectral Reconstruction
• Abstract summary: We propose a Physics-embedded Frequency-aware Transformer (PF-Trans) for high-fidelity remote sensing spectral reconstruction.<n>PF-Trans achieves state-of-the-art performance, achieving a Peak Signal-to-Noise Ratio (PSNR) of up to 48.50 dB on the GF-5 Shanghai dataset.
• Score: 9.122692658405116
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Snapshot Broadband Filter Array (BFA) imaging provides high light throughput for spectral reconstruction but introduces severe spectral aliasing due to complex modulation. Current deep learning approaches, limited to spatial denoising, often fail to address the global frequency-specific degradations caused by the mask structure. To address this, we propose a Physics-embedded Frequency-aware Transformer (PF-Trans) for high-fidelity remote sensing spectral reconstruction. Our method explicitly integrates the physical sensing model through mask injection and a gray-scale consistency loss to ensure physical fidelity. Furthermore, we introduce a Dual-domain Block with a parallel Fast Fourier Transform (FFT) branch, enabling the network to perceive and suppress aliasing artifacts in the frequency domain. Extensive experiments on multiple datasets demonstrate that PF-Trans achieves state-of-the-art performance, achieving a Peak Signal-to-Noise Ratio (PSNR) of up to 48.50 dB on the GF-5 Shanghai dataset, significantly outperforming comparison methods.

Related papers

• Bio-SFT: Asymmetric Cortical Guidance and Retinal Adaptation for Robust HDR Reconstruction [61.07381300333128]
  Extreme luminance variation and severe quantization in dark regions make accurate reconstruction challenging.<n>Bio-SFT is a bio-inspired spiking frequency transformer for single-image HDR reconstruction.<n>Experiments on HDRTV1K show that Bio-SFT consistently improves HDR-VDP-3 and $E_ITP$ while reducing artifact propagation in symmetric guidance pipelines.
  arXiv  Detail & Related papers  (2026-07-20T01:07:54Z)
• An Explainable FFT-Based Spatial-Frequency Fusion Framework for Deepfake Detection [1.8549313085249324]
  Recent studies show that combining spatial and frequency features leads to stronger detection results than using independently.<n>This paper presents MSCA-FFT, a Fast Fourier Transform (FFT)-based multi-scale cross-attention framework for image-level deepfake detection.
  arXiv  Detail & Related papers  (2026-07-19T23:45:40Z)
• FSCM: Frequency-Enhanced Spatial-Spectral Coupled Mamba for Infrared Hyperspectral Image Colorization [10.509841173943387]
  This paper presents a spectral-information-guided GAN framework for infrared colorization.<n>Within FSCM, a frequency-enhanced spatial-spectral state-space generator composed of cascaded FSB units is constructed.<n>Experiments show that FSCM outperforms existing infrared colorization methods in visual quality and semantic fidelity.
  arXiv  Detail & Related papers  (2026-05-13T15:48:58Z)
• UHDRes: Ultra-High-Definition Image Restoration via Dual-Domain Decoupled Spectral Modulation [0.07352098890194292]
  Ultra-high-definition (UHD) images often suffer from severe degradations such as blur, haze, rain, or low-light conditions.<n>We propose UHDRes, a novel lightweight dual-domain decoupled spectral modulation framework for UHD image restoration.
  arXiv  Detail & Related papers  (2025-11-07T06:28:30Z)
• Diffusion Transformer meets Multi-level Wavelet Spectrum for Single Image Super-Resolution [15.056888813012451]
  We propose a Diffusion Transformer model based on image Wavelet spectra for SR (DTWSR)<n>DTWSR incorporates the superiority of diffusion models and transformers to capture the interrelations among multiscale frequency sub-bands.<n>A dual-decoder is designed elaborately to handle the distinct variances in low-frequency and high-frequency sub-bands, without omitting their alignment in image generation.
  arXiv  Detail & Related papers  (2025-11-03T02:56:58Z)
• Fourier-Guided Attention Upsampling for Image Super-Resolution [0.13999481573773068]
  Frequency-Guided Attention (FGA) is a lightweight upsampling module for single image super-resolution.<n>Trials show average PSNR gains of 0.120.14 dB and improved frequency-domain consistency by up to 29%.
  arXiv  Detail & Related papers  (2025-08-14T13:13:17Z)
• Wavelet-Guided Dual-Frequency Encoding for Remote Sensing Change Detection [67.84730634802204]
  Change detection in remote sensing imagery plays a vital role in various engineering applications, such as natural disaster monitoring, urban expansion tracking, and infrastructure management.<n>Most existing methods still rely on spatial-domain modeling, where the limited diversity of feature representations hinders the detection of subtle change regions.<n>We observe that frequency-domain feature modeling particularly in the wavelet domain amplify fine-grained differences in frequency components, enhancing the perception of edge changes that are challenging to capture in the spatial domain.
  arXiv  Detail & Related papers  (2025-08-07T11:14:16Z)
• FADPNet: Frequency-Aware Dual-Path Network for Face Super-Resolution [70.61549422952193]
  Face super-resolution (FSR) under limited computational costs remains an open problem.<n>Existing approaches typically treat all facial pixels equally, resulting in suboptimal allocation of computational resources.<n>We propose FADPNet, a Frequency-Aware Dual-Path Network that decomposes facial features into low- and high-frequency components.
  arXiv  Detail & Related papers  (2025-06-17T02:33:42Z)
• Freqformer: Image-Demoiréing Transformer via Efficient Frequency Decomposition [83.40450475728792]
  We present Freqformer, a Transformer-based framework specifically designed for image demoir'eing through targeted frequency separation.<n>Our method performs an effective frequency decomposition that explicitly splits moir'e patterns into high-frequency spatially-localized textures and low-frequency scale-robust color distortions.<n>Experiments on various demoir'eing benchmarks demonstrate that Freqformer achieves state-of-the-art performance with a compact model size.
  arXiv  Detail & Related papers  (2025-05-25T12:23:10Z)
• Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learning [81.98675881423131]
  This research addresses the challenge of developing a universal deepfake detector that can effectively identify unseen deepfake images. Existing frequency-based paradigms have relied on frequency-level artifacts introduced during the up-sampling in GAN pipelines to detect forgeries. We introduce a novel frequency-aware approach called FreqNet, centered around frequency domain learning, specifically designed to enhance the generalizability of deepfake detectors.
  arXiv  Detail & Related papers  (2024-03-12T01:28:00Z)
• Wavelet-Based Network For High Dynamic Range Imaging [64.66969585951207]
  Existing methods, such as optical flow based and end-to-end deep learning based solutions, are error-prone either in detail restoration or ghosting artifacts removal. In this work, we propose a novel frequency-guided end-to-end deep neural network (FNet) to conduct HDR fusion in the frequency domain, and Wavelet Transform (DWT) is used to decompose inputs into different frequency bands. The low-frequency signals are used to avoid specific ghosting artifacts, while the high-frequency signals are used for preserving details.
  arXiv  Detail & Related papers  (2021-08-03T12:26:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.