SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration
- URL: http://arxiv.org/abs/2603.05940v1
- Date: Fri, 06 Mar 2026 06:16:57 GMT
- Title: SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration
- Abstract summary: SLER-IR is a spherical layer-wise expert routing framework that activates specialized experts across network layers.<n>To ensure reliable routing, we introduce a Spherical Uniform Degradation Embedding with contrastive learning.<n>A Global-Local Granularity Fusion module integrates global semantics and local degradation cues to address spatially non-uniform degradations.
- Score: 23.475659268865186
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Image restoration under diverse degradations remains challenging for unified all-in-one frameworks due to feature interference and insufficient expert specialization. We propose SLER-IR, a spherical layer-wise expert routing framework that dynamically activates specialized experts across network layers. To ensure reliable routing, we introduce a Spherical Uniform Degradation Embedding with contrastive learning, which maps degradation representations onto a hypersphere to eliminate geometry bias in linear embedding spaces. In addition, a Global-Local Granularity Fusion (GLGF) module integrates global semantics and local degradation cues to address spatially non-uniform degradations and the train-test granularity gap. Experiments on three-task and five-task benchmarks demonstrate that SLER-IR achieves consistent improvements over state-of-the-art methods in both PSNR and SSIM. Code and models will be publicly released.
Related papers
- SphereVAD: Training-Free Video Anomaly Detection via Geodesic Inference on the Unit Hypersphere [90.85001795656633]
Video anomaly detection (VAD) aims to automatically identify events that deviate from normal patterns in untrimmed surveillance videos.<n>We propose SphereVAD, a fully training-free, zero-shot VAD framework that recasts anomaly discrimination as von Mises-Fisher (vMF) likelihood-ratio geodesic inference on the unit hypersphere.
arXiv Detail & Related papers (2026-05-08T16:57:38Z) - Hyperbolic Enhanced Representation Learning for Incomplete Multi-view Clustering [57.38215918201251]
We propose HERL, a Hyperbolic Enhanced Representation Learning framework for Incomplete Multi-View Clustering.<n> operating within the Poincaré ball, HERL constructs a structure-aware latent space to enhance representation learning.<n>We show that HERL consistently outperforms state-of-the-art approaches.
arXiv Detail & Related papers (2026-04-18T10:50:46Z) - Enhancing Gradient Inversion Attacks in Federated Learning via Hierarchical Feature Optimization [56.95448807869383]
Federated Learning (FL) has emerged as a compelling paradigm for privacy-preserving distributed machine learning.<n>Recent studies find that the gradients exchanged in the FL system are also vulnerable to privacy leakage.<n>We propose textbfGradient textbfInversion over textbfFeature textbfDomains (GIFD)
arXiv Detail & Related papers (2026-04-01T14:32:15Z) - LGEST: Dynamic Spatial-Spectral Expert Routing for Hyperspectral Image Classification [2.866506214681715]
Local-Global Expert Spatial-Spectral Transformer (LGEST) is a novel framework that combines three key innovations.<n>The LGEST consistently outperforms state-of-the-art methods in experiments on four benchmark datasets.
arXiv Detail & Related papers (2026-03-25T07:53:31Z) - SRasP: Self-Reorientation Adversarial Style Perturbation for Cross-Domain Few-Shot Learning [29.002306547742347]
Cross-Domain Few-Shot Learning aims to transfer knowledge from a seen source domain to unseen target domains.<n>Existing style-based perturbation methods mitigate domain shift but often suffer from instability and convergence to sharp minima.<n>We propose a novel crop-global style perturbation network, termed Self-Reorientation Adversarial underlineStyle underlinePerturbation (SRasP)
arXiv Detail & Related papers (2026-03-05T13:03:35Z) - SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restoration [9.908527979711902]
Hyperspectral image (HSI) restoration is a fundamental challenge in computational imaging and computer vision.<n>This paper presents SHARE, a fully unsupervised framework that unifies geometric equivariance principles with low-rank spectral modelling.<n>Our method outperforms many state-of-the-art unsupervised approaches and achieves performance comparable to that of supervised methods.
arXiv Detail & Related papers (2026-01-20T14:01:13Z) - Zero-shot Adaptation of Stable Diffusion via Plug-in Hierarchical Degradation Representation for Real-World Super-Resolution [22.82705867627899]
Real-World Image Super-Resolution aims to recover high-quality images from low-quality inputs degraded by unknown and complex real-world factors.<n>textbfHD-CLIP (textbfHierarchical textbfDegradation CLIP) decomposes a low-quality image into a semantic embedding.<n>textbfCLIP can be seamlessly integrated into various super-resolution frameworks without training.
arXiv Detail & Related papers (2025-12-11T06:45:28Z) - Mixture of Ranks with Degradation-Aware Routing for One-Step Real-World Image Super-Resolution [76.66229730098759]
In real-world image super-resolution (Real-ISR), existing approaches mainly rely on fine-tuning pre-trained diffusion models.<n>We propose a Mixture-of-Ranks (MoR) architecture for single-step image super-resolution.<n>We introduce a fine-grained expert partitioning strategy that treats each rank in LoRA as an independent expert.
arXiv Detail & Related papers (2025-11-20T04:11:44Z) - Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Images [51.74614065919118]
This paper introduces SegEarth-OV, the first framework for annotation-free open-vocabulary segmentation of RS images.<n>We propose SimFeatUp, a universal upsampler that robustly restores high-resolution spatial details from coarse features.<n>We also present a simple yet effective Global Bias Alleviation operation to subtract the inherent global context from patch features.
arXiv Detail & Related papers (2025-08-25T14:22:57Z) - HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguity [8.74691272469226]
HiNeuS is a unified framework that holistically addresses three core limitations in existing approaches.<n>We introduce: 1) Differential visibility verification through SDF-guided ray tracing; 2) Planar-conformal regularization via ray-aligned geometry patches; and 3) Physically-grounded Eikonal relaxation that dynamically modulates geometric constraints based on local gradients.
arXiv Detail & Related papers (2025-06-30T13:45:25Z) - Manifold-aware Representation Learning for Degradation-agnostic Image Restoration [135.90908995927194]
Image Restoration (IR) aims to recover high quality images from degraded inputs affected by various corruptions such as noise, blur, haze, rain, and low light conditions.<n>We present MIRAGE, a unified framework for all in one IR that explicitly decomposes the input feature space into three semantically aligned parallel branches.<n>This modular decomposition significantly improves generalization and efficiency across diverse degradations.
arXiv Detail & Related papers (2025-05-24T12:52:10Z) - GIFD: A Generative Gradient Inversion Method with Feature Domain
Optimization [52.55628139825667]
Federated Learning (FL) has emerged as a promising distributed machine learning framework to preserve clients' privacy.
Recent studies find that an attacker can invert the shared gradients and recover sensitive data against an FL system by leveraging pre-trained generative adversarial networks (GAN) as prior knowledge.
We propose textbfGradient textbfInversion over textbfFeature textbfDomains (GIFD), which disassembles the GAN model and searches the feature domains of the intermediate layers.
arXiv Detail & Related papers (2023-08-09T04:34:21Z) - PC-GANs: Progressive Compensation Generative Adversarial Networks for
Pan-sharpening [50.943080184828524]
We propose a novel two-step model for pan-sharpening that sharpens the MS image through the progressive compensation of the spatial and spectral information.
The whole model is composed of triple GANs, and based on the specific architecture, a joint compensation loss function is designed to enable the triple GANs to be trained simultaneously.
arXiv Detail & Related papers (2022-07-29T03:09:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.