Fully Rotation-Equivariant Spectral-Spatial Learning for Multispectral Object Detection

• URL: http://arxiv.org/abs/2607.05148v1
• Date: Mon, 06 Jul 2026 14:29:51 GMT
• Title: Fully Rotation-Equivariant Spectral-Spatial Learning for Multispectral Object Detection
• Abstract summary: FressDet is a fully rotation-equivariant spectral-spatial learning framework for multispectral object detection.<n>It captures the continuous, ordered nature of spectral structure and enables reliable spectral-spatial fusion across pyramid levels.<n>FressDet learns more discriminative and robust spectral-spatial representations even under rotational perturbations.
• Score: 26.632380150006753
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Existing multispectral detectors are limited by discrete spectral processing, a scale-dependent shift in the relative reliability of spectral and spatial cues across pyramid levels, and the lack of explicit rotation-equivariant geometric priors for arbitrarily oriented objects. To tackle these limitations, we propose FressDet, a fully rotation-equivariant spectral-spatial learning framework for multispectral object detection, capable of capturing the continuous, ordered nature of spectral structure and enabling reliable spectral-spatial fusion across pyramid levels under arbitrary in-plane rotations. FressDet integrates three complementary components. Spectral Implicit Warp (SpeIW) enables query-based spectral resampling via a coordinate-conditioned implicit field, yielding a monotone, order-preserving warp. Rotation-Equivariant Consistency Weighting (ReCoW) adaptively fuses spectral and spatial branches based on branch reliability, reinforcing informative cues while suppressing noise across pyramid levels. The oriented-aware head exploits group-indexed features to stably predict oriented objects without parameter replication. Taken together, FressDet learns more discriminative and robust spectral-spatial representations even under rotational perturbations. By achieving state-of-the-art performance with 93% fewer parameters on three public benchmarks, FressDet demonstrates its effectiveness and generalizability.

Related papers

• Spectral-Spatial Synergistic Guided Network for Hyperspectral Salient Object Detection [29.979358462284623]
  We propose a lightweight and efficient Spectral-Spatial Synergistic Guided Network (S3GNet) for object detection.<n>S3GNet builds a closed-loop information flow around spectrum robust modeling, cross-stream co-perception and multi-scale refinement decoding.<n> Experimental results show that S3GNet achieves superior performance in both computational efficiency and detection accuracy compared to existing methods.
  arXiv  Detail & Related papers  (2026-07-23T08:14:32Z)
• Analytic Torsion and Spectral Gap Capture Persistent-Laplacian Performance [0.0]
  We propose a compact spectral representation that distills the persistent Laplacian into three mathematically grounded invariants.<n>Our results suggest that these invariants provide a principled, fixed-length interface between spectral geometry and topological learning.
  arXiv  Detail & Related papers  (2026-06-15T17:28:57Z)
• Dynamic Spectral Denoising with Global-Context Attention for Multi-Behavior Recommendation [58.33732779555114]
  We argue that the key bottleneck is a representation-level failure caused by two coupled heterogeneities.<n>We propose Dynamic Spectral Denoising with Global-Context Attention for Multi-Behavior Recommendation (SpectraMB)<n>SpectraMB achieves the best results in most evaluation settings and exhibits improved robustness under noisy interactions.
  arXiv  Detail & Related papers  (2026-06-01T15:58:13Z)
• Phy-CoSF: Physics-Guided Continuous Spectral Fields Reconstruction and Super-Resolution for Snapshot Compressive Imaging [79.35520607451187]
  We propose Phy-CoSF, which synergizes deep unfolding networks with implicit neural representations.<n>Specifically, we propose a two-phase architecture that bridges discrete-wavelength training with continuous spectral rendering.
  arXiv  Detail & Related papers  (2026-05-13T14:17:02Z)
• Physics-Aligned Spectral Mamba: Decoupling Semantics and Dynamics for Few-Shot Hyperspectral Target Detection [14.607792636586067]
  SpecMamba is a framework that decouples stable semantic representation from agile spectral adaptation.<n>It consistently outperforms state-of-the-art methods in detection accuracy and cross-domain generalization.
  arXiv  Detail & Related papers  (2026-04-07T08:04:18Z)
• Robust Graph Representation Learning via Adaptive Spectral Contrast [0.9558392439655014]
  High-frequency signals are indispensable for encoding heterophily but exhibit significantly higher variance under spectrally concentrated perturbations.<n>We propose ASPECT, a framework that resolves this dilemma through a reliability-aware spectral gating mechanism.<n>ASPECT achieves new state-of-the-art performance on 8 out of 9 benchmarks, effectively decoupling meaningful structural heterophily from incidental noise.
  arXiv  Detail & Related papers  (2026-04-02T10:38:00Z)
• Spectral Gating Networks [65.9496901693099]
  We introduce Spectral Gating Networks (SGN) to introduce frequency-rich expressivity in feed-forward networks.<n>SGN augments a standard activation pathway with a compact spectral pathway and learnable gates that allow the model to start from a stable base behavior.<n>It consistently improves accuracy-efficiency trade-offs under comparable computational budgets.
  arXiv  Detail & Related papers  (2026-02-07T20:00:49Z)
• Spectral Graph Clustering under Differential Privacy: Balancing Privacy, Accuracy, and Efficiency [53.98433419539793]
  We study the problem of spectral graph clustering under edge differential privacy (DP)<n>Specifically, we develop three mechanisms: (i) graph perturbation via randomized edge flipping combined with adjacency matrix shuffling, which enforces edge privacy; (ii) private graph projection with additive Gaussian noise in a lower-dimensional space to reduce dimensionality and computational complexity; and (iii) a noisy power iteration method that distributes Gaussian noise across iterations to ensure edge DP while maintaining convergence.
  arXiv  Detail & Related papers  (2025-10-08T15:30:27Z)
• SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling [65.65474629224558]
  We propose a spectrum foundation model, termed SpectrumFM, which provides a new paradigm for spectrum cognition.<n>An innovative spectrum encoder that exploits the convolutional neural networks is proposed to effectively capture both fine-grained local signal structures and high-level global dependencies in the spectrum data.<n>Two novel self-supervised learning tasks, namely masked reconstruction and next-slot signal prediction, are developed for pre-training SpectrumFM, enabling the model to learn rich and transferable representations.
  arXiv  Detail & Related papers  (2025-08-02T14:40:50Z)
• CARL: Camera-Agnostic Representation Learning for Spectral Image Analysis [69.02751635551724]
  Spectral imaging offers promising applications across diverse domains, including medicine and urban scene understanding.<n> variability in channel dimensionality and captured wavelengths among spectral cameras impede the development of AI-driven methodologies.<n>We introduce CARL, a model for Camera-Agnostic Representation Learning across RGB, multispectral, and hyperspectral imaging modalities.
  arXiv  Detail & Related papers  (2025-04-27T13:06:40Z)
• Holistic Physics Solver: Learning PDEs in a Unified Spectral-Physical Space [54.13671100638092]
  Holistic Physics Mixer (HPM) is a framework for integrating spectral and physical information in a unified space.<n>We show that HPM consistently outperforms state-of-the-art methods in both accuracy and computational efficiency.
  arXiv  Detail & Related papers  (2024-10-15T08:19:39Z)
• TOP-ReID: Multi-spectral Object Re-Identification with Token Permutation [64.65950381870742]
  We propose a cyclic token permutation framework for multi-spectral object ReID, dubbled TOP-ReID. We also propose a Token Permutation Module (TPM) for cyclic multi-spectral feature aggregation. Our proposed framework can generate more discriminative multi-spectral features for robust object ReID.
  arXiv  Detail & Related papers  (2023-12-15T08:54:15Z)
• Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detection [14.621504062838731]
  We propose a novel approach that fully leverages the spectral characteristics by extracting two distinct frequency components from the spectrum. The Spectral Saliency approximates the region of salient objects, while the Spectral Edge captures edge information of salient objects. To effectively utilize this dual-frequency information, we introduce a novel lightweight Spectrum-driven Mixed-frequency Network (SMN)
  arXiv  Detail & Related papers  (2023-12-02T08:05:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.