Cross-Validated Cross-Channel Self-Attention and Denoising for Automatic Modulation Classification
- URL: http://arxiv.org/abs/2604.10054v1
- Date: Sat, 11 Apr 2026 06:29:12 GMT
- Title: Cross-Validated Cross-Channel Self-Attention and Denoising for Automatic Modulation Classification
- Abstract summary: The goal was to develop a feature-preserving denoising method that mitigates the loss of modulation class separation.<n>A deep learning AMC model was proposed, incorporating a cross-channel self-attention block to capture dependencies between in-phase and quadrature components.<n>Results showed that denoising depth strongly influences robustness at low and moderate SNRs.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This study addresses a key limitation in deep learning Automatic Modulation Classification (AMC) models, which perform well at high signal-to-noise ratios (SNRs) but degrade under noisy conditions due to conventional feature extraction suppressing both discriminative structure and interference. The goal was to develop a feature-preserving denoising method that mitigates the loss of modulation class separation. A deep learning AMC model was proposed, incorporating a cross-channel self-attention block to capture dependencies between in-phase and quadrature components, along with dual-path deep residual shrinkage denoising blocks to suppress noise. Experiments using the RML2018.01a dataset employed stratified sampling across 24 modulation types and 26 SNR levels. Results showed that denoising depth strongly influences robustness at low and moderate SNRs. Compared to benchmark models PET-CGDNN, MCLDNN, and DAE, the proposed model achieved notable accuracy improvements across -8 dB to +2 dB SNR, with increases of 3%, 2.3%, and 14%, respectively. Cross-validation confirmed the model's robustness, yielding a mean accuracy of 62.6%, macro precision of 65.8%, macro-recall of 62.6%, and macro-F1 score of 62.9%. The architecture advances interference-aware AMC by formalizing baseband modeling as orthogonal subproblems and introducing cross-channel attention as a generalized complex interaction operator, with ablations confirming the critical role of feature-preserving denoising for robustness at low-to-medium SNR.
Related papers
- Uncertainty-Aware Multi-Task Learning for Joint Modulation Recognition and SINR Estimation [0.0]
Joint modulation recognition and signal-to-interference-plus-noise ratio estimation can reduce duplicated processing in intelligent receivers.<n>This letter proposes an uncertainty-aware multi-task model that transforms each short normalized in-phase/quadrature window into 36 deterministic, label-free statistics.<n>A joint uncertainty score combines classification entropy and predicted regression variance to support selective inference.
arXiv Detail & Related papers (2026-08-28T21:06:06Z) - Normalized Architectures are Natively 4-Bit [49.13186675123547]
nGPT, an architecture that constrains weights and hidden representations to the unit hypersphere, is inherently more robust to low-precision arithmetic.<n>We validate this approach on both a 1.2B dense model and hybrid (Mamba-Transformer) MoE models of up to 3B/30B parameters.
arXiv Detail & Related papers (2026-05-07T11:54:07Z) - Less is More in Semantic Space: Intrinsic Decoupling via Clifford-M for Fundus Image Classification [13.23226865033351]
We propose Clifford-M, a lightweight backbone that replaces feed-forward expansion and frequency-splitting modules with sparse geometric interaction.<n>Without pre-training, Clifford-M achieves a mean AUC-ROC of 0.8142 and a mean macro-F1 of 0.5481 on ODIR-5K using only 0.85M parameters.
arXiv Detail & Related papers (2026-03-21T13:00:05Z) - SKANet: A Cognitive Dual-Stream Framework with Adaptive Modality Fusion for Robust Compound GNSS Interference Classification [47.20483076887704]
Global Navigation Satellite Systems (GNSS) face growing threats from sophisticated jamming interference.<n>We propose a cognitive deep learning framework built upon a dual-stream architecture that integrates Time-Frequency Images (TFIs) and Power Spectral Density (PSD)<n>We show that SKANet achieves an overall accuracy of 96.99%, exhibiting superior robustness for compound jamming classification.
arXiv Detail & Related papers (2026-01-19T07:42:45Z) - Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classification [55.56234913868664]
We propose Test-time Adaptive Hierarchical Co-enhanced Denoising Network (TAHCD) for reliable learning on multimodal data.<n>The proposed method achieves superior classification performance, robustness, and generalization compared with state-of-the-art reliable multimodal learning approaches.
arXiv Detail & Related papers (2026-01-12T03:14:12Z) - Denoised Recommendation Model with Collaborative Signal Decoupling [2.7629252298084026]
Collaborative filtering (CF) algorithm suffers from suboptimal recommendation performance due to noise in user-item interaction matrix.<n>This study proposes a novel GNN-based CF model called DRCSD for denoising unstable interactions.
arXiv Detail & Related papers (2025-11-06T10:18:02Z) - Every Attention Matters: An Efficient Hybrid Architecture for Long-Context Reasoning [73.10669391954801]
We present the Ring-linear model series, specifically including Ring-mini-linear-2.0 and Ring-flash-linear-2.0.<n>Both models adopt a hybrid architecture that effectively integrates linear attention and softmax attention.<n>Compared to a 32 billion parameter dense model, this series reduces inference cost to 1/10, and compared to the original Ring series, the cost is also reduced by over 50%.
arXiv Detail & Related papers (2025-10-22T07:59:38Z) - A Lightweight Deep Learning Model for Automatic Modulation Classification using Dual Path Deep Residual Shrinkage Network [0.0]
Automatic Modulation Classification (AMC) plays a key role in enhancing spectrum efficiency.<n>There is a pressing need for lightweight AMC models that balance low complexity with high classification accuracy.<n>This paper proposes a low-complexity, lightweight deep learning (DL) AMC model optimized for resource-constrained edge devices.
arXiv Detail & Related papers (2025-07-07T00:37:54Z) - Conditional Denoising Diffusion for ISAC Enhanced Channel Estimation in Cell-Free 6G [10.728362890819392]
Cell-free Integrated Sensing and Communication (ISAC) aims to revolutionize 6th Generation (6G) networks.<n>Channel estimation is a critical step in cell-free ISAC systems to ensure reliable communication.<n>This paper presents a novel framework leveraging sensing information as a key input within a Conditional Denoising Diffusion Model.
arXiv Detail & Related papers (2025-06-07T22:45:21Z) - Edge Detection based on Channel Attention and Inter-region Independence Test [2.8724598079549715]
Existing edge detection methods often suffer from noise amplification and excessive retention of non-salient details.<n>We propose CAM-EDIT, a novel framework that integrates Channel Attention Mechanism (CAM) and Edge Detection via Independence Testing (EDIT)<n>The F-measure scores of CAM-EDIT are 0.635 and 0.460, representing improvements of 19.2% to 26.5% over traditional methods.
arXiv Detail & Related papers (2025-05-02T06:30:21Z) - Deep Active Speech Cancellation with Mamba-Masking Network [62.73250985838971]
We present a novel deep learning network for Active Speech Cancellation (ASC)<n>The proposed Mamba-Masking architecture introduces a masking mechanism that directly interacts with the encoded reference signal.<n> Experimental results demonstrate substantial performance gains, achieving up to 7.2dB improvement in ANC scenarios and 6.2dB in ASC.
arXiv Detail & Related papers (2025-02-03T09:22:26Z) - SMRD: SURE-based Robust MRI Reconstruction with Diffusion Models [76.43625653814911]
Diffusion models have gained popularity for accelerated MRI reconstruction due to their high sample quality.
They can effectively serve as rich data priors while incorporating the forward model flexibly at inference time.
We introduce SURE-based MRI Reconstruction with Diffusion models (SMRD) to enhance robustness during testing.
arXiv Detail & Related papers (2023-10-03T05:05:35Z) - Brain Imaging-to-Graph Generation using Adversarial Hierarchical Diffusion Models for MCI Causality Analysis [44.45598796591008]
Brain imaging-to-graph generation (BIGG) framework is proposed to map functional magnetic resonance imaging (fMRI) into effective connectivity for mild cognitive impairment analysis.
The hierarchical transformers in the generator are designed to estimate the noise at multiple scales.
Evaluations of the ADNI dataset demonstrate the feasibility and efficacy of the proposed model.
arXiv Detail & Related papers (2023-05-18T06:54:56Z) - Towards a Competitive End-to-End Speech Recognition for CHiME-6 Dinner
Party Transcription [73.66530509749305]
In this paper, we argue that, even in difficult cases, some end-to-end approaches show performance close to the hybrid baseline.
We experimentally compare and analyze CTC-Attention versus RNN-Transducer approaches along with RNN versus Transformer architectures.
Our best end-to-end model based on RNN-Transducer, together with improved beam search, reaches quality by only 3.8% WER abs. worse than the LF-MMI TDNN-F CHiME-6 Challenge baseline.
arXiv Detail & Related papers (2020-04-22T19:08:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.