Neural Network-based Vehicular Channel Estimation Performance: Effect of Noise in the Training Set
- URL: http://arxiv.org/abs/2502.06824v1
- Date: Wed, 05 Feb 2025 09:29:01 GMT
- Title: Neural Network-based Vehicular Channel Estimation Performance: Effect of Noise in the Training Set
- Abstract summary: Vehicular communication systems face significant challenges due to high mobility and rapidly changing environments.<n>To address these challenges, neural network (NN)-based channel estimation methods have been suggested.<n>This study examines the effectiveness of training NN-based channel estimators on mixed SNR datasets.
- Score: 0.5530212768657544
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Vehicular communication systems face significant challenges due to high mobility and rapidly changing environments, which affect the channel over which the signals travel. To address these challenges, neural network (NN)-based channel estimation methods have been suggested. These methods are primarily trained on high signal-to-noise ratio (SNR) with the assumption that training a NN in less noisy conditions can result in good generalisation. This study examines the effectiveness of training NN-based channel estimators on mixed SNR datasets compared to training solely on high SNR datasets, as seen in several related works. Estimators evaluated in this work include an architecture that uses convolutional layers and self-attention mechanisms; a method that employs temporal convolutional networks and data pilot-aided estimation; two methods that combine classical methods with multilayer perceptrons; and the current state-of-the-art model that combines Long-Short-Term Memory networks with data pilot-aided and temporal averaging methods as post processing. Our results indicate that using only high SNR data for training is not always optimal, and the SNR range in the training dataset should be treated as a hyperparameter that can be adjusted for better performance. This is illustrated by the better performance of some models in low SNR conditions when trained on the mixed SNR dataset, as opposed to when trained exclusively on high SNR data.
Related papers
- Realistic noise synthesis reduces bias and improves tissue microstructure estimation with supervised machine learning [0.2155083987188202]
We investigate the impact of discrepancies between noise characteristics of simulated and acquired signals on microstructure parameter estimation.<n>We propose a realistic noise synthesis (RNS) framework to mitigate it.<n>RNS incorporates both the Rician expectation and the effective post-processing noise variance into simulated training signals.
arXiv Detail & Related papers (2026-06-01T10:35:33Z) - Dynamics and Representation Structure of Local Approximations to Gradient-Based Learning in Linear Recurrent Neural Networks [56.42974363744522]
We study the learning dynamics of random feedback local online (RFLO) and truncated backpropagation through time (tBPTT)<n>Our work provides analytical insight into how locality constraints shape learning dynamics, with implications for neuroscientific models of learning and alternative optimization approaches for RNNs.
arXiv Detail & Related papers (2026-05-29T18:19:45Z) - Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks [48.553902624178995]
We train an ensemble of networks on regression and classification tasks using training sets by independent realizations of a noise process.<n>We show that the signal-to-noise ratio (SNR) and the training sample size influence the alignment.<n>Across linear and nonlinear networks, regression and classification tasks, and both synthetic and real-world data, we consistently observe that alignment varies monotonically with SNR.
arXiv Detail & Related papers (2026-05-26T12:58:48Z) - Dilated CNNs for Periodic Signal Processing: A Low-Complexity Approach [0.0]
This study proposes a computationally efficient method based on DCNN and Re-sampling, termed R-DCNN, designed for operation under strict power and resource constraints.<n>The approach targets signals with varying fundamental frequencies and requires only a single observation for training.<n>It generalizes to additional signals via a lightweight resampling step that aligns time scales in signals with different frequencies to re-use the same network weights.<n>Despite its low computational complexity, R-DCNN achieves performance comparable to state-of-the-art classical methods, such as autoregressive (AR)-based techniques, as well as conventional DCNNs trained
arXiv Detail & Related papers (2026-04-23T13:16:27Z) - How Does Label Noise Gradient Descent Improve Generalization in the Low SNR Regime? [78.0226274470175]
We investigate whether introducing label noise to the gradient updates can enhance the test performance of neural network (NN)<n>We prove that adding label noise during training suppresses noise memorization, preventing it from dominating the learning process.<n>In contrast, we show that NN trained with standard GD tends to overfit to noise in the same low SNR setting.
arXiv Detail & Related papers (2025-10-20T13:28:13Z) - Hybrid Data-Driven SSM for Interpretable and Label-Free mmWave Channel Prediction [15.984639104292352]
This paper proposes a novel hybrid method that integrates a data-driven neural network into a conventional model-based workflow.
A novel unsupervised learning strategy is developed to train the embedded neural network solely with unlabeled data.
arXiv Detail & Related papers (2024-11-18T13:54:44Z) - Heterogeneous Learning Rate Scheduling for Neural Architecture Search on Long-Tailed Datasets [0.0]
We propose a novel adaptive learning rate scheduling strategy tailored for the architecture parameters of DARTS.
Our approach dynamically adjusts the learning rate of the architecture parameters based on the training epoch, preventing the disruption of well-trained representations.
arXiv Detail & Related papers (2024-06-11T07:32:25Z) - Learning with Noisy Foundation Models [95.50968225050012]
This paper is the first work to comprehensively understand and analyze the nature of noise in pre-training datasets.
We propose a tuning method (NMTune) to affine the feature space to mitigate the malignant effect of noise and improve generalization.
arXiv Detail & Related papers (2024-03-11T16:22:41Z) - Diffusion-based Generative Prior for Low-Complexity MIMO Channel
Estimation [12.192048506302015]
This work proposes a novel channel estimator based on diffusion models (DMs)
CNN with positional embedding of the signal-to-noise ratio (SNR) information is designed by learning the channel distribution in the sparse angular domain.
Results exhibit better performance than state-of-the-art channel estimators utilizing generative priors.
arXiv Detail & Related papers (2024-03-06T08:47:31Z) - Low-Resource Music Genre Classification with Cross-Modal Neural Model
Reprogramming [129.4950757742912]
We introduce a novel method for leveraging pre-trained models for low-resource (music) classification based on the concept of Neural Model Reprogramming (NMR)
NMR aims at re-purposing a pre-trained model from a source domain to a target domain by modifying the input of a frozen pre-trained model.
Experimental results suggest that a neural model pre-trained on large-scale datasets can successfully perform music genre classification by using this reprogramming method.
arXiv Detail & Related papers (2022-11-02T17:38:33Z) - Being a Bit Frequentist Improves Bayesian Neural Networks [76.73339435080446]
We show that OOD-trained BNNs are competitive to, if not better than recent frequentist baselines.
This work provides strong baselines for future work in both Bayesian and frequentist UQ.
arXiv Detail & Related papers (2021-06-18T11:22:42Z) - A SAR speckle filter based on Residual Convolutional Neural Networks [68.8204255655161]
This work aims to present a novel method for filtering the speckle noise from Sentinel-1 data by applying Deep Learning (DL) algorithms, based on Convolutional Neural Networks (CNNs)
The obtained results, if compared with the state of the art, show a clear improvement in terms of Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM)
arXiv Detail & Related papers (2021-04-19T14:43:07Z) - Deep Networks for Direction-of-Arrival Estimation in Low SNR [89.45026632977456]
We introduce a Convolutional Neural Network (CNN) that is trained from mutli-channel data of the true array manifold matrix.
We train a CNN in the low-SNR regime to predict DoAs across all SNRs.
Our robust solution can be applied in several fields, ranging from wireless array sensors to acoustic microphones or sonars.
arXiv Detail & Related papers (2020-11-17T12:52:18Z) - Deep Time Delay Neural Network for Speech Enhancement with Full Data
Learning [60.20150317299749]
This paper proposes a deep time delay neural network (TDNN) for speech enhancement with full data learning.
To make full use of the training data, we propose a full data learning method for speech enhancement.
arXiv Detail & Related papers (2020-11-11T06:32:37Z) - Centimeter-Level Indoor Localization using Channel State Information
with Recurrent Neural Networks [12.193558591962754]
This paper proposes the neural network method to estimate the centimeter-level indoor positioning with real CSI data collected from linear antennas.
It utilizes an amplitude of channel response or a correlation matrix as the input, which can highly reduce the data size and suppress the noise.
Also, it makes use of the consistency in the user motion trajectory via Recurrent Neural Network (RNN) and signal-noise ratio (SNR) information, which can further improve the estimation accuracy.
arXiv Detail & Related papers (2020-02-04T17:10:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.