Latency-Distortion Tradeoffs in Communicating Classification Results over Noisy Channels

• URL: http://arxiv.org/abs/2404.14586v1
• Date: Mon, 22 Apr 2024 21:22:12 GMT
• Title: Latency-Distortion Tradeoffs in Communicating Classification Results over Noisy Channels
• Abstract summary: We study the scenario where a probability vector needs to be transmitted over a noisy channel. We analyze the trade-off between transmission latency and the distortion. Our results show that there is an interesting interplay between source distortion (i.e., distortion for the probability vector measured via f-divergence) and the subsequent channel encoding/decoding parameters.
• Score: 8.159697831570593
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this work, the problem of communicating decisions of a classifier over a noisy channel is considered. With machine learning based models being used in variety of time-sensitive applications, transmission of these decisions in a reliable and timely manner is of significant importance. To this end, we study the scenario where a probability vector (representing the decisions of a classifier) at the transmitter, needs to be transmitted over a noisy channel. Assuming that the distortion between the original probability vector and the reconstructed one at the receiver is measured via f-divergence, we study the trade-off between transmission latency and the distortion. We completely analyze this trade-off using uniform, lattice, and sparse lattice-based quantization techniques to encode the probability vector by first characterizing bit budgets for each technique given a requirement on the allowed source distortion. These bounds are then combined with results from finite-blocklength literature to provide a framework for analyzing the effects of both quantization distortion and distortion due to decoding error probability (i.e., channel effects) on the incurred transmission latency. Our results show that there is an interesting interplay between source distortion (i.e., distortion for the probability vector measured via f-divergence) and the subsequent channel encoding/decoding parameters; and indicate that a joint design of these parameters is crucial to navigate the latency-distortion tradeoff. We study the impact of changing different parameters (e.g. number of classes, SNR, source distortion) on the latency-distortion tradeoff and perform experiments on AWGN and fading channels. Our results indicate that sparse lattice-based quantization is the most effective at minimizing latency across various regimes and for sparse, high-dimensional probability vectors (i.e., high number of classes).

Related papers

• JSCGC: Joint Source-Channel-Generation Coding for Wireless Generative Communications [58.67925548779465]
  Joint Source-Channel-Generation Coding (JSCGC) is a generative communication paradigm that replaces the conventional decoder with a generative model at the receiver.<n>JSCGC consistently improves feature-based, semantic-level, and inferenceal quality across diverse channel conditions.
  arXiv  Detail & Related papers  (2026-06-11T03:42:03Z)
• The Radio-Frequency Transformer for Signal Separation [29.348481060446314]
  We study a problem of signal separation: estimating a signal of interest contaminated by an unknown non-Gaussian background/interference.<n>We learn a good discrete tokenizer for SOI and then train an end-to-end transformer on a cross-entropy loss.<n>Across real and synthetic mixtures from the MIT RF Challenge dataset, our method achieves competitive performance.
  arXiv  Detail & Related papers  (2026-03-10T05:22:02Z)
• Fault-Tolerant Information Processing with Quantum Weak Measurement [15.123920303879792]
  A fault-tolerant information processing approach via quantum weak measurement is proposed.<n>The signal to be protected can be retrieved with a minimal distortion after having been transmitted through a noisy channel.<n>The proposed approach may provide a solution for suppressing noise effects in long-distance quantum communication, high-sensitivity quantum sensing, and accurate quantum computation.
  arXiv  Detail & Related papers  (2025-12-07T01:39:22Z)
• Adaptive Estimation of Drifting Noise in Quantum Error Correction [1.1998722332188005]
  We present a framework to capture time-dependent Pauli noise, by exploiting the syndrome statistics of quantum error correction experiments.<n>We prove the noise-filtering behavior of sliding windows, linking window size to spectral cutoff frequencies, and provide an iterative algorithm that captures multiple drift frequencies.<n>Our window-based estimation methods and adaptive decoding offer new insights into noise spectroscopy and decoder optimization under drift.
  arXiv  Detail & Related papers  (2025-11-12T17:03:56Z)
• Prediction-Powered Communication with Distortion Guarantees [65.37485275954224]
  We study a prediction-powered communication setting, in which devices communicate under zero-delay constraints with strict distortion guarantees.<n>We propose two zero-delay compression algorithms leveraging online conformal prediction to provide per-sequence guarantees on the distortion of reconstructed sequences.<n>Experiments on semantic text compression validate the approach, showing significant bit rate reductions.
  arXiv  Detail & Related papers  (2025-09-29T07:19:39Z)
• FreSca: Unveiling the Scaling Space in Diffusion Models [52.20473039489599]
  Diffusion models offer impressive controllability for image tasks, primarily through noise predictions that encode task-specific information and guidance enabling adjustable scaling. We investigate this space, starting with inversion-based editing where the difference between conditional/unconditional noise predictions carries key semantic information. Our core contribution stems from a Fourier analysis of noise predictions, revealing that its low- and high-frequency components evolve differently throughout diffusion. Based on this insight, we introduce FreSca, a straightforward method that applies guidance scaling independently to different frequency bands in the Fourier domain.
  arXiv  Detail & Related papers  (2025-04-02T22:03:11Z)
• Resampling Filter Design for Multirate Neural Audio Effect Processing [9.149661171430257]
  We explore the use of signal resampling at the input and output of the neural network as an alternative solution. We show that a two-stage design consisting of a half-band IIR filter cascaded with a Kaiser window FIR filter can give similar or better results to the previously proposed model adjustment method.
  arXiv  Detail & Related papers  (2025-01-30T16:44:49Z)
• Diffusion-Driven Semantic Communication for Generative Models with Bandwidth Constraints [66.63250537475973]
  This paper introduces a diffusion-driven semantic communication framework with advanced VAE-based compression for bandwidth-constrained generative model.<n>Our experimental results demonstrate significant improvements in pixel-level metrics like peak signal to noise ratio (PSNR) and semantic metrics like learned perceptual image patch similarity (LPIPS)
  arXiv  Detail & Related papers  (2024-07-26T02:34:25Z)
• Collaborative Edge AI Inference over Cloud-RAN [37.3710464868215]
  A cloud radio access network (Cloud-RAN) based collaborative edge AI inference architecture is proposed. Specifically, geographically distributed devices capture real-time noise-corrupted sensory data samples and extract the noisy local feature vectors. We allow each RRH receives local feature vectors from all devices over the same resource blocks simultaneously by leveraging an over-the-air computation (AirComp) technique. These aggregated feature vectors are quantized and transmitted to a central processor for further aggregation and downstream inference tasks.
  arXiv  Detail & Related papers  (2024-04-09T04:26:16Z)
• Short-Time Fourier Transform for deblurring Variational Autoencoders [0.0]
  Variational Autoencoders (VAEs) are powerful generative models. Their generated samples are known to suffer from a characteristic blurriness, as compared to the outputs of alternative generating techniques.
  arXiv  Detail & Related papers  (2024-01-06T08:57:11Z)
• Streaming Joint Speech Recognition and Disfluency Detection [30.018034246393725]
  We propose Transformer-based encoder-decoder models that jointly solve speech recognition and disfluency detection. Compared to pipeline approaches, the joint models can leverage acoustic information that makes disfluency detection robust to recognition errors. We show that the proposed joint models outperformed a BERT-based pipeline approach in both accuracy and latency.
  arXiv  Detail & Related papers  (2022-11-16T07:34:20Z)
• Neural Estimation of the Rate-Distortion Function With Applications to Operational Source Coding [25.59334941818991]
  A fundamental question in designing lossy data compression schemes is how well one can do in comparison with the rate-distortion function. We investigate methods to estimate the rate-distortion function on large, real-world data. We apply the resulting rate-distortion estimator, called NERD, on popular image datasets.
  arXiv  Detail & Related papers  (2022-04-04T16:06:40Z)
• Treatment Learning Causal Transformer for Noisy Image Classification [62.639851972495094]
  In this work, we incorporate this binary information of "existence of noise" as treatment into image classification tasks to improve prediction accuracy. Motivated from causal variational inference, we propose a transformer-based architecture, that uses a latent generative model to estimate robust feature representations for noise image classification. We also create new noisy image datasets incorporating a wide range of noise factors for performance benchmarking.
  arXiv  Detail & Related papers  (2022-03-29T13:07:53Z)
• Error Correction Code Transformer [92.10654749898927]
  We propose to extend for the first time the Transformer architecture to the soft decoding of linear codes at arbitrary block lengths. We encode each channel's output dimension to high dimension for better representation of the bits information to be processed separately. The proposed approach demonstrates the extreme power and flexibility of Transformers and outperforms existing state-of-the-art neural decoders by large margins at a fraction of their time complexity.
  arXiv  Detail & Related papers  (2022-03-27T15:25:58Z)
• Deblurring via Stochastic Refinement [85.42730934561101]
  We present an alternative framework for blind deblurring based on conditional diffusion models. Our method is competitive in terms of distortion metrics such as PSNR.
  arXiv  Detail & Related papers  (2021-12-05T04:36:09Z)
• Performance of teleportation-based error correction circuits for bosonic codes with noisy measurements [58.720142291102135]
  We analyze the error-correction capabilities of rotation-symmetric codes using a teleportation-based error-correction circuit. We find that with the currently achievable measurement efficiencies in microwave optics, bosonic rotation codes undergo a substantial decrease in their break-even potential.
  arXiv  Detail & Related papers  (2021-08-02T16:12:13Z)
• SignalNet: A Low Resolution Sinusoid Decomposition and Estimation Network [79.04274563889548]
  We propose SignalNet, a neural network architecture that detects the number of sinusoids and estimates their parameters from quantized in-phase and quadrature samples. We introduce a worst-case learning threshold for comparing the results of our network relative to the underlying data distributions. In simulation, we find that our algorithm is always able to surpass the threshold for three-bit data but often cannot exceed the threshold for one-bit data.
  arXiv  Detail & Related papers  (2021-06-10T04:21:20Z)
• A Deep Ordinal Distortion Estimation Approach for Distortion Rectification [62.72089758481803]
  We propose a novel distortion rectification approach that can obtain more accurate parameters with higher efficiency. We design a local-global associated estimation network that learns the ordinal distortion to approximate the realistic distortion distribution. Considering the redundancy of distortion information, our approach only uses a part of distorted image for the ordinal distortion estimation.
  arXiv  Detail & Related papers  (2020-07-21T10:03:42Z)
• Neural Communication Systems with Bandwidth-limited Channel [9.332315420944836]
  Reliably transmitting messages despite information loss is a core problem of information theory. In this study we consider learning coding with the bandwidth-limited channel (BWLC)
  arXiv  Detail & Related papers  (2020-03-30T11:58:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.