A Synonymous Variational Perspective on the Rate-Distortion-Perception Tradeoff

• URL: http://arxiv.org/abs/2604.14603v1
• Date: Thu, 16 Apr 2026 04:21:32 GMT
• Title: A Synonymous Variational Perspective on the Rate-Distortion-Perception Tradeoff
• Abstract summary: In this paper, motivated by a synonymity-based semantic information perspective, we reformulate reconstruction as recovering any admissible sample within an ideal synonymous set (synset) associated with the source.<n>We show that the distributional divergence term arises naturally from the synset-based reconstruction objective, clarify its compatibility with existing formulations and classical RD theory, and suggest the potential advantages of synonymous source coding.
• Score: 13.751084926770773
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The fundamental limit of natural signal compression has traditionally been characterized by classical rate-distortion (RD) theory through the tradeoff between coding rate and reconstruction distortion, while the rate-distortion-perception (RDP) framework introduces a divergence-based measure of perceptual quality as a modeling principle rather than a theoretically-derived principle, leaving its theoretical origin unclear. In this paper, motivated by a synonymity-based semantic information perspective, we reformulate perceptual reconstruction as recovering any admissible sample within an ideal synonymous set (synset) associated with the source, rather than the source sample itself, and correspondingly establish a synonymous source coding architecture. On this basis, we develop a synonymous variational inference (SVI) analysis framework with a synonymous variational lower bound (SVLBO) for tractable analysis of synset-oriented compression. Within this framework, we establish a synonymity-perception consistency principle, showing that optimal identification of semantic information is theoretically consistent with perceptual optimization. Based on its derivation result, we prove a synonymous RDP tradeoff for the proposed synonymous source coding. These analytical results show that the distributional divergence term arises naturally from the synset-based reconstruction objective, clarify its compatibility with existing RDP formulations and classical RD theory, and suggest the potential advantages of synonymous source coding.

Related papers

• Rate-Distortion-Perception Theory: Redefining the Fundamental Limits of Information Representation [9.788112471288057]
  Rate-distortion-perception (RDP) theory extends the RD framework by introducing perception as a third fundamental axis.<n>Special attention is given to computational tools such as alternating schemes, Newton-based methods, and convex optimization.
  arXiv  Detail & Related papers  (2026-07-19T12:55:43Z)
• Implicit Variational Rejection Sampling [49.24060583051337]
  Variational Inference (VI) is a fundamental inference technique in Bayesian machine learning for approxing complex posterior distributions.<n>Recent advancements have leveraged neural networks to model implicit distributions, offering increased flexibility.<n>We propose a method called Implicit Variational Rejection Sampling (IVRS), which integrates implicit distributions with rejection sampling to improve the posterior approximation.
  arXiv  Detail & Related papers  (2026-06-12T08:17:45Z)
• JSCGC: Joint Source-Channel-Generation Coding for Wireless Generative Communications [58.67925548779465]
  Joint Source-Channel-Generation Coding (JSCGC) is a generative communication paradigm that replaces the conventional decoder with a generative model at the receiver.<n>JSCGC consistently improves feature-based, semantic-level, and inferenceal quality across diverse channel conditions.
  arXiv  Detail & Related papers  (2026-06-11T03:42:03Z)
• AR-Flow VAE: A Structured Autoregressive Flow Prior Variational Autoencoder for Unsupervised Blind Source Separation [1.4174475093445233]
  We propose AR-Flow VAE, a novel VAE-based framework for blind source separation.<n>This work provides a foundation for future investigations into the identifiability and interpretability of AR-Flow VAE.
  arXiv  Detail & Related papers  (2026-03-15T15:35:51Z)
• Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restoration [31.878334664450776]
  We present textbfPrefRestore, a hierarchical framework that integrates discrete semantic logic with continuous texture generation.<n>Our methodology fundamentally addresses this information disparity through two complementary strategies.<n>Pref-Restore achieves state-of-the-art performance across synthetic and real-world benchmarks.
  arXiv  Detail & Related papers  (2026-01-27T11:50:31Z)
• Joint Source-Channel-Generation Coding: From Distortion-oriented Reconstruction to Semantic-consistent Generation [58.67925548779465]
  We propose Joint Source-Channel-Generation Coding (JSCGC), a novel paradigm that shifts the focus from perceptual reconstruction to probabilistic generation.<n>JSCGC improves substantially semantic quality and semantic fidelity, significantly outperforming conventional distortion-oriented J SCC methods.
  arXiv  Detail & Related papers  (2026-01-19T08:12:47Z)
• The Procrustean Bed of Time Series: The Optimization Bias of Point-wise Loss [53.542743390809356]
  This paper aims to provide a first-principles analysis of the Expectation of Optimization Bias (EOB)<n>Our analysis reveals a fundamental paradigm paradox: the more deterministic and structured the time series, the more severe the bias by point-wise loss function.<n>We present a concrete solution that simultaneously achieves both principles via DFT or DWT.
  arXiv  Detail & Related papers  (2025-12-21T06:08:22Z)
• Latent Diffusion Model Based Denoising Receiver for 6G Semantic Communication: From Stochastic Differential Theory to Application [11.385703484113552]
  We propose a novel semantic communication framework empowered by generative artificial intelligence (GAI)<n>A latent diffusion model (LDM)-based semantic communication framework is proposed that combines a variational autoencoder for semantic features extraction.<n>The proposed system is a training-free framework that supports zero-shot generalization, and achieves superior performance under low-SNR and out-of-distribution conditions.
  arXiv  Detail & Related papers  (2025-06-06T03:20:32Z)
• Synonymous Variational Inference for Perceptual Image Compression [9.694218792074693]
  We propose a synonymous variational inference (SVI) method to re-analyze the image compression problem.<n>It takes perceptual similarity as a typical synonymous criterion to build an ideal synonymous set (Synset)<n>We introduce a new image compression scheme that corresponds to the analytical process of SVI.
  arXiv  Detail & Related papers  (2025-05-28T15:03:27Z)
• On Self-Adaptive Perception Loss Function for Sequential Lossy Compression [29.361832071511795]
  We consider causal, low-latency, sequential lossy compression, with mean squared-error (MSE) as the distortion loss, and a perception loss function (PLF) to enhance the realism of reconstructions.<n>We establish the theoretical rate-distortion-perception function for first-order Markov sources and analyze the Gaussian model in detail.<n>The proposed metric is referred to as self-adaptive perception loss function (PLF-SA), as its behavior adapts to the quality of reconstructed frames.
  arXiv  Detail & Related papers  (2025-02-15T01:41:53Z)
• Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint [56.74058752955209]
  This paper studies the alignment process of generative models with Reinforcement Learning from Human Feedback (RLHF) We first identify the primary challenges of existing popular methods like offline PPO and offline DPO as lacking in strategical exploration of the environment. We propose efficient algorithms with finite-sample theoretical guarantees.
  arXiv  Detail & Related papers  (2023-12-18T18:58:42Z)
• Learning Causal Semantic Representation for Out-of-Distribution Prediction [125.38836464226092]
  We propose a Causal Semantic Generative model (CSG) based on a causal reasoning so that the two factors are modeled separately. We show that CSG can identify the semantic factor by fitting training data, and this semantic-identification guarantees the boundedness of OOD generalization error.
  arXiv  Detail & Related papers  (2020-11-03T13:16:05Z)
• Towards a Theoretical Understanding of the Robustness of Variational Autoencoders [82.68133908421792]
  We make inroads into understanding the robustness of Variational Autoencoders (VAEs) to adversarial attacks and other input perturbations. We develop a novel criterion for robustness in probabilistic models: $r$-robustness. We show that VAEs trained using disentangling methods score well under our robustness metrics.
  arXiv  Detail & Related papers  (2020-07-14T21:22:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.