Disentangling the Link Between Image Statistics and Human Perception
- URL: http://arxiv.org/abs/2303.09874v3
- Date: Thu, 5 Oct 2023 14:06:32 GMT
- Title: Disentangling the Link Between Image Statistics and Human Perception
- Authors: Alexander Hepburn, Valero Laparra, Ra\'ul Santos-Rodriguez, Jes\'us
Malo
- Abstract summary: In the 1950s, Barlow and Attneave hypothesised a link between biological vision and information maximisation.
We show how probability-related factors can be combined to predict human perception via sensitivity of state-of-the-art subjective image quality metrics.
- Score: 47.912998421927085
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In the 1950s, Barlow and Attneave hypothesised a link between biological
vision and information maximisation. Following Shannon, information was defined
using the probability of natural images. A number of physiological and
psychophysical phenomena have been derived ever since from principles like
info-max, efficient coding, or optimal denoising. However, it remains unclear
how this link is expressed in mathematical terms from image probability. First,
classical derivations were subjected to strong assumptions on the probability
models and on the behaviour of the sensors. Moreover, the direct evaluation of
the hypothesis was limited by the inability of the classical image models to
deliver accurate estimates of the probability. In this work we directly
evaluate image probabilities using an advanced generative model for natural
images, and we analyse how probability-related factors can be combined to
predict human perception via sensitivity of state-of-the-art subjective image
quality metrics. We use information theory and regression analysis to find a
combination of just two probability-related factors that achieves 0.8
correlation with subjective metrics. This probability-based sensitivity is
psychophysically validated by reproducing the basic trends of the Contrast
Sensitivity Function, its suprathreshold variation, and trends of the Weber-law
and masking.
Related papers
- Estimating Causal Effects from Learned Causal Networks [56.14597641617531]
We propose an alternative paradigm for answering causal-effect queries over discrete observable variables.
We learn the causal Bayesian network and its confounding latent variables directly from the observational data.
We show that this emphmodel completion learning approach can be more effective than estimand approaches.
arXiv Detail & Related papers (2024-08-26T08:39:09Z) - Trust Your Gut: Comparing Human and Machine Inference from Noisy Visualizations [7.305342793164905]
We investigate scenarios where human intuition might surpass idealized statistical rationality.
Our findings suggest that analyst gut reactions to visualizations may provide an advantage, even when departing from rationality.
arXiv Detail & Related papers (2024-07-23T22:39:57Z) - Counterfactual Reasoning with Probabilistic Graphical Models for
Analyzing Socioecological Systems [0.5892638927736115]
Causal and counterfactual reasoning are emerging directions in data science.
This paper proposes applying a novel and recent technique for bounding unidentifiable queries.
arXiv Detail & Related papers (2024-01-18T16:10:07Z) - Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach [61.04606493712002]
Susceptibility to misinformation describes the degree of belief in unverifiable claims that is not observable.
Existing susceptibility studies heavily rely on self-reported beliefs.
We propose a computational approach to model users' latent susceptibility levels.
arXiv Detail & Related papers (2023-11-16T07:22:56Z) - Bias in Pruned Vision Models: In-Depth Analysis and Countermeasures [93.17009514112702]
Pruning, setting a significant subset of the parameters of a neural network to zero, is one of the most popular methods of model compression.
Despite existing evidence for this phenomenon, the relationship between neural network pruning and induced bias is not well-understood.
arXiv Detail & Related papers (2023-04-25T07:42:06Z) - From Risk Prediction to Risk Factors Interpretation. Comparison of
Neural Networks and Classical Statistics for Dementia Prediction [0.0]
It is proposed to investigate the onset of a disease D, based on several risk factors.
Two classes of techniques are available: classical statistics and artificial intelligence.
arXiv Detail & Related papers (2023-01-17T16:26:17Z) - Bayesian Networks for the robust and unbiased prediction of depression
and its symptoms utilizing speech and multimodal data [65.28160163774274]
We apply a Bayesian framework to capture the relationships between depression, depression symptoms, and features derived from speech, facial expression and cognitive game data collected at thymia.
arXiv Detail & Related papers (2022-11-09T14:48:13Z) - Identifying Weight-Variant Latent Causal Models [82.14087963690561]
We find that transitivity acts as a key role in impeding the identifiability of latent causal representations.
Under some mild assumptions, we can show that the latent causal representations can be identified up to trivial permutation and scaling.
We propose a novel method, termed Structural caUsAl Variational autoEncoder, which directly learns latent causal representations and causal relationships among them.
arXiv Detail & Related papers (2022-08-30T11:12:59Z) - Deep Probability Estimation [14.659180336823354]
We investigate probability estimation from high-dimensional data using deep neural networks.
The goal of this work is to investigate probability estimation from high-dimensional data using deep neural networks.
We evaluate existing methods on the synthetic data as well as on three real-world probability estimation tasks.
arXiv Detail & Related papers (2021-11-21T03:55:50Z) - Robust Modeling of Epistemic Mental States [2.867517731896504]
Epistemic states are: Agreement, Concentration, Thoughtful, Certain, and Interest.
Non-linear relations are found to be more prevalent, while temporal features derived from original facial features have demonstrated a strong correlation with intensity changes.
We propose a novel prediction framework that takes facial features and their nonlinear relation scores as input and predict different epistemic states in videos.
arXiv Detail & Related papers (2020-05-28T13:34:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.