Uncertainty-Driven Action Quality Assessment
- URL: http://arxiv.org/abs/2207.14513v2
- Date: Tue, 19 Dec 2023 01:31:29 GMT
- Title: Uncertainty-Driven Action Quality Assessment
- Authors: Caixia Zhou and Yaping Huang and Haibin Ling
- Abstract summary: We propose a novel probabilistic model, named Uncertainty-Driven AQA (UD-AQA), to capture the diversity among multiple judge scores.
We generate the estimation of uncertainty for each prediction, which is employed to re-weight AQA regression loss.
Our proposed method achieves competitive results on three benchmarks including the Olympic events MTL-AQA and FineDiving, and the surgical skill JIGSAWS datasets.
- Score: 67.20617610820857
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic action quality assessment (AQA) has attracted increasing attention
due to its wide applications. However, most existing AQA methods employ
deterministic models to predict the final score for each action, while
overlooking the subjectivity and diversity among expert judges during the
scoring process. In this paper, we propose a novel probabilistic model, named
Uncertainty-Driven AQA (UD-AQA), to utilize and capture the diversity among
multiple judge scores. Specifically, we design a Conditional Variational
Auto-Encoder (CVAE)-based module to encode the uncertainty in expert
assessment, where multiple judge scores can be produced by sampling latent
features from the learned latent space multiple times. To further utilize the
uncertainty, we generate the estimation of uncertainty for each prediction,
which is employed to re-weight AQA regression loss, effectively reducing the
influence of uncertain samples during training. Moreover, we further design an
uncertainty-guided training strategy to dynamically adjust the learning order
of the samples from low uncertainty to high uncertainty. The experiments show
that our proposed method achieves competitive results on three benchmarks
including the Olympic events MTL-AQA and FineDiving, and the surgical skill
JIGSAWS datasets.
Related papers
- Uncertainty-aware Language Modeling for Selective Question Answering [107.47864420630923]
We present an automatic large language model (LLM) conversion approach that produces uncertainty-aware LLMs.
Our approach is model- and data-agnostic, is computationally-efficient, and does not rely on external models or systems.
arXiv Detail & Related papers (2023-11-26T22:47:54Z) - Adaptive Uncertainty Estimation via High-Dimensional Testing on Latent
Representations [28.875819909902244]
Uncertainty estimation aims to evaluate the confidence of a trained deep neural network.
Existing uncertainty estimation approaches rely on low-dimensional distributional assumptions.
We propose a new framework using data-adaptive high-dimensional hypothesis testing for uncertainty estimation.
arXiv Detail & Related papers (2023-10-25T12:22:18Z) - Toward Reliable Human Pose Forecasting with Uncertainty [51.628234388046195]
We develop an open-source library for human pose forecasting, including multiple models, supporting several datasets.
We devise two types of uncertainty in the problem to increase performance and convey better trust.
arXiv Detail & Related papers (2023-04-13T17:56:08Z) - Delving into Identify-Emphasize Paradigm for Combating Unknown Bias [52.76758938921129]
We propose an effective bias-conflicting scoring method (ECS) to boost the identification accuracy.
We also propose gradient alignment (GA) to balance the contributions of the mined bias-aligned and bias-conflicting samples.
Experiments are conducted on multiple datasets in various settings, demonstrating that the proposed solution can mitigate the impact of unknown biases.
arXiv Detail & Related papers (2023-02-22T14:50:24Z) - Estimation Error Correction in Deep Reinforcement Learning for
Deterministic Actor-Critic Methods [0.0]
In value-based deep reinforcement learning methods, approximation of value functions induces overestimation bias and leads to suboptimal policies.
We show that in deep actor-critic methods that aim to overcome the overestimation bias, if the reinforcement signals received by the agent have a high variance, a significant underestimation bias arises.
To minimize the underestimation, we introduce a parameter-free, novel deep Q-learning variant.
arXiv Detail & Related papers (2021-09-22T13:49:35Z) - Cross Learning in Deep Q-Networks [82.20059754270302]
We propose a novel cross Q-learning algorithm, aim at alleviating the well-known overestimation problem in value-based reinforcement learning methods.
Our algorithm builds on double Q-learning, by maintaining a set of parallel models and estimate the Q-value based on a randomly selected network.
arXiv Detail & Related papers (2020-09-29T04:58:17Z) - Stochastic-YOLO: Efficient Probabilistic Object Detection under Dataset
Shifts [8.656808451823172]
In this paper, we adapt the well-established YOLOv3 architecture to generate uncertainty estimations.
We provide some sensitivity analyses, while arguing that MC-YOLO is a sound approach.
arXiv Detail & Related papers (2020-09-07T09:28:17Z) - Generating Adversarial Examples with an Optimized Quality [12.747258403133035]
Deep learning models are vulnerable to Adversarial Examples (AEs),carefully crafted samples to deceive those models.
Recent studies have introduced new adversarial attack methods, but none provided guaranteed quality for the crafted examples.
In this paper, we incorporateImage Quality Assessment (IQA) metrics into the design and generation process of AEs.
arXiv Detail & Related papers (2020-06-30T23:05:12Z) - Uncertainty-aware Score Distribution Learning for Action Quality
Assessment [91.05846506274881]
We propose an uncertainty-aware score distribution learning (USDL) approach for action quality assessment (AQA)
Specifically, we regard an action as an instance associated with a score distribution, which describes the probability of different evaluated scores.
Under the circumstance where fine-grained score labels are available, we devise a multi-path uncertainty-aware score distributions learning (MUSDL) method to explore the disentangled components of a score.
arXiv Detail & Related papers (2020-06-13T15:41:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.