Low-resolution Human Pose Estimation
- URL: http://arxiv.org/abs/2109.09090v1
- Date: Sun, 19 Sep 2021 09:13:57 GMT
- Title: Low-resolution Human Pose Estimation
- Authors: Chen Wang, Feng Zhang, Xiatian Zhu, Shuzhi Sam Ge
- Abstract summary: We propose a novel Confidence-Aware Learning (CAL) method for low-resolution pose estimation.
CAL addresses two fundamental limitations of existing offset learning methods: inconsistent training and testing, decoupled heatmap and offset learning.
Our method outperforms significantly the state-of-the-art methods for low-resolution human pose estimation.
- Score: 49.531572116079026
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Human pose estimation has achieved significant progress on images with high
imaging resolution. However, low-resolution imagery data bring nontrivial
challenges which are still under-studied. To fill this gap, we start with
investigating existing methods and reveal that the most dominant heatmap-based
methods would suffer more severe model performance degradation from
low-resolution, and offset learning is an effective strategy. Established on
this observation, in this work we propose a novel Confidence-Aware Learning
(CAL) method which further addresses two fundamental limitations of existing
offset learning methods: inconsistent training and testing, decoupled heatmap
and offset learning. Specifically, CAL selectively weighs the learning of
heatmap and offset with respect to ground-truth and most confident prediction,
whilst capturing the statistical importance of model output in mini-batch
learning manner. Extensive experiments conducted on the COCO benchmark show
that our method outperforms significantly the state-of-the-art methods for
low-resolution human pose estimation.
Related papers
- Iterative Ensemble Training with Anti-Gradient Control for Mitigating Memorization in Diffusion Models [20.550324116099357]
Diffusion models are known for their tremendous ability to generate novel and high-quality samples.
Recent approaches for memory mitigation either only focused on the text modality problem in cross-modal generation tasks or utilized data augmentation strategies.
We propose a novel training framework for diffusion models from the perspective of visual modality, which is more generic and fundamental for mitigating memorization.
arXiv Detail & Related papers (2024-07-22T02:19:30Z) - BOOT: Data-free Distillation of Denoising Diffusion Models with
Bootstrapping [64.54271680071373]
Diffusion models have demonstrated excellent potential for generating diverse images.
Knowledge distillation has been recently proposed as a remedy that can reduce the number of inference steps to one or a few.
We present a novel technique called BOOT, that overcomes limitations with an efficient data-free distillation algorithm.
arXiv Detail & Related papers (2023-06-08T20:30:55Z) - Learning from Multi-Perception Features for Real-Word Image
Super-resolution [87.71135803794519]
We propose a novel SR method called MPF-Net that leverages multiple perceptual features of input images.
Our method incorporates a Multi-Perception Feature Extraction (MPFE) module to extract diverse perceptual information.
We also introduce a contrastive regularization term (CR) that improves the model's learning capability.
arXiv Detail & Related papers (2023-05-26T07:35:49Z) - UMat: Uncertainty-Aware Single Image High Resolution Material Capture [2.416160525187799]
We propose a learning-based method to recover normals, specularity, and roughness from a single diffuse image of a material.
Our method is the first one to deal with the problem of modeling uncertainty in material digitization.
arXiv Detail & Related papers (2023-05-25T17:59:04Z) - Improving Robustness for Pose Estimation via Stable Heatmap Regression [19.108116394510258]
A heatmap regression method is proposed to alleviate network vulnerability to small perturbations.
A maximum stability training loss is used to simplify the optimization difficulty.
The proposed method achieves a significant advance in robustness over state-of-the-art approaches on two benchmark datasets.
arXiv Detail & Related papers (2021-05-08T03:07:05Z) - Few-shot Action Recognition with Prototype-centered Attentive Learning [88.10852114988829]
Prototype-centered Attentive Learning (PAL) model composed of two novel components.
First, a prototype-centered contrastive learning loss is introduced to complement the conventional query-centered learning objective.
Second, PAL integrates a attentive hybrid learning mechanism that can minimize the negative impacts of outliers.
arXiv Detail & Related papers (2021-01-20T11:48:12Z) - Deep Unfolding Network for Image Super-Resolution [159.50726840791697]
This paper proposes an end-to-end trainable unfolding network which leverages both learning-based methods and model-based methods.
The proposed network inherits the flexibility of model-based methods to super-resolve blurry, noisy images for different scale factors via a single model.
arXiv Detail & Related papers (2020-03-23T17:55:42Z) - Towards High Performance Human Keypoint Detection [87.1034745775229]
We find that context information plays an important role in reasoning human body configuration and invisible keypoints.
Inspired by this, we propose a cascaded context mixer ( CCM) which efficiently integrates spatial and channel context information.
To maximize CCM's representation capability, we develop a hard-negative person detection mining strategy and a joint-training strategy.
We present several sub-pixel refinement techniques for postprocessing keypoint predictions to improve detection accuracy.
arXiv Detail & Related papers (2020-02-03T02:24:51Z) - Deep Weakly-Supervised Learning Methods for Classification and
Localization in Histology Images: A Survey [25.429124017422385]
Using deep learning models to diagnose cancer presents several challenges.
Deep weakly-supervised object localization (WSOL) methods provide strategies for low-cost training of deep learning models.
This paper provides a review of state-of-art DL methods for WSOL.
arXiv Detail & Related papers (2019-09-08T00:01:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.