Human Pose Estimation in Extremely Low-Light Conditions

• URL: http://arxiv.org/abs/2303.15410v1
• Date: Mon, 27 Mar 2023 17:28:25 GMT
• Title: Human Pose Estimation in Extremely Low-Light Conditions
• Authors: Sohyun Lee, Jaesung Rim, Boseung Jeong, Geonu Kim, Byungju Woo, Haechan Lee, Sunghyun Cho, Suha Kwak
• Abstract summary: We develop a dedicated camera system and build a new dataset of real low-light images with accurate pose labels. Thanks to our camera system, each low-light image in our dataset is coupled with an aligned well-lit image, which enables accurate pose labeling. We also propose a new model and a new training strategy that fully exploit the privileged information to learn representation insensitive to lighting conditions.
• Score: 21.210706205233286
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We study human pose estimation in extremely low-light images. This task is challenging due to the difficulty of collecting real low-light images with accurate labels, and severely corrupted inputs that degrade prediction quality significantly. To address the first issue, we develop a dedicated camera system and build a new dataset of real low-light images with accurate pose labels. Thanks to our camera system, each low-light image in our dataset is coupled with an aligned well-lit image, which enables accurate pose labeling and is used as privileged information during training. We also propose a new model and a new training strategy that fully exploit the privileged information to learn representation insensitive to lighting conditions. Our method demonstrates outstanding performance on real extremely low light images, and extensive analyses validate that both of our model and dataset contribute to the success.

Related papers

• Semi-LLIE: Semi-supervised Contrastive Learning with Mamba-based Low-light Image Enhancement [59.17372460692809]
  This work proposes a mean-teacher-based semi-supervised low-light enhancement (Semi-LLIE) framework that integrates the unpaired data into model training. We introduce a semantic-aware contrastive loss to faithfully transfer the illumination distribution, contributing to enhancing images with natural colors. We also propose novel perceptive loss based on the large-scale vision-language Recognize Anything Model (RAM) to help generate enhanced images with richer textual details.
  arXiv  Detail & Related papers  (2024-09-25T04:05:32Z)
• Domain-Adaptive 2D Human Pose Estimation via Dual Teachers in Extremely Low-Light Conditions [65.0109231252639]
  Recent studies on low-light pose estimation require the use of paired well-lit and low-light images with ground truths for training. Our primary novelty lies in leveraging two complementary-teacher networks to generate more reliable pseudo labels. Our method achieves 6.8% (2.4 AP) improvement over the state-of-the-art (SOTA) method.
  arXiv  Detail & Related papers  (2024-07-22T08:09:14Z)
• BVI-RLV: A Fully Registered Dataset and Benchmarks for Low-Light Video Enhancement [56.97766265018334]
  This paper introduces a low-light video dataset, consisting of 40 scenes with various motion scenarios under two distinct low-lighting conditions. We provide fully registered ground truth data captured in normal light using a programmable motorized dolly and refine it via an image-based approach for pixel-wise frame alignment across different light levels. Our experimental results demonstrate the significance of fully registered video pairs for low-light video enhancement (LLVE) and the comprehensive evaluation shows that the models trained with our dataset outperform those trained with the existing datasets.
  arXiv  Detail & Related papers  (2024-07-03T22:41:49Z)
• Boosting Object Detection with Zero-Shot Day-Night Domain Adaptation [33.142262765252795]
  Detectors trained on well-lit data exhibit significant performance degradation on low-light data due to low visibility. We propose to boost low-light object detection with zero-shot day-night domain adaptation. Our method generalizes a detector from well-lit scenarios to low-light ones without requiring real low-light data.
  arXiv  Detail & Related papers  (2023-12-02T20:11:48Z)
• Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation [76.96499178502759]
  Relighting aims to re-illuminate the person in the image as if the person appeared in an environment with the target lighting. Recent methods rely on deep learning to achieve high-quality results. We propose a new approach that can perform on par with the state-of-the-art (SOTA) relighting methods without requiring a light stage.
  arXiv  Detail & Related papers  (2022-09-21T17:15:58Z)
• Enhancing Low-Light Images in Real World via Cross-Image Disentanglement [58.754943762945864]
  We propose a new low-light image enhancement dataset consisting of misaligned training images with real-world corruptions. Our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets.
  arXiv  Detail & Related papers  (2022-01-10T03:12:52Z)
• NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset [25.29013780731876]
  Low light proves more difficult for machine cognition than previously thought. We present a large-scale dataset showing dynamic scenes captured on the streets at night. We propose to incorporate an image enhancement module into the object detection framework and two novel data augmentation techniques.
  arXiv  Detail & Related papers  (2021-10-20T03:44:04Z)
• Adaptive Enhancement of Extreme Low-Light Images [4.511923587827301]
  We create a dataset of 1500 raw images taken in both indoor and outdoor low-light conditions. We introduce a deep learning model capable of enhancing input images with a wide range of intensity levels at runtime. Our experimental results demonstrate that our proposed dataset combined with our model can consistently and effectively enhance images.
  arXiv  Detail & Related papers  (2020-12-07T23:31:59Z)
• Unsupervised Low-light Image Enhancement with Decoupled Networks [103.74355338972123]
  We learn a two-stage GAN-based framework to enhance the real-world low-light images in a fully unsupervised fashion. Our proposed method outperforms the state-of-the-art unsupervised image enhancement methods in terms of both illumination enhancement and noise reduction.
  arXiv  Detail & Related papers  (2020-05-06T13:37:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.