Automatic Analysis of Human Body Representations in Western Art

• URL: http://arxiv.org/abs/2210.08860v1
• Date: Mon, 17 Oct 2022 08:56:22 GMT
• Title: Automatic Analysis of Human Body Representations in Western Art
• Authors: Shu Zhao (1), Alm{\i}la Akda\u{g} Salah (1), Albert Ali Salah (1 and 2) ((1) Utrecht University, (2) Bo\u{g}azi\c{c}i University)
• Abstract summary: We propose a computer vision pipeline to analyse human pose and representations in paintings. For normalisation, we map the detected poses and contours to Leonardo da Vinci's Vitruvian Man. Our approach improves over purely skeleton based analyses of human body in paintings.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The way the human body is depicted in classical and modern paintings is relevant for art historical analyses. Each artist has certain themes and concerns, resulting in different poses being used more heavily than others. In this paper, we propose a computer vision pipeline to analyse human pose and representations in paintings, which can be used for specific artists or periods. Specifically, we combine two pose estimation approaches (OpenPose and DensePose, respectively) and introduce methods to deal with occlusion and perspective issues. For normalisation, we map the detected poses and contours to Leonardo da Vinci's Vitruvian Man, the classical depiction of body proportions. We propose a visualisation approach for illustrating the articulation of joints in a set of paintings. Combined with a hierarchical clustering of poses, our approach reveals common and uncommon poses used by artists. Our approach improves over purely skeleton based analyses of human body in paintings.

Related papers

• AI Art Neural Constellation: Revealing the Collective and Contrastive State of AI-Generated and Human Art [36.21731898719347]
  We conduct a comprehensive analysis to position AI-generated art within the context of human art heritage. Our comparative analysis is based on an extensive dataset, dubbed ArtConstellation'' Key finding is that AI-generated artworks are visually related to the principle concepts for modern period art made in 1800-2000.
  arXiv  Detail & Related papers  (2024-02-04T11:49:51Z)
• Understanding Pose and Appearance Disentanglement in 3D Human Pose Estimation [72.50214227616728]
  Several methods have proposed to learn image representations in a self-supervised fashion so as to disentangle the appearance information from the pose one. We study disentanglement from the perspective of the self-supervised network, via diverse image synthesis experiments. We design an adversarial strategy focusing on generating natural appearance changes of the subject, and against which we could expect a disentangled network to be robust.
  arXiv  Detail & Related papers  (2023-09-20T22:22:21Z)
• VINECS: Video-based Neural Character Skinning [82.39776643541383]
  We propose a fully automated approach for creating a fully rigged character with pose-dependent skinning weights. We show that our approach outperforms state-of-the-art while not relying on dense 4D scans.
  arXiv  Detail & Related papers  (2023-07-03T08:35:53Z)
• Poses of People in Art: A Data Set for Human Pose Estimation in Digital Art History [0.6345523830122167]
  We introduce the first openly licensed data set for estimating human poses in art. The Poses of People in Art data set consists of 2,454 images from 22 art-historical depiction styles. A total of 10,749 human figures are precisely enclosed by rectangular bounding boxes, with a maximum of four per image labeled by up to 17 keypoints.
  arXiv  Detail & Related papers  (2023-01-12T16:23:58Z)
• A domain adaptive deep learning solution for scanpath prediction of paintings [66.46953851227454]
  This paper focuses on the eye-movement analysis of viewers during the visual experience of a certain number of paintings. We introduce a new approach to predicting human visual attention, which impacts several cognitive functions for humans. The proposed new architecture ingests images and returns scanpaths, a sequence of points featuring a high likelihood of catching viewers' attention.
  arXiv  Detail & Related papers  (2022-09-22T22:27:08Z)
• Semi-supervised Human Pose Estimation in Art-historical Images [9.633949256082763]
  We propose a novel approach to estimate human poses in art-language images. Our approach achieves significantly better results than methods that use pre-trained models or style transfer.
  arXiv  Detail & Related papers  (2022-07-06T21:20:58Z)
• DeepPortraitDrawing: Generating Human Body Images from Freehand Sketches [75.4318318890065]
  We present DeepDrawing, a framework for converting roughly drawn sketches to realistic human body images. To encode complicated body shapes under various poses, we take a local-to-global approach. Our method produces more realistic images than the state-of-the-art sketch-to-image synthesis techniques.
  arXiv  Detail & Related papers  (2022-05-04T14:02:45Z)
• Hallucinating Pose-Compatible Scenes [55.064949607528405]
  We present a large-scale generative adversarial network for pose-conditioned scene generation. We curating a massive meta-dataset containing over 19 million frames of humans in everyday environments. We leverage our trained model for various applications: hallucinating pose-compatible scene(s) with or without humans, visualizing incompatible scenes and poses, placing a person from one generated image into another scene, and animating pose.
  arXiv  Detail & Related papers  (2021-12-13T18:59:26Z)
• A Review on Human Pose Estimation [12.82092487526086]
  The phenomenon of Human Pose Estimation (HPE) is a problem that has been explored over the years, particularly in computer vision. This paper will cover them, starting with the classical approaches to HPE to the Deep Learning based models.
  arXiv  Detail & Related papers  (2021-10-13T17:12:38Z)
• HumanGAN: A Generative Model of Humans Images [78.6284090004218]
  We present a generative model for images of dressed humans offering control over pose, local body part appearance and garment style. Our model encodes part-based latent appearance vectors in a normalized pose-independent space and warps them to different poses, it preserves body and clothing appearance under varying posture.
  arXiv  Detail & Related papers  (2021-03-11T19:00:38Z)
• Holistic 3D Human and Scene Mesh Estimation from Single View Images [5.100152971410397]
  We propose an end-to-end trainable model that perceives the 3D scene from a single RGB image. We show that our model outperforms existing human body mesh methods and indoor scene reconstruction methods.
  arXiv  Detail & Related papers  (2020-12-02T23:22:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.