Human Body Shape Classification Based on a Single Image

• URL: http://arxiv.org/abs/2305.18480v1
• Date: Mon, 29 May 2023 11:47:43 GMT
• Title: Human Body Shape Classification Based on a Single Image
• Authors: Cameron Trotter, Filipa Peleja, Dario Dotti and Alberto de Santos
• Abstract summary: We present a methodology to classify human body shape from a single image. The proposed methodology does not require 3D body recreation as a result of classification. The resultant body shape classification can be utilised in a variety of downstream tasks.
• Score: 1.3764085113103217
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: There is high demand for online fashion recommender systems that incorporate the needs of the consumer's body shape. As such, we present a methodology to classify human body shape from a single image. This is achieved through the use of instance segmentation and keypoint estimation models, trained only on open-source benchmarking datasets. The system is capable of performing in noisy environments owing to to robust background subtraction. The proposed methodology does not require 3D body recreation as a result of classification based on estimated keypoints, nor requires historical information about a user to operate - calculating all required measurements at the point of use. We evaluate our methodology both qualitatively against existing body shape classifiers and quantitatively against a novel dataset of images, which we provide for use to the community. The resultant body shape classification can be utilised in a variety of downstream tasks, such as input to size and fit recommendation or virtual try-on systems.

Related papers

• Explainable Metric Learning for Deflating Data Bias [2.977255700811213]
  We present an explainable metric learning framework, which constructs hierarchical levels of semantic segments of an image for better interpretability. Our approach enables a more human-understandable similarity measurement between two images based on the semantic segments within it.
  arXiv  Detail & Related papers  (2024-07-05T21:07:27Z)
• 3D Shape Completion on Unseen Categories:A Weakly-supervised Approach [61.76304400106871]
  We introduce a novel weakly-supervised framework to reconstruct the complete shapes from unseen categories. We first propose an end-to-end prior-assisted shape learning network that leverages data from the seen categories to infer a coarse shape. In addition, we propose a self-supervised shape refinement model to further refine the coarse shape.
  arXiv  Detail & Related papers  (2024-01-19T09:41:09Z)
• GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence [5.500735640045456]
  Category-level pose estimation is a challenging task with many potential applications in computer vision and robotics. We propose to utilize both geometric and semantic features obtained from a pre-trained foundation model. This requires significantly less data to train than prior methods since the semantic features are robust to object texture and appearance.
  arXiv  Detail & Related papers  (2023-11-23T02:35:38Z)
• ALiSNet: Accurate and Lightweight Human Segmentation Network for Fashion E-Commerce [57.876602177247534]
  Smartphones provide a convenient way for users to capture images of their body. We create a new segmentation model by simplifying Semantic FPN with PointRend. We finetune this model on a high-quality dataset of humans in a restricted set of poses relevant for our application.
  arXiv  Detail & Related papers  (2023-04-15T11:06:32Z)
• Semantic keypoint-based pose estimation from single RGB frames [64.80395521735463]
  We present an approach to estimating the continuous 6-DoF pose of an object from a single RGB image. The approach combines semantic keypoints predicted by a convolutional network (convnet) with a deformable shape model. We show that our approach can accurately recover the 6-DoF object pose for both instance- and class-based scenarios.
  arXiv  Detail & Related papers  (2022-04-12T15:03:51Z)
• Towards Self-Supervised Category-Level Object Pose and Size Estimation [121.28537953301951]
  This work presents a self-supervised framework for category-level object pose and size estimation from a single depth image. We leverage the geometric consistency residing in point clouds of the same shape for self-supervision.
  arXiv  Detail & Related papers  (2022-03-06T06:02:30Z)
• Object Pose Estimation using Mid-level Visual Representations [5.220940151628735]
  This work proposes a novel pose estimation model for object categories that can be effectively transferred to previously unseen environments. Deep convolutional network models (CNN) for pose estimation are typically trained and evaluated on datasets curated for object detection, pose estimation, or 3D reconstruction. We show that the approach is favorable when it comes to generalization and transfer to novel environments.
  arXiv  Detail & Related papers  (2022-03-02T22:49:17Z)
• DONet: Learning Category-Level 6D Object Pose and Size Estimation from Depth Observation [53.55300278592281]
  We propose a method of Category-level 6D Object Pose and Size Estimation (COPSE) from a single depth image. Our framework makes inferences based on the rich geometric information of the object in the depth channel alone. Our framework competes with state-of-the-art approaches that require labeled real-world images.
  arXiv  Detail & Related papers  (2021-06-27T10:41:50Z)
• Learning to Segment Human Body Parts with Synthetically Trained Deep Convolutional Networks [58.0240970093372]
  This paper presents a new framework for human body part segmentation based on Deep Convolutional Neural Networks trained using only synthetic data. The proposed approach achieves cutting-edge results without the need of training the models with real annotated data of human body parts.
  arXiv  Detail & Related papers  (2021-02-02T12:26:50Z)
• Validation and generalization of pixel-wise relevance in convolutional neural networks trained for face classification [0.0]
  We show how relevance measures vary with and generalize across key model parameters. Using relevance-based image masking, we find that relevance maps for face classification prove generally stable. Fine-grained analyses of relevance maps across models revealed asymmetries in generalization that point to specific benefits of choice parameters.
  arXiv  Detail & Related papers  (2020-06-16T23:20:40Z)
• RePose: Learning Deep Kinematic Priors for Fast Human Pose Estimation [17.0630180888369]
  We propose a novel efficient and lightweight model for human pose estimation from a single image. Our model is designed to achieve competitive results at a fraction of the number of parameters and computational cost of various state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-02-10T16:44:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.