Weight and Height Estimation from a Single Human Image Captured in the Wild

• URL: http://arxiv.org/abs/2607.26104v1
• Date: Tue, 28 Jul 2026 08:39:11 GMT
• Title: Weight and Height Estimation from a Single Human Image Captured in the Wild
• Abstract summary: We propose a new dataset consisting of 6105 images with ground truth labels of height, weight and BMI.<n>It consists of frontal, back, full and half body, side poses, mirror selfies with varying backgrounds and scale variations.<n>Our experimental results demonstrate that full body images have produced better results than the other half body and facial images in the wild.
• Score: 18.961726513066733
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: A person's physical characteristics such as weight and height are important indicators of his physical and mental health, daily life routines and finances. Body Mass Index (BMI) is a well known measure that encodes the characteristics of both the weight and the height. BMI has been used as a self-monitoring tool, and it has long-term implications on one's life. For example, it may help predicting the risk of various diseases and estimating longevity. Automatic BMI estimation using a single person image in the wild is a challenging task due to wide variations in human pose, camera geometry, personal appearance and distracting backgrounds. In this paper, we explore the performance of deep neural networks using single and multi-task learning by employing different modalities including RGB, depth-maps, pose-affinity maps, and edge-maps to predict BMI, weight, and height from daily life images available on social networking websites. Currently, no full body image dataset for BMI estimation is publicly available, therefore we propose a new dataset consisting of 6105 images with ground truth labels of height, weight and BMI. Our proposed dataset is collected in the wild containing images from various ethnicity and distributed over varying age groups and gender. It consists of frontal, back, full and half body, side poses, mirror selfies with varying backgrounds and scale variations and may contain artifacts hiding partial or full face. Extensive experimentation is performed using full body, half body and face images only using different CNN backbones including VGG, Densenet and ResNet. Our experimental results demonstrate that full body images have produced better results than the other half body and facial images in the wild.

Related papers

• Evaluating Multiview Object Consistency in Humans and Image Models [68.36073530804296]
  We leverage an experimental design from the cognitive sciences which requires zero-shot visual inferences about object shape. We collect 35K trials of behavioral data from over 500 participants. We then evaluate the performance of common vision models.
  arXiv  Detail & Related papers  (2024-09-09T17:59:13Z)
• Celeb-FBI: A Benchmark Dataset on Human Full Body Images and Age, Gender, Height and Weight Estimation using Deep Learning Approach [0.0]
  'Celeb-FBI' dataset contains 7,211 full-body images of individuals accompanied by detailed information on their height, age, weight, and gender. We employ three deep learning approaches: CNN, 50-layer ResNet, and 16-layer VGG, which are used for estimating height, weight, age, and gender from human full-body images. From the results obtained, ResNet-50 performed best for the system with an accuracy rate of 79.18% for age, 95.43% for gender, 85.60% for height and 81.91% for weight.
  arXiv  Detail & Related papers  (2024-07-03T20:16:47Z)
• Stellar: Systematic Evaluation of Human-Centric Personalized Text-to-Image Methods [52.806258774051216]
  We focus on text-to-image systems that input a single image of an individual and ground the generation process along with text describing the desired visual context. We introduce a standardized dataset (Stellar) that contains personalized prompts coupled with images of individuals that is an order of magnitude larger than existing relevant datasets and where rich semantic ground-truth annotations are readily available. We derive a simple yet efficient, personalized text-to-image baseline that does not require test-time fine-tuning for each subject and which sets quantitatively and in human trials a new SoTA.
  arXiv  Detail & Related papers  (2023-12-11T04:47:39Z)
• CongNaMul: A Dataset for Advanced Image Processing of Soybean Sprouts [0.26786930391553554]
  CongNaMul dataset is curated to facilitate tasks such as image classification, semantic segmentation, decomposition, and measurement of length and weight. The classification task provides four classes to determine the quality of soybean sprouts: normal, broken, spotted, and broken and spotted. The dataset is expected to be a valuable resource for a wide range of research and applications in the advanced analysis of images of soybean sprouts.
  arXiv  Detail & Related papers  (2023-08-30T01:14:32Z)
• MassNet: A Deep Learning Approach for Body Weight Extraction from A Single Pressure Image [0.41043522719179826]
  Pressure mapping mattress is a non-invasive and privacy-preserving tool to obtain the pressure distribution image over the bed surface. We propose a deep learning-based model, including a dual-branch network to extract the deep features and pose features respectively. The results show that our model outperforms the state-of-the-art algorithms over both 2 datasets.
  arXiv  Detail & Related papers  (2023-03-17T17:24:57Z)
• Accurate 3D Body Shape Regression using Metric and Semantic Attributes [55.58629009876271]
  We show that 3D body shape regression from images can be trained from easy-to-obtain anthropometric measurements and linguistic shape attributes. This is the first demonstration that 3D body shape regression from images can be trained from easy-to-obtain anthropometric measurements and linguistic shape attributes.
  arXiv  Detail & Related papers  (2022-06-14T17:54:49Z)
• Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis [52.720314035084215]
  This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers. We present a simple yet powerful framework, named Generalizable Neural Performer (GNR), that learns a generalizable and robust neural body representation. Experiments on GeneBody-1.0 and ZJU-Mocap show better robustness of our methods than recent state-of-the-art generalizable methods.
  arXiv  Detail & Related papers  (2022-04-25T17:14:22Z)
• Learning Realistic Human Reposing using Cyclic Self-Supervision with 3D Shape, Pose, and Appearance Consistency [55.94908688207493]
  We propose a self-supervised framework named SPICE that closes the image quality gap with supervised methods. The key insight enabling self-supervision is to exploit 3D information about the human body in several ways. SPICE achieves state-of-the-art performance on the DeepFashion dataset.
  arXiv  Detail & Related papers  (2021-10-11T17:48:50Z)
• Estimation of BMI from Facial Images using Semantic Segmentation based Region-Aware Pooling [3.889462292853575]
  Body-Mass-Index (BMI) conveys important information about one's life such as health and socio-economic conditions. Recent works have employed hand-crafted geometrical face features or face-level deep convolutional neural network features for face to BMI prediction. We propose to use deep features that are pooled from different face regions.
  arXiv  Detail & Related papers  (2021-04-10T10:53:21Z)
• AI-based BMI Inference from Facial Images: An Application to Weight Monitoring [3.4601380631551146]
  We evaluate and compare the performance of five different CNN architectures for BMI inference from facial images. Experimental results suggest the efficacy of the deep learning methods in BMI inference from face images with minimum Mean Absolute Error (MAE) of $1.04$ obtained using ResNet50.
  arXiv  Detail & Related papers  (2020-10-15T00:00:40Z)
• Whole-Body Human Pose Estimation in the Wild [88.09875133989155]
  COCO-WholeBody extends COCO dataset with whole-body annotations. It is the first benchmark that has manual annotations on the entire human body. A single-network model, named ZoomNet, is devised to take into account the hierarchical structure of the full human body.
  arXiv  Detail & Related papers  (2020-07-23T08:35:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.