Body Composition Estimation Based on Multimodal Multi-task Deep Neural
Network
- URL: http://arxiv.org/abs/2205.11031v1
- Date: Mon, 23 May 2022 04:31:06 GMT
- Title: Body Composition Estimation Based on Multimodal Multi-task Deep Neural
Network
- Authors: Subas Chhatkuli, Iris Jiang, and Kyohei Kamiyama
- Abstract summary: Body composition is largely made up of muscle, fat, bones, and water.
We introduce a multimodal multi-task deep neural network to estimate body fat percentage and skeletal muscle mass.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In addition to body weight and Body Mass Index (BMI), body composition is an
essential data point that allows people to understand their overall health and
body fitness. However, body composition is largely made up of muscle, fat,
bones, and water, which makes estimation not as easy and straightforward as
measuring body weight. In this paper, we introduce a multimodal multi-task deep
neural network to estimate body fat percentage and skeletal muscle mass by
analyzing facial images in addition to a person's height, gender, age, and
weight information. Using a dataset representative of demographics in Japan, we
confirmed that the proposed approach performed better compared to the existing
methods. Moreover, the multi-task approach implemented in this study is also
able to grasp the negative correlation between body fat percentage and skeletal
muscle mass gain/loss.
Related papers
- Advancing Smart Malnutrition Monitoring: A Multi-Modal Learning Approach
for Vital Health Parameter Estimation [0.0]
This study presents a groundbreaking, scalable, and robust smart malnutrition-monitoring system.
It uses a single full-body image of an individual to estimate height, weight, and other crucial health parameters.
Our model achieves a low Mean Absolute Error (MAE) of $pm$ 4.7 cm and $pm$ 5.3 kg in estimating height and weight.
arXiv Detail & Related papers (2023-07-31T15:08:02Z) - Body Fat Estimation from Surface Meshes using Graph Neural Networks [48.85291874087541]
We show that triangulated body surface meshes can be used to accurately predict VAT and ASAT volumes using graph neural networks.
Our methods achieve high performance while reducing training time and required resources compared to state-of-the-art convolutional neural networks in this area.
arXiv Detail & Related papers (2023-07-13T10:21:34Z) - MassNet: A Deep Learning Approach for Body Weight Extraction from A
Single Pressure Image [0.41043522719179826]
Pressure mapping mattress is a non-invasive and privacy-preserving tool to obtain the pressure distribution image over the bed surface.
We propose a deep learning-based model, including a dual-branch network to extract the deep features and pose features respectively.
The results show that our model outperforms the state-of-the-art algorithms over both 2 datasets.
arXiv Detail & Related papers (2023-03-17T17:24:57Z) - Human Body Measurement Estimation with Adversarial Augmentation [28.934387668050224]
We present a Body Measurement network (BMnet) for estimating 3D anthropomorphic measurements of the human body shape from silhouette images.
We augmented BMnet with a novel adversarial body simulator (ABS) that finds and synthesizes challenging body shapes.
Results show that training BMnet with ABS improves measurement prediction accuracy on real bodies by up to 10%, when compared to no augmentation or random body shape sampling.
arXiv Detail & Related papers (2022-10-11T17:58:10Z) - KTN: Knowledge Transfer Network for Learning Multi-person 2D-3D
Correspondences [77.56222946832237]
We present a novel framework to detect the densepose of multiple people in an image.
The proposed method, which we refer to Knowledge Transfer Network (KTN), tackles two main problems.
It simultaneously maintains feature resolution and suppresses background pixels, and this strategy results in substantial increase in accuracy.
arXiv Detail & Related papers (2022-06-21T03:11:37Z) - Whole-Body Human Pose Estimation in the Wild [88.09875133989155]
COCO-WholeBody extends COCO dataset with whole-body annotations.
It is the first benchmark that has manual annotations on the entire human body.
A single-network model, named ZoomNet, is devised to take into account the hierarchical structure of the full human body.
arXiv Detail & Related papers (2020-07-23T08:35:26Z) - Universal Loss Reweighting to Balance Lesion Size Inequality in 3D
Medical Image Segmentation [50.63623720394348]
We propose a loss reweighting approach to increase the ability of the network to detect small lesions.
We report the benefit from our method for well-known loss functions, including Dice Loss, Focal Loss, and Asymmetric Similarity Loss.
Our experiments show that inverse weighting considerably increases the detection quality, while preserves the delineation quality on a state-of-the-art level.
arXiv Detail & Related papers (2020-07-20T12:08:22Z) - Large-scale inference of liver fat with neural networks on UK Biobank
body MRI [1.3439502310822151]
A novel framework for automated inference of liver fat from neck-to-knee body MRI is proposed.
A ResNet50 was trained for regression on two-dimensional slices from these scans and the reference values as target.
The network learned to rectify non-linearities in the fat fraction values and identified several outliers in the reference.
arXiv Detail & Related papers (2020-06-30T13:33:30Z) - HEMlets PoSh: Learning Part-Centric Heatmap Triplets for 3D Human Pose
and Shape Estimation [60.35776484235304]
This work attempts to address the uncertainty of lifting the detected 2D joints to the 3D space by introducing an intermediate state-Part-Centric Heatmap Triplets (HEMlets)
The HEMlets utilize three joint-heatmaps to represent the relative depth information of the end-joints for each skeletal body part.
A Convolutional Network (ConvNet) is first trained to predict HEMlets from the input image, followed by a volumetric joint-heatmap regression.
arXiv Detail & Related papers (2020-03-10T04:03:45Z) - Learning Compositional Neural Information Fusion for Human Parsing [181.48380078517525]
We formulate the approach as a neural information fusion framework.
Our model assembles the information from three inference processes over the hierarchy.
The whole model is end-to-end differentiable, explicitly modeling information flows and structures.
arXiv Detail & Related papers (2020-01-19T10:35:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.