Pose Trainer: Correcting Exercise Posture using Pose Estimation

• URL: http://arxiv.org/abs/2006.11718v1
• Date: Sun, 21 Jun 2020 05:51:37 GMT
• Title: Pose Trainer: Correcting Exercise Posture using Pose Estimation
• Authors: Steven Chen and Richard R. Yang
• Abstract summary: Pose Trainer is an application that detects the user's exercise pose and provides personalized, detailed recommendations on how the user can improve their form. We record a dataset of over 100 exercise videos of correct and incorrect form, based on personal training guidelines, and build geometric-heuristic and machine learning algorithms for evaluation.
• Score: 7.005458308454871
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fitness exercises are very beneficial to personal health and fitness; however, they can also be ineffective and potentially dangerous if performed incorrectly by the user. Exercise mistakes are made when the user does not use the proper form, or pose. In our work, we introduce Pose Trainer, an application that detects the user's exercise pose and provides personalized, detailed recommendations on how the user can improve their form. Pose Trainer uses the state of the art in pose estimation to detect a user's pose, then evaluates the vector geometry of the pose through an exercise to provide useful feedback. We record a dataset of over 100 exercise videos of correct and incorrect form, based on personal training guidelines, and build geometric-heuristic and machine learning algorithms for evaluation. Pose Trainer works on four common exercises and supports any Windows or Linux computer with a GPU.

Related papers

• ExpertAF: Expert Actionable Feedback from Video [81.46431188306397]
  We introduce a novel method to generate actionable feedback from video of a person doing a physical activity. Our method takes a video demonstration and its accompanying 3D body pose and generates expert commentary. Our method is able to reason across multi-modal input combinations to output full-spectrum, actionable coaching.
  arXiv  Detail & Related papers  (2024-08-01T16:13:07Z)
• Interactive Garment Recommendation with User in the Loop [77.35411131350833]
  We propose to build a user profile on the fly by integrating user reactions as we recommend complementary items to compose an outfit. We present a reinforcement learning agent capable of suggesting appropriate garments and ingesting user feedback to improve its recommendations.
  arXiv  Detail & Related papers  (2024-02-18T16:01:28Z)
• A Spatial-Temporal Transformer based Framework For Human Pose Assessment And Correction in Education Scenarios [6.146739983645156]
  The framework comprises skeletal tracking, pose estimation, posture assessment, and posture correction modules. We create a pose correction method to provide corrective feedback in the form of visual aids. Results show that our model can effectively measure and comment on the quality of students' actions.
  arXiv  Detail & Related papers  (2023-11-01T09:53:38Z)
• Using Learnable Physics for Real-Time Exercise Form Recommendations [2.1548132286330453]
  We present an algorithmic pipeline that can diagnose problems in exercise techniques and offer corrective recommendations. We use MediaPipe for pose recognition, count repetitions using peak-prominence detection, and use a learnable physics simulator to track motion evolution.
  arXiv  Detail & Related papers  (2023-10-11T06:11:11Z)
• 3D Pose Based Feedback for Physical Exercises [87.35086507661227]
  We introduce a learning-based framework that identifies the mistakes made by a user. Our framework does not rely on hard-coded rules, instead, it learns them from data. Our approach yields 90.9% mistake identification accuracy and successfully corrects 94.2% of the mistakes.
  arXiv  Detail & Related papers  (2022-08-05T16:15:02Z)
• Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessment [12.040334568268445]
  We propose to learn exercise-specific representations from unlabeled samples. In particular, our domain knowledge-informed self-supervised approaches exploit the harmonic motion of the exercise actions. We show that our self-supervised representations outperform off-the-shelf 2D- and 3D-pose estimators.
  arXiv  Detail & Related papers  (2022-02-28T18:40:02Z)
• Deep Learning for Fitness [0.0]
  Fitness tutor is an application for maintaining correct posture during workout exercises or doing yoga. Inspired by healthcare innovations like robotic surgery, we design a novel application Fitness tutor which can guide the workouts using pose estimation.
  arXiv  Detail & Related papers  (2021-09-03T08:42:07Z)
• FixMyPose: Pose Correctional Captioning and Retrieval [67.20888060019028]
  We introduce a new captioning dataset named FixMyPose to address automated pose correction systems. We collect descriptions of correcting a "current" pose to look like a "target" pose. To avoid ML biases, we maintain a balance across characters with diverse demographics.
  arXiv  Detail & Related papers  (2021-04-04T21:45:44Z)
• Physics-Based Dexterous Manipulations with Estimated Hand Poses and Residual Reinforcement Learning [52.37106940303246]
  We learn a model that maps noisy input hand poses to target virtual poses. The agent is trained in a residual setting by using a model-free hybrid RL+IL approach. We test our framework in two applications that use hand pose estimates for dexterous manipulations: hand-object interactions in VR and hand-object motion reconstruction in-the-wild.
  arXiv  Detail & Related papers  (2020-08-07T17:34:28Z)
• Unsupervised Shape and Pose Disentanglement for 3D Meshes [49.431680543840706]
  We present a simple yet effective approach to learn disentangled shape and pose representations in an unsupervised setting. We use a combination of self-consistency and cross-consistency constraints to learn pose and shape space from registered meshes. We demonstrate the usefulness of learned representations through a number of tasks including pose transfer and shape retrieval.
  arXiv  Detail & Related papers  (2020-07-22T11:00:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.