Using Learnable Physics for Real-Time Exercise Form Recommendations

• URL: http://arxiv.org/abs/2310.07221v1
• Date: Wed, 11 Oct 2023 06:11:11 GMT
• Title: Using Learnable Physics for Real-Time Exercise Form Recommendations
• Authors: Abhishek Jaiswal, Gautam Chauhan, Nisheeth Srivastava
• Abstract summary: We present an algorithmic pipeline that can diagnose problems in exercise techniques and offer corrective recommendations. We use MediaPipe for pose recognition, count repetitions using peak-prominence detection, and use a learnable physics simulator to track motion evolution.
• Score: 2.1548132286330453
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Good posture and form are essential for safe and productive exercising. Even in gym settings, trainers may not be readily available for feedback. Rehabilitation therapies and fitness workouts can thus benefit from recommender systems that provide real-time evaluation. In this paper, we present an algorithmic pipeline that can diagnose problems in exercise techniques and offer corrective recommendations, with high sensitivity and specificity in real-time. We use MediaPipe for pose recognition, count repetitions using peak-prominence detection, and use a learnable physics simulator to track motion evolution for each exercise. A test video is diagnosed based on deviations from the prototypical learned motion using statistical learning. The system is evaluated on six full and upper body exercises. These real-time recommendations, counseled via low-cost equipment like smartphones, will allow exercisers to rectify potential mistakes making self-practice feasible while reducing the risk of workout injuries.

Related papers

• ExpertAF: Expert Actionable Feedback from Video [81.46431188306397]
  We introduce a novel method to generate actionable feedback from video of a person doing a physical activity. Our method takes a video demonstration and its accompanying 3D body pose and generates expert commentary. Our method is able to reason across multi-modal input combinations to output full-spectrum, actionable coaching.
  arXiv  Detail & Related papers  (2024-08-01T16:13:07Z)
• Refining Pre-Trained Motion Models [56.18044168821188]
  We take on the challenge of improving state-of-the-art supervised models with self-supervised training. We focus on obtaining a "clean" training signal from real-world unlabelled video. We show that our method yields reliable gains over fully-supervised methods in real videos.
  arXiv  Detail & Related papers  (2024-01-01T18:59:33Z)
• P\=uioio: On-device Real-Time Smartphone-Based Automated Exercise Repetition Counting System [1.4050836886292868]
  We introduce a deep learning based exercise repetition counting system for smartphones consisting of five components: (1) Pose estimation, (2) Thresholding, (3) Optical flow, (4) State machine, and (5) Counter. The system is then implemented via a cross-platform mobile application named P=uioio that uses only the smartphone camera to track repetitions in real time for three standard exercises: Squats, Push-ups, and Pull-ups.
  arXiv  Detail & Related papers  (2023-07-22T01:38:02Z)
• Design, Development, and Evaluation of an Interactive Personalized Social Robot to Monitor and Coach Post-Stroke Rehabilitation Exercises [68.37238218842089]
  We develop an interactive social robot exercise coaching system for personalized rehabilitation. This system integrates a neural network model with a rule-based model to automatically monitor and assess patients' rehabilitation exercises. Our system can adapt to new participants and achieved 0.81 average performance to assess their exercises, which is comparable to the experts' agreement level.
  arXiv  Detail & Related papers  (2023-05-12T17:37:04Z)
• 3D Pose Based Feedback for Physical Exercises [87.35086507661227]
  We introduce a learning-based framework that identifies the mistakes made by a user. Our framework does not rely on hard-coded rules, instead, it learns them from data. Our approach yields 90.9% mistake identification accuracy and successfully corrects 94.2% of the mistakes.
  arXiv  Detail & Related papers  (2022-08-05T16:15:02Z)
• Domain Knowledge-Informed Self-Supervised Representations for Workout Form Assessment [12.040334568268445]
  We propose to learn exercise-specific representations from unlabeled samples. In particular, our domain knowledge-informed self-supervised approaches exploit the harmonic motion of the exercise actions. We show that our self-supervised representations outperform off-the-shelf 2D- and 3D-pose estimators.
  arXiv  Detail & Related papers  (2022-02-28T18:40:02Z)
• Real-Time Learning from An Expert in Deep Recommendation Systems with Marginal Distance Probability Distribution [1.3535770763481902]
  We develop a recommendation system for daily exercise activities to users based on their history, profile and similar users. The developed recommendation system uses a deep recurrent neural network with user-profile attention and temporal attention mechanisms. We propose a real-time, expert-in-the-loop active learning procedure.
  arXiv  Detail & Related papers  (2021-10-12T19:20:18Z)
• Deep Learning for Fitness [0.0]
  Fitness tutor is an application for maintaining correct posture during workout exercises or doing yoga. Inspired by healthcare innovations like robotic surgery, we design a novel application Fitness tutor which can guide the workouts using pose estimation.
  arXiv  Detail & Related papers  (2021-09-03T08:42:07Z)
• Learning to Run with Potential-Based Reward Shaping and Demonstrations from Video Data [70.540936204654]
  "Learning to run" competition was to train a two-legged model of a humanoid body to run in a simulated race course with maximum speed. All submissions took a tabula rasa approach to reinforcement learning (RL) and were able to produce relatively fast, but not optimal running behaviour. We demonstrate how data from videos of human running can be used to shape the reward of the humanoid learning agent.
  arXiv  Detail & Related papers  (2020-12-16T09:46:58Z)
• Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation [51.72616167073565]
  We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation. We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field. We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
  arXiv  Detail & Related papers  (2020-06-28T21:03:19Z)
• Pose Trainer: Correcting Exercise Posture using Pose Estimation [7.005458308454871]
  Pose Trainer is an application that detects the user's exercise pose and provides personalized, detailed recommendations on how the user can improve their form. We record a dataset of over 100 exercise videos of correct and incorrect form, based on personal training guidelines, and build geometric-heuristic and machine learning algorithms for evaluation.
  arXiv  Detail & Related papers  (2020-06-21T05:51:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.