MAAIG: Motion Analysis And Instruction Generation

• URL: http://arxiv.org/abs/2311.00980v1
• Date: Thu, 2 Nov 2023 03:53:25 GMT
• Title: MAAIG: Motion Analysis And Instruction Generation
• Abstract summary: Many people engage in self-directed sports training at home but lack the real-time guidance of professional coaches. We propose a novel application framework called MAAIG. It can generate embedding vectors for each frame based on user-provided sports action videos.
• Score: 10.330867429217362
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Many people engage in self-directed sports training at home but lack the real-time guidance of professional coaches, making them susceptible to injuries or the development of incorrect habits. In this paper, we propose a novel application framework called MAAIG(Motion Analysis And Instruction Generation). It can generate embedding vectors for each frame based on user-provided sports action videos. These embedding vectors are associated with the 3D skeleton of each frame and are further input into a pretrained T5 model. Ultimately, our model utilizes this information to generate specific sports instructions. It has the capability to identify potential issues and provide real-time guidance in a manner akin to professional coaches, helping users improve their sports skills and avoid injuries.

Related papers

• ExpertEdit: Learning Skill-Aware Motion Editing from Expert Videos [50.06747687804514]
  ExpertEdit is a framework for skill-driven motion editing trained exclusively on unpaired expert video demonstrations.<n>It produces localized skill improvements without paired supervision or manual edit guidance.<n>It outperforms state-of-the-art supervised motion editing methods on multiple metrics of motion realism and expert quality.
  arXiv  Detail & Related papers  (2026-04-12T05:25:33Z)
• SportSkills: Physical Skill Learning from Sports Instructional Videos [51.16409727318035]
  SportSkills is the first large-scale sports dataset geared towards physical skill learning with in-the-wild video.<n>We show that SportSkills unlocks the ability to understand fine-grained differences between physical actions.<n>We introduce the first large-scale task formulation of mistake-conditioned instructional video retrieval.
  arXiv  Detail & Related papers  (2026-03-26T08:29:35Z)
• Teacher-Student Diffusion Model for Text-Driven 3D Hand Motion Generation [54.27025073220947]
  Existing methods either focus on full-body motion, overlooking detailed hand gestures, or require explicit 3D object meshes.<n>We propose TSHaMo, a model-agnostic teacher-student diffusion framework for text-driven hand motion generation.
  arXiv  Detail & Related papers  (2026-03-25T15:21:04Z)
• SportsGPT: An LLM-driven Framework for Interpretable Sports Motion Assessment and Training Guidance [22.480385290370663]
  We propose SportsGPT, an LLM-driven framework for interpretable sports motion assessment and training guidance.<n> MotionDTW is a two-stage time series alignment algorithm designed for accurate extraction from skeleton-based motion sequences.<n>SportsRAG is a RAG-based training guidance model built upon Qwen3.
  arXiv  Detail & Related papers  (2025-12-16T06:05:55Z)
• Learning Skill-Attributes for Transferable Assessment in Video [56.813876909367856]
  Skill assessment from video entails rating the quality of a person's physical performance and explaining what could be done better.<n>Our CrossTrainer approach discovers skill-attributes, such as balance, control, and hand positioning.<n>By abstracting out the shared behaviors indicative of human skill, the proposed video representation generalizes substantially better than an array of existing techniques.
  arXiv  Detail & Related papers  (2025-11-17T23:53:06Z)
• CoachMe: Decoding Sport Elements with a Reference-Based Coaching Instruction Generation Model [14.887934352089742]
  CoachMe is a reference-based model that analyzes the differences between a learner's motion and a reference under temporal and physical aspects.<n>We show how CoachMe adapts well to specific sports such as skating and boxing by learning from general movements and then leveraging limited data.
  arXiv  Detail & Related papers  (2025-09-15T09:01:39Z)
• KASportsFormer: Kinematic Anatomy Enhanced Transformer for 3D Human Pose Estimation on Short Sports Scene Video [4.653030985708889]
  We introduce KASportsFormer, a novel transformer based 3D pose estimation framework for sports.<n>Our proposed method achieves state-of-the-art results with MPJPE errors of 58.0mm and 34.3mm, respectively.
  arXiv  Detail & Related papers  (2025-07-28T12:17:40Z)
• AthleticsPose: Authentic Sports Motion Dataset on Athletic Field and Evaluation of Monocular 3D Pose Estimation Ability [4.991985467382602]
  We introduce the AthleticsPose dataset, featuring real'' motions captured from 23 athletes performing various athletics events on an athletic field.<n>Our results show that the model trained on AthleticsPose significantly outperforms a baseline model trained on an imitated sports motion dataset.<n>In case studies of kinematic indicators, the model demonstrated the potential to capture individual differences in knee angles but struggled with higher-speed metrics.
  arXiv  Detail & Related papers  (2025-07-17T08:43:23Z)
• VideoRun2D: Cost-Effective Markerless Motion Capture for Sprint Biomechanics [12.12643642515884]
  Sprinting is a determinant ability, especially in team sports. The kinematics of the sprint have been studied in the past using different methods. This study first adapts two general trackers for realistic biomechanical analysis and then evaluate them in comparison to manual tracking. Our best resulting markerless body tracker particularly adapted for sprint biomechanics is termed VideoRun2D.
  arXiv  Detail & Related papers  (2024-09-16T11:10:48Z)
• ExpertAF: Expert Actionable Feedback from Video [81.46431188306397]
  We introduce a novel method to generate actionable feedback from video of a person doing a physical activity. Our method takes a video demonstration and its accompanying 3D body pose and generates expert commentary. Our method is able to reason across multi-modal input combinations to output full-spectrum, actionable coaching.
  arXiv  Detail & Related papers  (2024-08-01T16:13:07Z)
• SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillation [55.47473138423572]
  We introduce SuperPADL, a scalable framework for physics-based text-to-motion. SuperPADL trains controllers on thousands of diverse motion clips using RL and supervised learning. Our controller is trained on a dataset containing over 5000 skills and runs in real time on a consumer GPU.
  arXiv  Detail & Related papers  (2024-07-15T07:07:11Z)
• Understanding why shooters shoot -- An AI-powered engine for basketball performance profiling [70.54015529131325]
  Basketball is dictated by many variables, such as playstyle and game dynamics. It is crucial that the performance profiles can reflect the diverse playstyles. We present a tool that can visualize player performance profiles in a timely manner.
  arXiv  Detail & Related papers  (2023-03-17T01:13:18Z)
• A Survey on Video Action Recognition in Sports: Datasets, Methods and Applications [60.3327085463545]
  We present a survey on video action recognition for sports analytics. We introduce more than ten types of sports, including team sports, such as football, basketball, volleyball, hockey and individual sports, such as figure skating, gymnastics, table tennis, diving and badminton. We develop a toolbox using PaddlePaddle, which supports football, basketball, table tennis and figure skating action recognition.
  arXiv  Detail & Related papers  (2022-06-02T13:19:36Z)
• Learning to Run with Potential-Based Reward Shaping and Demonstrations from Video Data [70.540936204654]
  "Learning to run" competition was to train a two-legged model of a humanoid body to run in a simulated race course with maximum speed. All submissions took a tabula rasa approach to reinforcement learning (RL) and were able to produce relatively fast, but not optimal running behaviour. We demonstrate how data from videos of human running can be used to shape the reward of the humanoid learning agent.
  arXiv  Detail & Related papers  (2020-12-16T09:46:58Z)
• AI-enabled Prediction of eSports Player Performance Using the Data from Heterogeneous Sensors [12.071865017583502]
  We report on an Artificial Intelligence (AI) enabled solution for predicting the eSports player in-game performance using exclusively the data from sensors. The player performance is assessed from the game logs in a multiplayer game for each moment of time using a recurrent neural network. The proposed solution has a number of promising applications for Pro eSports teams as well as a learning tool for amateur players.
  arXiv  Detail & Related papers  (2020-12-07T07:31:53Z)
• A New Action Recognition Framework for Video Highlights Summarization in Sporting Events [9.870478438166288]
  We present a framework to automatically clip the sports video stream by using a three-level prediction algorithm based on two classical open-source structures, i.e., YOLO-v3 and OpenPose. It is found that by using a modest amount of sports video training data, our methodology can perform sports activity highlights clipping accurately.
  arXiv  Detail & Related papers  (2020-12-01T04:14:40Z)
• Contact and Human Dynamics from Monocular Video [73.47466545178396]
  Existing deep models predict 2D and 3D kinematic poses from video that are approximately accurate, but contain visible errors. We present a physics-based method for inferring 3D human motion from video sequences that takes initial 2D and 3D pose estimates as input.
  arXiv  Detail & Related papers  (2020-07-22T21:09:11Z)
• Pose Trainer: Correcting Exercise Posture using Pose Estimation [7.005458308454871]
  Pose Trainer is an application that detects the user's exercise pose and provides personalized, detailed recommendations on how the user can improve their form. We record a dataset of over 100 exercise videos of correct and incorrect form, based on personal training guidelines, and build geometric-heuristic and machine learning algorithms for evaluation.
  arXiv  Detail & Related papers  (2020-06-21T05:51:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.