A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images

• URL: http://arxiv.org/abs/2202.05199v1
• Date: Thu, 10 Feb 2022 18:02:46 GMT
• Title: A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images
• Authors: Christoph Leitner, Robert Jarolim, Bernhard Englmair, Annika Kruse, Karen Andrea Lara Hernandez, Andreas Konrad, Eric Su, J\"org Schr\"ottner, Luke A. Kelly, Glen A. Lichtwark, Markus Tilp and Christian Baumgartner
• Abstract summary: We propose a reliable and time efficient machine-learning approach to track muscle-tendon junctions in ultrasound videos. We gathered an extensive dataset, covering 3 functional movements, 2 muscles, collected on 123 healthy and 38 impaired subjects with 3 different ultrasound systems. Our model achieves similar performance scores to the four human specialists in identifying the muscle-tendon junction position.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Biomechanical and clinical gait research observes muscles and tendons in limbs to study their functions and behaviour. Therefore, movements of distinct anatomical landmarks, such as muscle-tendon junctions, are frequently measured. We propose a reliable and time efficient machine-learning approach to track these junctions in ultrasound videos and support clinical biomechanists in gait analysis. In order to facilitate this process, a method based on deep-learning was introduced. We gathered an extensive dataset, covering 3 functional movements, 2 muscles, collected on 123 healthy and 38 impaired subjects with 3 different ultrasound systems, and providing a total of 66864 annotated ultrasound images in our network training. Furthermore, we used data collected across independent laboratories and curated by researchers with varying levels of experience. For the evaluation of our method a diverse test-set was selected that is independently verified by four specialists. We show that our model achieves similar performance scores to the four human specialists in identifying the muscle-tendon junction position. Our method provides time-efficient tracking of muscle-tendon junctions, with prediction times of up to 0.078 seconds per frame (approx. 100 times faster than manual labeling). All our codes, trained models and test-set were made publicly available and our model is provided as a free-to-use online service on https://deepmtj.org/.

Related papers

• Multimodal deep learning approach to predicting neurological recovery from coma after cardiac arrest [2.374912052693646]
  The aim was to predict neurological recovery from coma following cardiac arrest using clinical data and time-series such as multi-channel EEG and ECG signals. Our submitted model achieved a Challenge score of $0.53$ on a hidden test set for predictions made $72$ hours after return of spontaneous circulation.
  arXiv  Detail & Related papers  (2024-03-09T22:29:24Z)
• Towards Unifying Anatomy Segmentation: Automated Generation of a Full-body CT Dataset via Knowledge Aggregation and Anatomical Guidelines [113.08940153125616]
  We generate a dataset of whole-body CT scans with $142$ voxel-level labels for 533 volumes providing comprehensive anatomical coverage. Our proposed procedure does not rely on manual annotation during the label aggregation stage. We release our trained unified anatomical segmentation model capable of predicting $142$ anatomical structures on CT data.
  arXiv  Detail & Related papers  (2023-07-25T09:48:13Z)
• A Two-stream Convolutional Network for Musculoskeletal and Neurological Disorders Prediction [14.003588854239544]
  Musculoskeletal and neurological disorders are the most common causes of walking problems among older people. Recent deep learning-based methods have shown promising results for automated analysis.
  arXiv  Detail & Related papers  (2022-08-18T14:32:16Z)
• Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of Articulated Motion [48.52403516006036]
  This paper proposes a vision-based approach allowing autonomous robotic US limb scanning. To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories. In all cases, the system can successfully acquire the planned vascular structure on volunteers' limbs.
  arXiv  Detail & Related papers  (2022-08-10T15:39:20Z)
• A Spatio-Temporal Multilayer Perceptron for Gesture Recognition [70.34489104710366]
  We propose a multilayer state-weighted perceptron for gesture recognition in the context of autonomous vehicles. An evaluation of TCG and Drive&Act datasets is provided to showcase the promising performance of our approach. We deploy our model to our autonomous vehicle to show its real-time capability and stable execution.
  arXiv  Detail & Related papers  (2022-04-25T08:42:47Z)
• SpineOne: A One-Stage Detection Framework for Degenerative Discs and Vertebrae [54.751251046196494]
  We propose a one-stage detection framework termed SpineOne to simultaneously localize and classify degenerative discs and vertebrae from MRI slices. SpineOne is built upon the following three key techniques: 1) a new design of the keypoint heatmap to facilitate simultaneous keypoint localization and classification; 2) the use of attention modules to better differentiate the representations between discs and vertebrae; and 3) a novel gradient-guided objective association mechanism to associate multiple learning objectives at the later training stage.
  arXiv  Detail & Related papers  (2021-10-28T12:59:06Z)
• A CNN Segmentation-Based Approach to Object Detection and Tracking in Ultrasound Scans with Application to the Vagus Nerve Detection [17.80391011147757]
  We propose a deep learning framework to automatically detect and track a specific anatomical target structure in ultrasound scans. Our framework is designed to be accurate and robust across subjects and imaging devices, to operate in real-time, and to not require a large training set. We tested the framework on two different ultrasound datasets with the aim to detect and track the Vagus nerve, where it outperformed current state-of-the-art real-time object detection networks.
  arXiv  Detail & Related papers  (2021-06-25T19:12:46Z)
• Relational Graph Learning on Visual and Kinematics Embeddings for Accurate Gesture Recognition in Robotic Surgery [84.73764603474413]
  We propose a novel online approach of multi-modal graph network (i.e., MRG-Net) to dynamically integrate visual and kinematics information. The effectiveness of our method is demonstrated with state-of-the-art results on the public JIGSAWS dataset.
  arXiv  Detail & Related papers  (2020-11-03T11:00:10Z)
• Automatic Breast Lesion Classification by Joint Neural Analysis of Mammography and Ultrasound [1.9814912982226993]
  We propose a deep-learning based method for classifying breast cancer lesions from their respective mammography and ultrasound images. The proposed approach is based on a GoogleNet architecture, fine-tuned for our data in two training steps. It achieves an AUC of 0.94, outperforming state-of-the-art models trained over a single modality.
  arXiv  Detail & Related papers  (2020-09-23T09:08:24Z)
• Automatic Tracking of the Muscle Tendon Junction in Healthy and Impaired Subjects using Deep Learning [0.0]
  Recording muscle tendon junction displacements during movement allows separate investigation of the muscle and tendon behaviour. We employ a novel deep learning approach to detect the position of the muscle tendon junction in ultrasound images. We show that our approach can be applied for various subjects and can be operated in real-time.
  arXiv  Detail & Related papers  (2020-05-05T11:24:40Z)
• A Global Benchmark of Algorithms for Segmenting Late Gadolinium-Enhanced Cardiac Magnetic Resonance Imaging [90.29017019187282]
  " 2018 Left Atrium Challenge" using 154 3D LGE-MRIs, currently the world's largest cardiac LGE-MRI dataset. Analyse of the submitted algorithms using technical and biological metrics was performed. Results show the top method achieved a dice score of 93.2% and a mean surface to a surface distance of 0.7 mm.
  arXiv  Detail & Related papers  (2020-04-26T08:49:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.