Proving the Potential of Skeleton Based Action Recognition to Automate the Analysis of Manual Processes

• URL: http://arxiv.org/abs/2310.08451v1
• Date: Thu, 12 Oct 2023 16:11:13 GMT
• Title: Proving the Potential of Skeleton Based Action Recognition to Automate the Analysis of Manual Processes
• Authors: Marlin Berger, Frederik Cloppenburg, Jens Eufinger, Thomas Gries
• Abstract summary: In this work, based on a video stream, the current motion class in a manual assembly process is detected. With information on the current motion, Key-Performance-Indicators (KPIs) can be derived easily. A skeleton-based action recognition approach is taken, as this field recently shows major success in machine vision tasks. A ML pipeline is developed, to enable extensive research on different (pre-) processing methods and neural nets.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In manufacturing sectors such as textiles and electronics, manual processes are a fundamental part of production. The analysis and monitoring of the processes is necessary for efficient production design. Traditional methods for analyzing manual processes are complex, expensive, and inflexible. Compared to established approaches such as Methods-Time-Measurement (MTM), machine learning (ML) methods promise: Higher flexibility, self-sufficient & permanent use, lower costs. In this work, based on a video stream, the current motion class in a manual assembly process is detected. With information on the current motion, Key-Performance-Indicators (KPIs) can be derived easily. A skeleton-based action recognition approach is taken, as this field recently shows major success in machine vision tasks. For skeleton-based action recognition in manual assembly, no sufficient pre-work could be found. Therefore, a ML pipeline is developed, to enable extensive research on different (pre-) processing methods and neural nets. Suitable well generalizing approaches are found, proving the potential of ML to enhance analyzation of manual processes. Models detect the current motion, performed by an operator in manual assembly, but the results can be transferred to all kinds of manual processes.

Related papers

• NLP4PBM: A Systematic Review on Process Extraction using Natural Language Processing with Rule-based, Machine and Deep Learning Methods [0.0]
  This literature review studies the field of automated process extraction, i.e., transforming textual descriptions into structured processes using Natural Language Processing (NLP) We found that Machine Learning (ML) / Deep Learning (DL) methods are being increasingly used for the NLP component. In some cases, they were chosen for their suitability towards process extraction, and results show that they can outperform classic rule-based methods.
  arXiv  Detail & Related papers  (2024-09-10T15:16:02Z)
• Unsupervised Work Behavior Pattern Extraction Based on Hierarchical Probabilistic Model [0.0]
  We extend the hidden semi-Markov model (GP-HSMM) to enable the rapid and automated analysis of worker behavior without pre-training. The proposed model is a probabilistic model that hierarchically connects GP-HSMM and HSMM. It mutually infers the parameters between the GP-HSMM and HSMM, resulting in accurate motion pattern extraction.
  arXiv  Detail & Related papers  (2024-05-16T06:31:02Z)
• Process Modeling With Large Language Models [42.0652924091318]
  This paper explores the integration of Large Language Models (LLMs) into process modeling. We propose a framework that leverages LLMs for the automated generation and iterative refinement of process models. Preliminary results demonstrate the framework's ability to streamline process modeling tasks.
  arXiv  Detail & Related papers  (2024-03-12T11:27:47Z)
• Machine Learning Meets Advanced Robotic Manipulation [48.6221343014126]
  The paper reviews cutting edge technologies and recent trends on machine learning methods applied to real-world manipulation tasks. The rest of the paper is devoted to ML applications in different domains such as industry, healthcare, agriculture, space, military, and search and rescue.
  arXiv  Detail & Related papers  (2023-09-22T01:06:32Z)
• Iterative Forward Tuning Boosts In-Context Learning in Language Models [88.25013390669845]
  In this study, we introduce a novel two-stage framework to boost in-context learning in large language models (LLMs) Specifically, our framework delineates the ICL process into two distinct stages: Deep-Thinking and test stages. The Deep-Thinking stage incorporates a unique attention mechanism, i.e., iterative enhanced attention, which enables multiple rounds of information accumulation.
  arXiv  Detail & Related papers  (2023-05-22T13:18:17Z)
• Benchmarking Automated Machine Learning Methods for Price Forecasting Applications [58.720142291102135]
  We show the possibility of substituting manually created ML pipelines with automated machine learning (AutoML) solutions. Based on the CRISP-DM process, we split the manual ML pipeline into a machine learning and non-machine learning part. We show in a case study for the industrial use case of price forecasting, that domain knowledge combined with AutoML can weaken the dependence on ML experts.
  arXiv  Detail & Related papers  (2023-04-28T10:27:38Z)
• An adaptive human-in-the-loop approach to emission detection of Additive Manufacturing processes and active learning with computer vision [76.72662577101988]
  In-situ monitoring and process control in Additive Manufacturing (AM) allows the collection of large amounts of emission data. This data can be used as input into 3D and 2D representations of the 3D-printed parts. The aim of this paper is to propose an adaptive human-in-the-loop approach using Machine Learning techniques.
  arXiv  Detail & Related papers  (2022-12-12T15:11:18Z)
• Explainable Artificial Intelligence for Improved Modeling of Processes [6.29494485203591]
  We evaluate the capability of modern Transformer architectures and more classical Machine Learning technologies of modeling process regularities. We show that the ML models are capable of predicting critical outcomes and that the attention mechanisms or XAI components offer new insights into the underlying processes.
  arXiv  Detail & Related papers  (2022-12-01T17:56:24Z)
• Machine learning in bioprocess development: From promise to practice [58.720142291102135]
  Data-driven methods like machine learning (ML) approaches have a high potential to rationally explore large design spaces. The aim of this review is to demonstrate how ML methods have been applied so far in bioprocess development.
  arXiv  Detail & Related papers  (2022-10-04T13:48:59Z)
• Generating Hidden Markov Models from Process Models Through Nonnegative Tensor Factorization [0.0]
  We introduce a novel mathematically sound method that integrates theoretical process models with interrelated minimal Hidden Markov Models. Our method consolidates: (a) theoretical process models, (b) HMMs, (c) coupled nonnegative matrix-tensor factorizations, and (d) custom model selection.
  arXiv  Detail & Related papers  (2022-10-03T16:19:27Z)
• Chain of Thought Imitation with Procedure Cloning [129.62135987416164]
  We propose procedure cloning, which applies supervised sequence prediction to imitate the series of expert computations. We show that imitating the intermediate computations of an expert's behavior enables procedure cloning to learn policies exhibiting significant generalization to unseen environment configurations.
  arXiv  Detail & Related papers  (2022-05-22T13:14:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.