Towards Using Behavior Trees in Industrial Automation Controllers

• URL: http://arxiv.org/abs/2404.14030v1
• Date: Mon, 22 Apr 2024 09:47:36 GMT
• Title: Towards Using Behavior Trees in Industrial Automation Controllers
• Authors: Aleksandr Sidorenko, Mahdi Rezapour, Achim Wagner, Martin Ruskowski,
• Abstract summary: The Industry 4.0 paradigm manifests the shift towards mass customization and cyber-physical production systems. There is a lack of PLC software flexibility and integration between low-level programs and high-level task-oriented control frameworks. This paper proposes an approach for improving the industrial control software design by integrating Behavior Trees into PLC programs.
• Score: 41.94295877935867
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The Industry 4.0 paradigm manifests the shift towards mass customization and cyber-physical production systems (CPPS) and sets new requirements for industrial automation software in terms of modularity, flexibility, and short development cycles of control programs. Though programmable logical controllers (PLCs) have been evolving into versatile and powerful edge devices, there is a lack of PLC software flexibility and integration between low-level programs and high-level task-oriented control frameworks. Behavior trees (BTs) is a novel framework, which enables rapid design of modular hierarchical control structures. It combines improved modularity with a simple and intuitive design of control logic. This paper proposes an approach for improving the industrial control software design by integrating BTs into PLC programs and separating hardware related functionalities from the coordination logic. Several strategies for integration of BTs into PLCs are shown. The first two integrate BTs with the IEC 61131 based PLCs and are based on the use of the PLCopen Common Behavior Model. The last one utilized event-based BTs and shows the integration with the IEC 61499 based controllers. An application example demonstrates the approach. The paper contributes in the following ways. First, we propose a new PLC software design, which improves modularity, supports better separation of concerns, and enables rapid development and reconfiguration of the control software. Second, we show and evaluate the integration of the BT framework into both IEC 61131 and IEC 61499 based PLCs, as well as the integration of the PLCopen function blocks with the external BT library. This leads to better integration of the low-level PLC code and the AI-based task-oriented frameworks. It also improves the skill-based programming approach for PLCs by using BTs for skills composition.

Related papers

• Agents4PLC: Automating Closed-loop PLC Code Generation and Verification in Industrial Control Systems using LLM-based Agents [27.097029139195943]
  Agents4PLC is a novel framework that automates PLC code generation and code-level verification. We first establish a benchmark for verifiable PLC code generation area. We then transition from natural language requirements to human-written-verified formal specifications and reference PLC code.
  arXiv  Detail & Related papers  (2024-10-18T06:51:13Z)
• Communication-Control Codesign for Large-Scale Wireless Networked Control Systems [80.30532872347668]
  Wireless Networked Control Systems (WNCSs) are essential to Industry 4.0, enabling flexible control in applications, such as drone swarms and autonomous robots. We propose a practical WNCS model that captures correlated dynamics among multiple control loops with spatially distributed sensors and actuators sharing limited wireless resources over multi-state Markov block-fading channels. We develop a Deep Reinforcement Learning (DRL) algorithm that efficiently handles the hybrid action space, captures communication-control correlations, and ensures robust training despite sparse cross-domain variables and floating control inputs.
  arXiv  Detail & Related papers  (2024-10-15T06:28:21Z)
• Skills Composition Framework for Reconfigurable Cyber-Physical Production Modules [44.99833362998488]
  This paper proposes a framework for skills' composition and execution in skill-based reconfigurable cyber-physical production modules. It is based on distributed Behavior trees (BTs) and provides good integration between low-level devices' specific code and AI-based task-oriented frameworks.
  arXiv  Detail & Related papers  (2024-05-22T12:56:05Z)
• Deep Learning for Wireless Networked Systems: a joint Estimation-Control-Scheduling Approach [47.29474858956844]
  Wireless networked control system (WNCS) connecting sensors, controllers, and actuators via wireless communications is a key enabling technology for highly scalable and low-cost deployment of control systems in the Industry 4.0 era. Despite the tight interaction of control and communications in WNCSs, most existing works adopt separative design approaches. We propose a novel deep reinforcement learning (DRL)-based algorithm for controller and optimization utilizing both model-free and model-based data.
  arXiv  Detail & Related papers  (2022-10-03T01:29:40Z)
• Deep Reinforcement Learning with Shallow Controllers: An Experimental Application to PID Tuning [3.9146761527401424]
  We demonstrate the challenges in implementing a state of the art deep RL algorithm on a real physical system. At the core of our approach is the use of a PID controller as the trainable RL policy.
  arXiv  Detail & Related papers  (2021-11-13T18:48:28Z)
• Optimization of the Model Predictive Control Update Interval Using Reinforcement Learning [0.7952582509792969]
  In control applications there is often a compromise that needs to be made with regards to the complexity and performance of the controller. We propose a controller architecture in which the computational cost is explicitly optimized along with the control objective.
  arXiv  Detail & Related papers  (2020-11-26T16:01:52Z)
• Learning a Contact-Adaptive Controller for Robust, Efficient Legged Locomotion [95.1825179206694]
  We present a framework that synthesizes robust controllers for a quadruped robot. A high-level controller learns to choose from a set of primitives in response to changes in the environment. A low-level controller that utilizes an established control method to robustly execute the primitives.
  arXiv  Detail & Related papers  (2020-09-21T16:49:26Z)
• Extending XACC for Quantum Optimal Control [70.19683407682642]
  Quantum computing vendors are beginning to open up application programming for direct pulse-level quantum control. We present an extension to the XACC system-level quantum-classical software framework. This extension enables the translation of digital quantum circuit representations to equivalent pulse sequences.
  arXiv  Detail & Related papers  (2020-06-04T13:13:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.