Improving Wind Resistance Performance of Cascaded PID Controlled Quadcopters using Residual Reinforcement Learning

• URL: http://arxiv.org/abs/2308.01648v1
• Date: Thu, 3 Aug 2023 09:29:19 GMT
• Title: Improving Wind Resistance Performance of Cascaded PID Controlled Quadcopters using Residual Reinforcement Learning
• Authors: Yu Ishihara, Yuichi Hazama, Kousuke Suzuki, Jerry Jun Yokono, Kohtaro Sabe, Kenta Kawamoto
• Abstract summary: Wind resistance control is an essential feature for quadcopters to maintain their position to avoid deviation from target position. We propose a residual reinforcement learning based approach to build a wind resistance controller of a quadcopter. Our controller reduces the position deviation by approximately 50% compared to the quadcopter controlled with the conventional cascaded PID controller.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Wind resistance control is an essential feature for quadcopters to maintain their position to avoid deviation from target position and prevent collisions with obstacles. Conventionally, cascaded PID controller is used for the control of quadcopters for its simplicity and ease of tuning its parameters. However, it is weak against wind disturbances and the quadcopter can easily deviate from target position. In this work, we propose a residual reinforcement learning based approach to build a wind resistance controller of a quadcopter. By learning only the residual that compensates the disturbance, we can continue using the cascaded PID controller as the base controller of the quadcopter but improve its performance against wind disturbances. To avoid unexpected crashes and destructions of quadcopters, our method does not require real hardware for data collection and training. The controller is trained only on a simulator and directly applied to the target hardware without extra finetuning process. We demonstrate the effectiveness of our approach through various experiments including an experiment in an outdoor scene with wind speed greater than 13 m/s. Despite its simplicity, our controller reduces the position deviation by approximately 50% compared to the quadcopter controlled with the conventional cascaded PID controller. Furthermore, trained controller is robust and preserves its performance even though the quadcopter's mass and propeller's lift coefficient is changed between 50% to 150% from original training time.

Related papers

• From Flies to Robots: Inverted Landing in Small Quadcopters with Dynamic Perching [15.57055572401334]
  Inverted landing is a routine behavior among a number of animal fliers. We develop a control policy general to arbitrary ceiling-approach conditions. We successfully achieved a range of robust inverted-landing behaviors in small quadcopters.
  arXiv  Detail & Related papers  (2024-02-29T21:09:08Z)
• Learning a Single Near-hover Position Controller for Vastly Different Quadcopters [56.37274861303324]
  This paper proposes an adaptive near-hover position controller for quadcopters. It can be deployed to quadcopters of very different mass, size and motor constants. It also shows rapid adaptation to unknown disturbances during runtime.
  arXiv  Detail & Related papers  (2022-09-19T17:55:05Z)
• Skip Training for Multi-Agent Reinforcement Learning Controller for Industrial Wave Energy Converters [94.84709449845352]
  Recent Wave Energy Converters (WEC) are equipped with multiple legs and generators to maximize energy generation. Traditional controllers have shown limitations to capture complex wave patterns and the controllers must efficiently maximize the energy capture. This paper introduces a Multi-Agent Reinforcement Learning controller (MARL), which outperforms the traditionally used spring damper controller.
  arXiv  Detail & Related papers  (2022-09-13T00:20:31Z)
• Neural-Fly Enables Rapid Learning for Agile Flight in Strong Winds [96.74836678572582]
  We present a learning-based approach that allows rapid online adaptation by incorporating pretrained representations through deep learning. Neural-Fly achieves precise flight control with substantially smaller tracking error than state-of-the-art nonlinear and adaptive controllers.
  arXiv  Detail & Related papers  (2022-05-13T21:55:28Z)
• Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contexts [2.198760145670348]
  We develop a robust form of a signal temporal logic to quantitatively evaluate the vehicle's behavior and measure the performance of controllers. We discuss the robustness of the obtained controllers, both to partial loss of power for one rotor and to wind gusts and finish by drawing conclusions on practical controller design by reinforcement learning.
  arXiv  Detail & Related papers  (2021-07-27T16:58:19Z)
• Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots [121.42930679076574]
  We present a model-free reinforcement learning framework for training robust locomotion policies in simulation. domain randomization is used to encourage the policies to learn behaviors that are robust across variations in system dynamics. We demonstrate this on versatile walking behaviors such as tracking a target walking velocity, walking height, and turning yaw.
  arXiv  Detail & Related papers  (2021-03-26T07:14:01Z)
• Machine Learning for Mechanical Ventilation Control [52.65490904484772]
  We consider the problem of controlling an invasive mechanical ventilator for pressure-controlled ventilation. A PID controller must let air in and out of a sedated patient's lungs according to a trajectory of airway pressures specified by a clinician. We show that our controllers are able to track target pressure waveforms significantly better than PID controllers.
  arXiv  Detail & Related papers  (2021-02-12T21:23:33Z)
• Learning a Contact-Adaptive Controller for Robust, Efficient Legged Locomotion [95.1825179206694]
  We present a framework that synthesizes robust controllers for a quadruped robot. A high-level controller learns to choose from a set of primitives in response to changes in the environment. A low-level controller that utilizes an established control method to robustly execute the primitives.
  arXiv  Detail & Related papers  (2020-09-21T16:49:26Z)
• Developmental Reinforcement Learning of Control Policy of a Quadcopter UAV with Thrust Vectoring Rotors [1.0057838324294686]
  We present a novel developmental reinforcement learning-based controller for a quadcopter with thrust vectoring capabilities. The control policy of this robot is learned using the policy transfer from the learned controller of the quadcopter. The performance of the learned policy is evaluated by physics-based simulations for the tasks of hovering and way-point navigation.
  arXiv  Detail & Related papers  (2020-07-15T16:17:29Z)
• Mid-flight Propeller Failure Detection and Control of Propeller-deficient Quadcopter using Reinforcement Learning [0.2578242050187029]
  This paper presents reinforcement learning based controllers for quadcopters with 4, 3, and 2 propellers. The paper also proposes a neural network based propeller fault detection system to detect propeller loss and switch to the appropriate controller.
  arXiv  Detail & Related papers  (2020-02-26T15:31:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.