A Survey on Physics Informed Reinforcement Learning: Review and Open Problems

• URL: http://arxiv.org/abs/2309.01909v1
• Date: Tue, 5 Sep 2023 02:45:18 GMT
• Title: A Survey on Physics Informed Reinforcement Learning: Review and Open Problems
• Authors: Chayan Banerjee, Kien Nguyen, Clinton Fookes, Maziar Raissi
• Abstract summary: We present a review of the literature on incorporating physics information, as known as physics priors, in reinforcement learning approaches. We introduce a novel taxonomy with the reinforcement learning pipeline as the backbone to classify existing works. This nascent field holds great potential for enhancing reinforcement learning algorithms by increasing their physical plausibility, precision, data efficiency, and applicability in real-world scenarios.
• Score: 25.3906503332344
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The inclusion of physical information in machine learning frameworks has revolutionized many application areas. This involves enhancing the learning process by incorporating physical constraints and adhering to physical laws. In this work we explore their utility for reinforcement learning applications. We present a thorough review of the literature on incorporating physics information, as known as physics priors, in reinforcement learning approaches, commonly referred to as physics-informed reinforcement learning (PIRL). We introduce a novel taxonomy with the reinforcement learning pipeline as the backbone to classify existing works, compare and contrast them, and derive crucial insights. Existing works are analyzed with regard to the representation/ form of the governing physics modeled for integration, their specific contribution to the typical reinforcement learning architecture, and their connection to the underlying reinforcement learning pipeline stages. We also identify core learning architectures and physics incorporation biases (i.e., observational, inductive and learning) of existing PIRL approaches and use them to further categorize the works for better understanding and adaptation. By providing a comprehensive perspective on the implementation of the physics-informed capability, the taxonomy presents a cohesive approach to PIRL. It identifies the areas where this approach has been applied, as well as the gaps and opportunities that exist. Additionally, the taxonomy sheds light on unresolved issues and challenges, which can guide future research. This nascent field holds great potential for enhancing reinforcement learning algorithms by increasing their physical plausibility, precision, data efficiency, and applicability in real-world scenarios.

Related papers

• Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond [61.18736646013446]
  In pursuit of a deeper understanding of its surprising behaviors, we investigate the utility of a simple yet accurate model of a trained neural network. Across three case studies, we illustrate how it can be applied to derive new empirical insights on a diverse range of prominent phenomena.
  arXiv  Detail & Related papers  (2024-10-31T22:54:34Z)
• Machine Learning with Physics Knowledge for Prediction: A Survey [16.96920919164813]
  This survey examines the broad suite of methods and models for combining machine learning with physics knowledge for prediction and forecast. The survey has two parts. The first considers incorporating physics knowledge on an architectural level through objective functions, structured predictive models, and data augmentation. The second considers data as physics knowledge, which motivates looking at multi-task, meta, and contextual learning as an alternative approach to incorporating physics knowledge in a data-driven fashion.
  arXiv  Detail & Related papers  (2024-08-19T09:36:07Z)
• Breaking the Curse of Dimensionality in Deep Neural Networks by Learning Invariant Representations [1.9580473532948401]
  This thesis explores the theoretical foundations of deep learning by studying the relationship between the architecture of these models and the inherent structures found within the data they process. We ask What drives the efficacy of deep learning algorithms and allows them to beat the so-called curse of dimensionality. Our methodology takes an empirical approach to deep learning, combining experimental studies with physics-inspired toy models.
  arXiv  Detail & Related papers  (2023-10-24T19:50:41Z)
• Physics-Informed Computer Vision: A Review and Perspectives [22.71741766133866]
  incorporation of physical information in machine learning frameworks is opening and transforming many application domains. We present a systematic literature review of more than 250 papers on formulation and approaches to computer vision tasks guided by physical laws.
  arXiv  Detail & Related papers  (2023-05-29T11:55:11Z)
• Symmetry Group Equivariant Architectures for Physics [52.784926970374556]
  In the domain of machine learning, an awareness of symmetries has driven impressive performance breakthroughs. We argue that both the physics community and the broader machine learning community have much to understand.
  arXiv  Detail & Related papers  (2022-03-11T18:27:04Z)
• Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysis [96.53859361560505]
  We propose a knowledge graph augmented network (KGAN) to incorporate external knowledge with explicitly syntactic and contextual information. KGAN captures the sentiment feature representations from multiple perspectives, i.e., context-, syntax- and knowledge-based. Experiments on three popular ABSA benchmarks demonstrate the effectiveness and robustness of our KGAN.
  arXiv  Detail & Related papers  (2022-01-13T08:25:53Z)
• Physics-Guided Deep Learning for Dynamical Systems: A survey [5.733401663293044]
  Traditional physics-based models are interpretable but rely on rigid assumptions. Deep learning provides novel alternatives for efficiently recognizing complex patterns and emulating nonlinear dynamics. It aims to take the best from both physics-based modeling and state-of-the-art DL models to better solve scientific problems.
  arXiv  Detail & Related papers  (2021-07-02T20:59:03Z)
• Physics guided machine learning using simplified theories [0.0]
  Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences. We introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines.
  arXiv  Detail & Related papers  (2020-12-18T21:30:40Z)
• Importance Weighted Policy Learning and Adaptation [89.46467771037054]
  We study a complementary approach which is conceptually simple, general, modular and built on top of recent improvements in off-policy learning. The framework is inspired by ideas from the probabilistic inference literature and combines robust off-policy learning with a behavior prior. Our approach achieves competitive adaptation performance on hold-out tasks compared to meta reinforcement learning baselines and can scale to complex sparse-reward scenarios.
  arXiv  Detail & Related papers  (2020-09-10T14:16:58Z)
• A Survey on Deep Learning for Localization and Mapping: Towards the Age of Spatial Machine Intelligence [48.67755344239951]
  We provide a comprehensive survey, and propose a new taxonomy for localization and mapping using deep learning. A wide range of topics are covered, from learning odometry estimation, mapping, to global localization and simultaneous localization and mapping. It is our hope that this work can connect emerging works from robotics, computer vision and machine learning communities.
  arXiv  Detail & Related papers  (2020-06-22T19:01:21Z)
• A Review on Intelligent Object Perception Methods Combining Knowledge-based Reasoning and Machine Learning [60.335974351919816]
  Object perception is a fundamental sub-field of Computer Vision. Recent works seek ways to integrate knowledge engineering in order to expand the level of intelligence of the visual interpretation of objects.
  arXiv  Detail & Related papers  (2019-12-26T13:26:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.