Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems

• URL: http://arxiv.org/abs/2003.04919v6
• Date: Mon, 14 Mar 2022 01:04:10 GMT
• Title: Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
• Authors: Jared Willard, Xiaowei Jia, Shaoming Xu, Michael Steinbach, Vipin Kumar
• Abstract summary: There is a growing consensus that solutions to complex science and engineering problems require novel methodologies. This paper provides a structured overview of such techniques. We then provide a taxonomy of these existing techniques, which uncovers knowledge gaps and potential crossovers of methods between disciplines.
• Score: 5.23043130762977
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: There is a growing consensus that solutions to complex science and engineering problems require novel methodologies that are able to integrate traditional physics-based modeling approaches with state-of-the-art machine learning (ML) techniques. This paper provides a structured overview of such techniques. Application-centric objective areas for which these approaches have been applied are summarized, and then classes of methodologies used to construct physics-guided ML models and hybrid physics-ML frameworks are described. We then provide a taxonomy of these existing techniques, which uncovers knowledge gaps and potential crossovers of methods between disciplines that can serve as ideas for future research.

Related papers

• Quantum Geometric Machine Learning [0.6526824510982799]
  We present state-of-the-art machine learning methods with techniques from differential geometry and topology. We demonstrate the use of deep learning greybox machine learning techniques for estimating approximate time-optimal unitary sequences. We present novel techniques utilising Cartan decompositions and variational methods for analytically solving quantum control problems.
  arXiv  Detail & Related papers  (2024-09-08T02:55:19Z)
• Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities [89.40778301238642]
  Model merging is an efficient empowerment technique in the machine learning community. There is a significant gap in the literature regarding a systematic and thorough review of these techniques.
  arXiv  Detail & Related papers  (2024-08-14T16:58:48Z)
• Ontology Embedding: A Survey of Methods, Applications and Resources [54.3453925775069]
  Ontologies are widely used for representing domain knowledge and meta data. One straightforward solution is to integrate statistical analysis and machine learning. Numerous papers have been published on embedding, but a lack of systematic reviews hinders researchers from gaining a comprehensive understanding of this field.
  arXiv  Detail & Related papers  (2024-06-16T14:49:19Z)
• Categorical semiotics: Foundations for Knowledge Integration [0.0]
  We tackle the challenging task of developing a comprehensive framework for defining and analyzing deep learning architectures. Our methodology employs graphical structures that resemble Ehresmann's sketches, interpreted within a universe of fuzzy sets. This approach offers a unified theory that elegantly encompasses both deterministic and non-deterministic neural network designs.
  arXiv  Detail & Related papers  (2024-04-01T23:19:01Z)
• Knowledge-guided Machine Learning: Current Trends and Future Prospects [14.783972088722193]
  It also provides an introduction to the current state of research in the emerging field of scientific knowledge-guided machine learning (KGML) We discuss different facets of KGML research in terms of the type of scientific knowledge used, the form of knowledge-ML integration explored, and the method for incorporating scientific knowledge in ML.
  arXiv  Detail & Related papers  (2024-03-24T02:54:46Z)
• Symmetry-Informed Geometric Representation for Molecules, Proteins, and Crystalline Materials [66.14337835284628]
  We propose a platform, coined Geom3D, which enables benchmarking the effectiveness of geometric strategies. Geom3D contains 16 advanced symmetry-informed geometric representation models and 14 geometric pretraining methods over 46 diverse datasets.
  arXiv  Detail & Related papers  (2023-06-15T05:37:25Z)
• Constructing Neural Network-Based Models for Simulating Dynamical Systems [59.0861954179401]
  Data-driven modeling is an alternative paradigm that seeks to learn an approximation of the dynamics of a system using observations of the true system. This paper provides a survey of the different ways to construct models of dynamical systems using neural networks. In addition to the basic overview, we review the related literature and outline the most significant challenges from numerical simulations that this modeling paradigm must overcome.
  arXiv  Detail & Related papers  (2021-11-02T10:51:42Z)
• Paradigm Shift Through the Integration of Physical Methodology and Data Science [0.0]
  Methods that integrate traditional physical and data science methodologies are new methods of mathematical analysis. This paper highlights the significance and importance of such integrated methods from the viewpoint of scientific theory.
  arXiv  Detail & Related papers  (2021-09-30T18:00:09Z)
• An Extensible Benchmark Suite for Learning to Simulate Physical Systems [60.249111272844374]
  We introduce a set of benchmark problems to take a step towards unified benchmarks and evaluation protocols. We propose four representative physical systems, as well as a collection of both widely used classical time-based and representative data-driven methods.
  arXiv  Detail & Related papers  (2021-08-09T17:39:09Z)
• Machine Learning in Nano-Scale Biomedical Engineering [77.75587007080894]
  We review the existing research regarding the use of machine learning in nano-scale biomedical engineering. The main challenges that can be formulated as ML problems are classified into the three main categories. For each of the presented methodologies, special emphasis is given to its principles, applications, and limitations.
  arXiv  Detail & Related papers  (2020-08-05T15:45:54Z)
• Semantic interoperability based on the European Materials and Modelling Ontology and its ontological paradigm: Mereosemiotics [0.0]
  European Materials and Modelling Ontology (EMMO) has recently been advanced in the computational molecular engineering and multi-scale modelling communities as a top-level. This work explores how top-level that are based on the same paradigm - the same set of fundamental. ontologys - as the EMMO can be applied to. models of physical systems and their use in computational engineering practice.
  arXiv  Detail & Related papers  (2020-03-22T13:19:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.