Molecular Dynamics Simulations on Cloud Computing and Machine Learning Platforms

• URL: http://arxiv.org/abs/2111.06466v1
• Date: Thu, 11 Nov 2021 21:20:26 GMT
• Title: Molecular Dynamics Simulations on Cloud Computing and Machine Learning Platforms
• Authors: Prateek Sharma and Vikram Jadhao
• Abstract summary: We see a paradigm shift in the computational structure, design, and requirements of scientific computing applications. Data-driven and machine learning approaches are being used to support, speed-up, and enhance scientific computing applications. Cloud computing platforms are increasingly appealing for scientific computing.
• Score: 0.8093262393618671
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Scientific computing applications have benefited greatly from high performance computing infrastructure such as supercomputers. However, we are seeing a paradigm shift in the computational structure, design, and requirements of these applications. Increasingly, data-driven and machine learning approaches are being used to support, speed-up, and enhance scientific computing applications, especially molecular dynamics simulations. Concurrently, cloud computing platforms are increasingly appealing for scientific computing, providing "infinite" computing powers, easier programming and deployment models, and access to computing accelerators such as TPUs (Tensor Processing Units). This confluence of machine learning (ML) and cloud computing represents exciting opportunities for cloud and systems researchers. ML-assisted molecular dynamics simulations are a new class of workload, and exhibit unique computational patterns. These simulations present new challenges for low-cost and high-performance execution. We argue that transient cloud resources, such as low-cost preemptible cloud VMs, can be a viable platform for this new workload. Finally, we present some low-hanging fruits and long-term challenges in cloud resource management, and the integration of molecular dynamics simulations into ML platforms (such as TensorFlow).

Related papers

• Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native [46.7766555589807]
  We describe an AI-native computing paradigm that harnesses the power of both cloudnative technologies and advanced machine learning inference. These joint efforts aim to optimize costs-of-goods-sold (COGS) and improve resource accessibility.
  arXiv  Detail & Related papers  (2024-01-17T20:34:11Z)
• Federated Fine-Tuning of LLMs on the Very Edge: The Good, the Bad, the Ugly [62.473245910234304]
  This paper takes a hardware-centric approach to explore how Large Language Models can be brought to modern edge computing systems. We provide a micro-level hardware benchmark, compare the model FLOP utilization to a state-of-the-art data center GPU, and study the network utilization in realistic conditions.
  arXiv  Detail & Related papers  (2023-10-04T20:27:20Z)
• In Situ Framework for Coupling Simulation and Machine Learning with Application to CFD [51.04126395480625]
  Recent years have seen many successful applications of machine learning (ML) to facilitate fluid dynamic computations. As simulations grow, generating new training datasets for traditional offline learning creates I/O and storage bottlenecks. This work offers a solution by simplifying this coupling and enabling in situ training and inference on heterogeneous clusters.
  arXiv  Detail & Related papers  (2023-06-22T14:07:54Z)
• Sim2real Transfer Learning for Point Cloud Segmentation: An Industrial Application Case on Autonomous Disassembly [55.41644538483948]
  We present an industrial application case that uses sim2real transfer learning for point cloud data. We provide insights on how to generate and process synthetic point cloud data. A novel patch-based attention network is proposed additionally to tackle this problem.
  arXiv  Detail & Related papers  (2023-01-12T14:00:37Z)
• Advancing Reacting Flow Simulations with Data-Driven Models [50.9598607067535]
  Key to effective use of machine learning tools in multi-physics problems is to couple them to physical and computer models. The present chapter reviews some of the open opportunities for the application of data-driven reduced-order modeling of combustion systems.
  arXiv  Detail & Related papers  (2022-09-05T16:48:34Z)
• Case study of SARS-CoV-2 transmission risk assessment in indoor environments using cloud computing resources [1.3150679728390269]
  We showcase how a complex computational framework can be abstracted and deployed on cloud services. We deploy the simulation framework on the Azure cloud framework, utilizing the Dendro-kT mesh generation tool and PETSc solvers. We compare the performance of the cloud machines with state-of-the-art HPC machine TACC Frontera.
  arXiv  Detail & Related papers  (2021-11-17T19:28:18Z)
• Edge-Cloud Polarization and Collaboration: A Comprehensive Survey [61.05059817550049]
  We conduct a systematic review for both cloud and edge AI. We are the first to set up the collaborative learning mechanism for cloud and edge modeling. We discuss potentials and practical experiences of some on-going advanced edge AI topics.
  arXiv  Detail & Related papers  (2021-11-11T05:58:23Z)
• Machine Learning Algorithms for Active Monitoring of High Performance Computing as a Service (HPCaaS) Cloud Environments [0.0]
  This paper explores the viability of engineering applications running on a cloud infrastructure configured as an HPC platform. The engineering applications considered in this work include MCNP6, a radiation transport code developed by Los Alamos National Laboratory, OpenFOAM, an open source computational fluid dynamics code, and CADONFS, a numerical implementation of the general number field sieve algorithm used for prime number factorization.
  arXiv  Detail & Related papers  (2020-09-26T01:29:19Z)
• Integrating Machine Learning with HPC-driven Simulations for Enhanced Student Learning [0.0]
  We develop a web application that supports both HPC-driven simulation and the ML surrogate methods to produce simulation outputs. The evaluation of the tool via in-classroom student feedback and surveys shows that the ML-enhanced tool provides a dynamic and responsive simulation environment.
  arXiv  Detail & Related papers  (2020-08-24T22:48:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.