ParticleGrid: Enabling Deep Learning using 3D Representation of Materials

• URL: http://arxiv.org/abs/2211.08506v1
• Date: Tue, 15 Nov 2022 21:03:34 GMT
• Title: ParticleGrid: Enabling Deep Learning using 3D Representation of Materials
• Authors: Shehtab Zaman, Ethan Ferguson, Cecile Pereira, Denis Akhiyarov, Mauricio Araya-Polo, Kenneth Chiu
• Abstract summary: We show the efficacy of 3D grids generated via $textitParticleGrid$ and accurately predict molecular energy properties using a 3D convolutional neural network. Our model is able to get 0.006 mean square error and nearly match the values calculated using computationally costly density functional theory.
• Score: 0.39146761527401425
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: From AlexNet to Inception, autoencoders to diffusion models, the development of novel and powerful deep learning models and learning algorithms has proceeded at breakneck speeds. In part, we believe that rapid iteration of model architecture and learning techniques by a large community of researchers over a common representation of the underlying entities has resulted in transferable deep learning knowledge. As a result, model scale, accuracy, fidelity, and compute performance have dramatically increased in computer vision and natural language processing. On the other hand, the lack of a common representation for chemical structure has hampered similar progress. To enable transferable deep learning, we identify the need for a robust 3-dimensional representation of materials such as molecules and crystals. The goal is to enable both materials property prediction and materials generation with 3D structures. While computationally costly, such representations can model a large set of chemical structures. We propose $\textit{ParticleGrid}$, a SIMD-optimized library for 3D structures, that is designed for deep learning applications and to seamlessly integrate with deep learning frameworks. Our highly optimized grid generation allows for generating grids on the fly on the CPU, reducing storage and GPU compute and memory requirements. We show the efficacy of 3D grids generated via $\textit{ParticleGrid}$ and accurately predict molecular energy properties using a 3D convolutional neural network. Our model is able to get 0.006 mean square error and nearly match the values calculated using computationally costly density functional theory at a fraction of the time.

Related papers

• UV Gaussians: Joint Learning of Mesh Deformation and Gaussian Textures for Human Avatar Modeling [71.87807614875497]
  We propose UV Gaussians, which models the 3D human body by jointly learning mesh deformations and 2D UV-space Gaussian textures. We collect and process a new dataset of human motion, which includes multi-view images, scanned models, parametric model registration, and corresponding texture maps. Experimental results demonstrate that our method achieves state-of-the-art synthesis of novel view and novel pose.
  arXiv  Detail & Related papers  (2024-03-18T09:03:56Z)
• 3D-QAE: Fully Quantum Auto-Encoding of 3D Point Clouds [71.39129855825402]
  Existing methods for learning 3D representations are deep neural networks trained and tested on classical hardware. This paper introduces the first quantum auto-encoder for 3D point clouds.
  arXiv  Detail & Related papers  (2023-11-09T18:58:33Z)
• Automated 3D Pre-Training for Molecular Property Prediction [54.15788181794094]
  We propose a novel 3D pre-training framework (dubbed 3D PGT) It pre-trains a model on 3D molecular graphs, and then fine-tunes it on molecular graphs without 3D structures. Extensive experiments on 2D molecular graphs are conducted to demonstrate the accuracy, efficiency and generalization ability of the proposed 3D PGT.
  arXiv  Detail & Related papers  (2023-06-13T14:43:13Z)
• 3D Molecular Geometry Analysis with 2D Graphs [79.47097907673877]
  Ground-state 3D geometries of molecules are essential for many molecular analysis tasks. Modern quantum mechanical methods can compute accurate 3D geometries but are computationally prohibitive. We propose a novel deep learning framework to predict 3D geometries from molecular graphs.
  arXiv  Detail & Related papers  (2023-05-01T19:00:46Z)
• Maximizing Spatio-Temporal Entropy of Deep 3D CNNs for Efficient Video Recognition [25.364148451584356]
  3D convolution neural networks (CNNs) have been the prevailing option for video recognition. We propose to automatically design efficient 3D CNN architectures via a novel training-free neural architecture search approach. Experiments on Something-Something V1&V2 and Kinetics400 demonstrate that the E3D family achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-03-05T15:11:53Z)
• 3D Infomax improves GNNs for Molecular Property Prediction [1.9703625025720701]
  We propose pre-training a model to reason about the geometry of molecules given only their 2D molecular graphs. We show that 3D pre-training provides significant improvements for a wide range of properties.
  arXiv  Detail & Related papers  (2021-10-08T13:30:49Z)
• Molecular machine learning with conformer ensembles [0.0]
  We introduce multiple deep learning models that expand upon key architectures such as ChemProp and Schnet. We then benchmark the performance trade-offs of these models on 2D, 3D and 4D representations in the prediction of drug activity. The new architectures perform significantly better than 2D models, but their performance is often just as strong with a single conformer as with many.
  arXiv  Detail & Related papers  (2020-12-15T17:44:48Z)
• 3DMaterialGAN: Learning 3D Shape Representation from Latent Space for Materials Science Applications [7.449993399792031]
  3DMaterialGAN is capable of recognizing and synthesizing individual grains whose morphology conforms to a given 3D polycrystalline material microstructure. We show that this method performs comparably or better than state-of-the-art on benchmark annotated 3D datasets. This framework lays the foundation for the recognition and synthesis of polycrystalline material microstructures.
  arXiv  Detail & Related papers  (2020-07-27T21:55:16Z)
• Deep Polynomial Neural Networks [77.70761658507507]
  $Pi$Nets are a new class of function approximators based on expansions. $Pi$Nets produce state-the-art results in three challenging tasks, i.e. image generation, face verification and 3D mesh representation learning.
  arXiv  Detail & Related papers  (2020-06-20T16:23:32Z)
• Learning Local Neighboring Structure for Robust 3D Shape Representation [143.15904669246697]
  Representation learning for 3D meshes is important in many computer vision and graphics applications. We propose a local structure-aware anisotropic convolutional operation (LSA-Conv) Our model produces significant improvement in 3D shape reconstruction compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-04-21T13:40:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.