Catalysis distillation neural network for the few shot open catalyst
challenge
- URL: http://arxiv.org/abs/2305.19545v1
- Date: Wed, 31 May 2023 04:23:56 GMT
- Title: Catalysis distillation neural network for the few shot open catalyst
challenge
- Authors: Bowen Deng
- Abstract summary: This paper introduces Few-Shot Open Catalyst Challenge 2023, a competition aimed at advancing the application of machine learning for predicting reactions.
We propose a machine learning approach based on a framework called Catalysis Distillation Graph Neural Network (CDGNN)
Our results demonstrate that CDGNN effectively learns embeddings from catalytic structures, enabling the capture of structure-adsorption relationships.
- Score: 1.1878820609988694
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The integration of artificial intelligence and science has resulted in
substantial progress in computational chemistry methods for the design and
discovery of novel catalysts. Nonetheless, the challenges of electrocatalytic
reactions and developing a large-scale language model in catalysis persist, and
the recent success of ChatGPT's (Chat Generative Pre-trained Transformer)
few-shot methods surpassing BERT (Bidirectional Encoder Representation from
Transformers) underscores the importance of addressing limited data, expensive
computations, time constraints and structure-activity relationship in research.
Hence, the development of few-shot techniques for catalysis is critical and
essential, regardless of present and future requirements. This paper introduces
the Few-Shot Open Catalyst Challenge 2023, a competition aimed at advancing the
application of machine learning technology for predicting catalytic reactions
on catalytic surfaces, with a specific focus on dual-atom catalysts in hydrogen
peroxide electrocatalysis. To address the challenge of limited data in
catalysis, we propose a machine learning approach based on MLP-Like and a
framework called Catalysis Distillation Graph Neural Network (CDGNN). Our
results demonstrate that CDGNN effectively learns embeddings from catalytic
structures, enabling the capture of structure-adsorption relationships. This
accomplishment has resulted in the utmost advanced and efficient determination
of the reaction pathway for hydrogen peroxide, surpassing the current graph
neural network approach by 16.1%.. Consequently, CDGNN presents a promising
approach for few-shot learning in catalysis.
Related papers
- Generative Language Model for Catalyst Discovery [0.0]
We introduce the Catalyst Generative Pretrained Transformer (CatGPT), trained to generate string representations of inorganic catalyst structures from a vast chemical space.
CatGPT not only demonstrates high performance in generating valid and accurate catalyst structures but also serves as a foundation model for generating desired types of catalysts.
arXiv Detail & Related papers (2024-07-19T05:34:08Z) - Adaptive Catalyst Discovery Using Multicriteria Bayesian Optimization with Representation Learning [17.00084254889438]
High-performance catalysts are crucial for sustainable energy conversion and human health.
The discovery of catalysts faces challenges due to the absence of efficient approaches to navigating vast and high-dimensional structure and composition spaces.
arXiv Detail & Related papers (2024-04-18T18:11:06Z) - UAlign: Pushing the Limit of Template-free Retrosynthesis Prediction with Unsupervised SMILES Alignment [51.49238426241974]
This paper introduces UAlign, a template-free graph-to-sequence pipeline for retrosynthesis prediction.
By combining graph neural networks and Transformers, our method can more effectively leverage the inherent graph structure of molecules.
arXiv Detail & Related papers (2024-03-25T03:23:03Z) - ChemReasoner: Heuristic Search over a Large Language Model's Knowledge Space using Quantum-Chemical Feedback [37.06094829713273]
Discovery of new catalysts is essential for the design of new and more efficient chemical processes.
We introduce an AI-guided computational screening framework unifying linguistic reasoning with quantum-chemistry based feedback from 3D atomistic representations.
arXiv Detail & Related papers (2024-02-15T21:33:07Z) - Platinum-based Catalysts for Oxygen Reduction Reaction simulated with a Quantum Computer [2.8866494528688555]
Hydrogen has emerged as a promising energy source, holding the key to achieve low-carbon and sustainable mobility.
Here, we present a pioneering study that combines classical and quantum computational approaches to investigate the ORR on pure platinum and platinum/cobalt surfaces.
Results highlight the involvement of strongly correlated species in the cobalt-containing catalyst, suggesting their potential as ideal candidates for showcasing quantum advantage in future applications.
arXiv Detail & Related papers (2023-07-28T21:49:00Z) - DR-Label: Improving GNN Models for Catalysis Systems by Label
Deconstruction and Reconstruction [72.20024514713633]
We present a novel graph neural network (GNN) supervision and prediction strategy DR-Label.
The strategy enhances the supervision signal, reduces the multiplicity of solutions in edge representation, and encourages the model to provide node predictions robust.
DR-Label was applied to three radically distinct models, each of which displayed consistent performance enhancements.
arXiv Detail & Related papers (2023-03-06T04:01:28Z) - PhAST: Physics-Aware, Scalable, and Task-specific GNNs for Accelerated
Catalyst Design [102.9593507372373]
Catalyst materials play a crucial role in the electrochemical reactions involved in industrial processes.
Machine learning holds the potential to efficiently model materials properties from large amounts of data.
We propose task-specific innovations applicable to most architectures, enhancing both computational efficiency and accuracy.
arXiv Detail & Related papers (2022-11-22T05:24:30Z) - Multi-Task Mixture Density Graph Neural Networks for Predicting Cu-based
Single-Atom Alloy Catalysts for CO2 Reduction Reaction [61.9212585617803]
Graph neural networks (GNNs) have drawn more and more attention from material scientists.
We develop a multi-task (MT) architecture based on DimeNet++ and mixture density networks to improve the performance of such task.
arXiv Detail & Related papers (2022-09-15T13:52:15Z) - Boosting Heterogeneous Catalyst Discovery by Structurally Constrained
Deep Learning Models [0.0]
Deep learning approaches such as graph neural networks (GNNs) open new opportunity to significantly extend scope for modelling novel high-performance catalysts.
Here we present embedding improvement for GNN that has been modified by Voronoi tesselation.
We show that a sensible choice of data can decrease the error to values above physically-based 20 meV per atom threshold.
arXiv Detail & Related papers (2022-07-11T17:01:28Z) - Self-Improved Retrosynthetic Planning [66.5397931294144]
Retrosynthetic planning is a fundamental problem in chemistry for finding a pathway of reactions to synthesize a target molecule.
Recent search algorithms have shown promising results for solving this problem by using deep neural networks (DNNs)
We propose an end-to-end framework for directly training the DNNs towards generating reaction pathways with the desirable properties.
arXiv Detail & Related papers (2021-06-09T08:03:57Z) - Learning To Navigate The Synthetically Accessible Chemical Space Using
Reinforcement Learning [75.95376096628135]
We propose a novel forward synthesis framework powered by reinforcement learning (RL) for de novo drug design.
In this setup, the agent learns to navigate through the immense synthetically accessible chemical space.
We describe how the end-to-end training in this study represents an important paradigm in radically expanding the synthesizable chemical space.
arXiv Detail & Related papers (2020-04-26T21:40:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.