Directed Message Passing Based on Attention for Prediction of Molecular Properties - Université Paris Cité Accéder directement au contenu
Article Dans Une Revue Computational Materials Science Année : 2023

Directed Message Passing Based on Attention for Prediction of Molecular Properties

Résumé

Molecular representation learning (MRL) has long been crucial in the fields of drug discovery and materials science, and it has made significant progress due to the development of natural language processing (NLP) and graph neural networks (GNNs). NLP treats the molecules as one dimensional sequential tokens while GNNs treat them as two dimensional topology graphs. Based on different message passing algorithms, GNNs have various performance on detecting chemical environments and predicting molecular properties. Herein, we propose Directed Graph Attention Networks (D-GATs): the expressive GNNs with directed bonds. The key to the success of our strategy is to treat the molecular graph as directed graph and update the bond states and atom states by scaled dot-product attention mechanism. This allows the model to better capture the sub-structure of molecular graph, i.e., functional groups. Compared to other GNNs or Message Passing Neural Networks (MPNNs), D-GATs outperform the state-of-the-art on 13 out of 15 important molecular property prediction benchmarks.
Fichier principal
Vignette du fichier
D-GATs.pdf (1.66 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04100403 , version 1 (22-05-2023)
hal-04100403 , version 2 (23-05-2023)

Identifiants

Citer

Chen Gong, Yvon Maday. Directed Message Passing Based on Attention for Prediction of Molecular Properties. Computational Materials Science, In press. ⟨hal-04100403v2⟩
32 Consultations
68 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More