Dataset’s chemical diversity limits the generalizability of machine learning predictions

Abstract The QM9 dataset has become the golden standard for Machine Learning (ML) predictions of various chemical properties. QM9 is based on the GDB, which is a combinatorial exploration of the chemical space. ML molecular predictions have been recently published with an accuracy on par with Densit...

Full description

Bibliographic Details
Main Authors: Marta Glavatskikh, Jules Leguy, Gilles Hunault, Thomas Cauchy, Benoit Da Mota
Format: Article
Language:English
Published: BMC 2019-11-01
Series:Journal of Cheminformatics
Subjects:
QM9
PC9
DFT
Online Access:http://link.springer.com/article/10.1186/s13321-019-0391-2
Description
Summary:Abstract The QM9 dataset has become the golden standard for Machine Learning (ML) predictions of various chemical properties. QM9 is based on the GDB, which is a combinatorial exploration of the chemical space. ML molecular predictions have been recently published with an accuracy on par with Density Functional Theory calculations. Such ML models need to be tested and generalized on real data. PC9, a new QM9 equivalent dataset (only H, C, N, O and F and up to 9 “heavy” atoms) of the PubChemQC project is presented in this article. A statistical study of bonding distances and chemical functions shows that this new dataset encompasses more chemical diversity. Kernel Ridge Regression, Elastic Net and the Neural Network model provided by SchNet have been used on both datasets. The overall accuracy in energy prediction is higher for the QM9 subset. However, a model trained on PC9 shows a stronger ability to predict energies of the other dataset.
ISSN:1758-2946