A machine learning approach for efficient multi-dimensional integration

Abstract Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in s...

Full description

Bibliographic Details
Main Author: Boram Yoon
Format: Article
Language:English
Published: Nature Publishing Group 2021-09-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-021-98392-z
id doaj-d6f6aeb2505749ccbcc8199689dc48fa
record_format Article
spelling doaj-d6f6aeb2505749ccbcc8199689dc48fa2021-09-26T11:28:15ZengNature Publishing GroupScientific Reports2045-23222021-09-011111810.1038/s41598-021-98392-zA machine learning approach for efficient multi-dimensional integrationBoram Yoon0CCS-7, Computer, Computational and Statistical Sciences Division, Los Alamos National LaboratoryAbstract Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in solving the physics problems. We propose a novel numerical multi-dimensional integration algorithm using machine learning (ML). After training a ML regression model to mimic a target integrand, the regression model is used to evaluate an approximation of the integral. Then, the difference between the approximation and the true answer is calculated to correct the bias in the approximation of the integral induced by ML prediction errors. Because of the bias correction, the final estimate of the integral is unbiased and has a statistically correct error estimation. Three ML models of multi-layer perceptron, gradient boosting decision tree, and Gaussian process regression algorithms are investigated. The performance of the proposed algorithm is demonstrated on six different families of integrands that typically appear in physics problems at various dimensions and integrand difficulties. The results show that, for the same total number of integrand evaluations, the new algorithm provides integral estimates with more than an order of magnitude smaller uncertainties than those of the VEGAS algorithm in most of the test cases.https://doi.org/10.1038/s41598-021-98392-z
collection DOAJ
language English
format Article
sources DOAJ
author Boram Yoon
spellingShingle Boram Yoon
A machine learning approach for efficient multi-dimensional integration
Scientific Reports
author_facet Boram Yoon
author_sort Boram Yoon
title A machine learning approach for efficient multi-dimensional integration
title_short A machine learning approach for efficient multi-dimensional integration
title_full A machine learning approach for efficient multi-dimensional integration
title_fullStr A machine learning approach for efficient multi-dimensional integration
title_full_unstemmed A machine learning approach for efficient multi-dimensional integration
title_sort machine learning approach for efficient multi-dimensional integration
publisher Nature Publishing Group
series Scientific Reports
issn 2045-2322
publishDate 2021-09-01
description Abstract Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in solving the physics problems. We propose a novel numerical multi-dimensional integration algorithm using machine learning (ML). After training a ML regression model to mimic a target integrand, the regression model is used to evaluate an approximation of the integral. Then, the difference between the approximation and the true answer is calculated to correct the bias in the approximation of the integral induced by ML prediction errors. Because of the bias correction, the final estimate of the integral is unbiased and has a statistically correct error estimation. Three ML models of multi-layer perceptron, gradient boosting decision tree, and Gaussian process regression algorithms are investigated. The performance of the proposed algorithm is demonstrated on six different families of integrands that typically appear in physics problems at various dimensions and integrand difficulties. The results show that, for the same total number of integrand evaluations, the new algorithm provides integral estimates with more than an order of magnitude smaller uncertainties than those of the VEGAS algorithm in most of the test cases.
url https://doi.org/10.1038/s41598-021-98392-z
work_keys_str_mv AT boramyoon amachinelearningapproachforefficientmultidimensionalintegration
AT boramyoon machinelearningapproachforefficientmultidimensionalintegration
_version_ 1716868046862155776