An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method
During the last years, kriging has become one of the most popular methods in computer simulation and machine learning. Kriging models have been successfully used in many engineering applications, to approximate expensive simulation models. When many input variables are used, kriging is inefficient m...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2016-01-01
|
Series: | Mathematical Problems in Engineering |
Online Access: | http://dx.doi.org/10.1155/2016/6723410 |
id |
doaj-744a6f2819c4430c90957520cd4718ad |
---|---|
record_format |
Article |
spelling |
doaj-744a6f2819c4430c90957520cd4718ad2020-11-24T20:49:48ZengHindawi LimitedMathematical Problems in Engineering1024-123X1563-51472016-01-01201610.1155/2016/67234106723410An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares MethodMohamed Amine Bouhlel0Nathalie Bartoli1Abdelkader Otsmane2Joseph Morlier3Department of Aerospace Engineering, University of Michigan, 1320 Beal Avenue, Ann Arbor, MI 48109, USAONERA, 2 Avenue Édouard Belin, 31055 Toulouse, FranceSNECMA, Rond-Point René Ravaud-Réau, 77550 Moissy-Cramayel, FranceInstitut Clément Ader, CNRS, ISAE-SUPAERO, Université de Toulouse, 10 Avenue Edouard Belin, 31055 Toulouse Cedex 4, FranceDuring the last years, kriging has become one of the most popular methods in computer simulation and machine learning. Kriging models have been successfully used in many engineering applications, to approximate expensive simulation models. When many input variables are used, kriging is inefficient mainly due to an exorbitant computational time required during its construction. To handle high-dimensional problems (100+), one method is recently proposed that combines kriging with the Partial Least Squares technique, the so-called KPLS model. This method has shown interesting results in terms of saving CPU time required to build model while maintaining sufficient accuracy, on both academic and industrial problems. However, KPLS has provided a poor accuracy compared to conventional kriging on multimodal functions. To handle this issue, this paper proposes adding a new step during the construction of KPLS to improve its accuracy for multimodal functions. When the exponential covariance functions are used, this step is based on simple identification between the covariance function of KPLS and kriging. The developed method is validated especially by using a multimodal academic function, known as Griewank function in the literature, and we show the gain in terms of accuracy and computer time by comparing with KPLS and kriging.http://dx.doi.org/10.1155/2016/6723410 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Mohamed Amine Bouhlel Nathalie Bartoli Abdelkader Otsmane Joseph Morlier |
spellingShingle |
Mohamed Amine Bouhlel Nathalie Bartoli Abdelkader Otsmane Joseph Morlier An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method Mathematical Problems in Engineering |
author_facet |
Mohamed Amine Bouhlel Nathalie Bartoli Abdelkader Otsmane Joseph Morlier |
author_sort |
Mohamed Amine Bouhlel |
title |
An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method |
title_short |
An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method |
title_full |
An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method |
title_fullStr |
An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method |
title_full_unstemmed |
An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method |
title_sort |
improved approach for estimating the hyperparameters of the kriging model for high-dimensional problems through the partial least squares method |
publisher |
Hindawi Limited |
series |
Mathematical Problems in Engineering |
issn |
1024-123X 1563-5147 |
publishDate |
2016-01-01 |
description |
During the last years, kriging has become one of the most popular methods in computer simulation and machine learning. Kriging models have been successfully used in many engineering applications, to approximate expensive simulation models. When many input variables are used, kriging is inefficient mainly due to an exorbitant computational time required during its construction. To handle high-dimensional problems (100+), one method is recently proposed that combines kriging with the Partial Least Squares technique, the so-called KPLS model. This method has shown interesting results in terms of saving CPU time required to build model while maintaining sufficient accuracy, on both academic and industrial problems. However, KPLS has provided a poor accuracy compared to conventional kriging on multimodal functions. To handle this issue, this paper proposes adding a new step during the construction of KPLS to improve its accuracy for multimodal functions. When the exponential covariance functions are used, this step is based on simple identification between the covariance function of KPLS and kriging. The developed method is validated especially by using a multimodal academic function, known as Griewank function in the literature, and we show the gain in terms of accuracy and computer time by comparing with KPLS and kriging. |
url |
http://dx.doi.org/10.1155/2016/6723410 |
work_keys_str_mv |
AT mohamedaminebouhlel animprovedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod AT nathaliebartoli animprovedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod AT abdelkaderotsmane animprovedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod AT josephmorlier animprovedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod AT mohamedaminebouhlel improvedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod AT nathaliebartoli improvedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod AT abdelkaderotsmane improvedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod AT josephmorlier improvedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod |
_version_ |
1716805665766244352 |