An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method

During the last years, kriging has become one of the most popular methods in computer simulation and machine learning. Kriging models have been successfully used in many engineering applications, to approximate expensive simulation models. When many input variables are used, kriging is inefficient m...

Full description

Bibliographic Details
Main Authors: Mohamed Amine Bouhlel, Nathalie Bartoli, Abdelkader Otsmane, Joseph Morlier
Format: Article
Language:English
Published: Hindawi Limited 2016-01-01
Series:Mathematical Problems in Engineering
Online Access:http://dx.doi.org/10.1155/2016/6723410
id doaj-744a6f2819c4430c90957520cd4718ad
record_format Article
spelling doaj-744a6f2819c4430c90957520cd4718ad2020-11-24T20:49:48ZengHindawi LimitedMathematical Problems in Engineering1024-123X1563-51472016-01-01201610.1155/2016/67234106723410An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares MethodMohamed Amine Bouhlel0Nathalie Bartoli1Abdelkader Otsmane2Joseph Morlier3Department of Aerospace Engineering, University of Michigan, 1320 Beal Avenue, Ann Arbor, MI 48109, USAONERA, 2 Avenue Édouard Belin, 31055 Toulouse, FranceSNECMA, Rond-Point René Ravaud-Réau, 77550 Moissy-Cramayel, FranceInstitut Clément Ader, CNRS, ISAE-SUPAERO, Université de Toulouse, 10 Avenue Edouard Belin, 31055 Toulouse Cedex 4, FranceDuring the last years, kriging has become one of the most popular methods in computer simulation and machine learning. Kriging models have been successfully used in many engineering applications, to approximate expensive simulation models. When many input variables are used, kriging is inefficient mainly due to an exorbitant computational time required during its construction. To handle high-dimensional problems (100+), one method is recently proposed that combines kriging with the Partial Least Squares technique, the so-called KPLS model. This method has shown interesting results in terms of saving CPU time required to build model while maintaining sufficient accuracy, on both academic and industrial problems. However, KPLS has provided a poor accuracy compared to conventional kriging on multimodal functions. To handle this issue, this paper proposes adding a new step during the construction of KPLS to improve its accuracy for multimodal functions. When the exponential covariance functions are used, this step is based on simple identification between the covariance function of KPLS and kriging. The developed method is validated especially by using a multimodal academic function, known as Griewank function in the literature, and we show the gain in terms of accuracy and computer time by comparing with KPLS and kriging.http://dx.doi.org/10.1155/2016/6723410
collection DOAJ
language English
format Article
sources DOAJ
author Mohamed Amine Bouhlel
Nathalie Bartoli
Abdelkader Otsmane
Joseph Morlier
spellingShingle Mohamed Amine Bouhlel
Nathalie Bartoli
Abdelkader Otsmane
Joseph Morlier
An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method
Mathematical Problems in Engineering
author_facet Mohamed Amine Bouhlel
Nathalie Bartoli
Abdelkader Otsmane
Joseph Morlier
author_sort Mohamed Amine Bouhlel
title An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method
title_short An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method
title_full An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method
title_fullStr An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method
title_full_unstemmed An Improved Approach for Estimating the Hyperparameters of the Kriging Model for High-Dimensional Problems through the Partial Least Squares Method
title_sort improved approach for estimating the hyperparameters of the kriging model for high-dimensional problems through the partial least squares method
publisher Hindawi Limited
series Mathematical Problems in Engineering
issn 1024-123X
1563-5147
publishDate 2016-01-01
description During the last years, kriging has become one of the most popular methods in computer simulation and machine learning. Kriging models have been successfully used in many engineering applications, to approximate expensive simulation models. When many input variables are used, kriging is inefficient mainly due to an exorbitant computational time required during its construction. To handle high-dimensional problems (100+), one method is recently proposed that combines kriging with the Partial Least Squares technique, the so-called KPLS model. This method has shown interesting results in terms of saving CPU time required to build model while maintaining sufficient accuracy, on both academic and industrial problems. However, KPLS has provided a poor accuracy compared to conventional kriging on multimodal functions. To handle this issue, this paper proposes adding a new step during the construction of KPLS to improve its accuracy for multimodal functions. When the exponential covariance functions are used, this step is based on simple identification between the covariance function of KPLS and kriging. The developed method is validated especially by using a multimodal academic function, known as Griewank function in the literature, and we show the gain in terms of accuracy and computer time by comparing with KPLS and kriging.
url http://dx.doi.org/10.1155/2016/6723410
work_keys_str_mv AT mohamedaminebouhlel animprovedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod
AT nathaliebartoli animprovedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod
AT abdelkaderotsmane animprovedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod
AT josephmorlier animprovedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod
AT mohamedaminebouhlel improvedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod
AT nathaliebartoli improvedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod
AT abdelkaderotsmane improvedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod
AT josephmorlier improvedapproachforestimatingthehyperparametersofthekrigingmodelforhighdimensionalproblemsthroughthepartialleastsquaresmethod
_version_ 1716805665766244352