Automated Online Experiment-Driven Adaptation–Mechanics and Cost Aspects

As modern software-intensive systems become larger, more complex, and more customizable, it is desirable to optimize their functionality by runtime adaptations. However, in most cases it is infeasible to fully model and predict their behavior in advance, which is a classical requirement of runtime s...

Full description

Bibliographic Details
Main Authors: Ilias Gerostathopoulos, Frantisek Plasil, Christian Prehofer, Janek Thomas, Bernd Bischl
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9399075/
id doaj-bb4fcc50d14e45abaf23b2ffe643b0e0
record_format Article
spelling doaj-bb4fcc50d14e45abaf23b2ffe643b0e02021-04-19T23:01:29ZengIEEEIEEE Access2169-35362021-01-019580795808710.1109/ACCESS.2021.30718099399075Automated Online Experiment-Driven Adaptation–Mechanics and Cost AspectsIlias Gerostathopoulos0https://orcid.org/0000-0001-9333-7101Frantisek Plasil1https://orcid.org/0000-0003-1910-8989Christian Prehofer2Janek Thomas3https://orcid.org/0000-0003-4511-6245Bernd Bischl4Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, HV, The NetherlandsDepartment of Distributed and Dependable Systems, Charles University in Prague, Prague, Czech RepublicDENSO Automotive Germany, Munich, GermanyDepartment of Informatics, Ludwig Maximilian University of Munich, Munich, GermanyDepartment of Informatics, Ludwig Maximilian University of Munich, Munich, GermanyAs modern software-intensive systems become larger, more complex, and more customizable, it is desirable to optimize their functionality by runtime adaptations. However, in most cases it is infeasible to fully model and predict their behavior in advance, which is a classical requirement of runtime self-adaptation. To address this problem, we propose their self-adaptation based on a sequence of online experiments carried out in a production environment. The key idea is to evaluate each experiment by data analysis and determine the next potential experiment via an optimization strategy. The feasibility of the approach is illustrated on a use case devoted to online self-adaptation of traffic navigation where Bayesian optimization, grid search, and local search are employed as the optimization strategies. Furthermore, the cost of the experiments is discussed and three key cost components are examined—time cost, adaptation cost, and endurability cost.https://ieeexplore.ieee.org/document/9399075/Experimentationoptimizationself-adaptation
collection DOAJ
language English
format Article
sources DOAJ
author Ilias Gerostathopoulos
Frantisek Plasil
Christian Prehofer
Janek Thomas
Bernd Bischl
spellingShingle Ilias Gerostathopoulos
Frantisek Plasil
Christian Prehofer
Janek Thomas
Bernd Bischl
Automated Online Experiment-Driven Adaptation–Mechanics and Cost Aspects
IEEE Access
Experimentation
optimization
self-adaptation
author_facet Ilias Gerostathopoulos
Frantisek Plasil
Christian Prehofer
Janek Thomas
Bernd Bischl
author_sort Ilias Gerostathopoulos
title Automated Online Experiment-Driven Adaptation–Mechanics and Cost Aspects
title_short Automated Online Experiment-Driven Adaptation–Mechanics and Cost Aspects
title_full Automated Online Experiment-Driven Adaptation–Mechanics and Cost Aspects
title_fullStr Automated Online Experiment-Driven Adaptation–Mechanics and Cost Aspects
title_full_unstemmed Automated Online Experiment-Driven Adaptation–Mechanics and Cost Aspects
title_sort automated online experiment-driven adaptation–mechanics and cost aspects
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description As modern software-intensive systems become larger, more complex, and more customizable, it is desirable to optimize their functionality by runtime adaptations. However, in most cases it is infeasible to fully model and predict their behavior in advance, which is a classical requirement of runtime self-adaptation. To address this problem, we propose their self-adaptation based on a sequence of online experiments carried out in a production environment. The key idea is to evaluate each experiment by data analysis and determine the next potential experiment via an optimization strategy. The feasibility of the approach is illustrated on a use case devoted to online self-adaptation of traffic navigation where Bayesian optimization, grid search, and local search are employed as the optimization strategies. Furthermore, the cost of the experiments is discussed and three key cost components are examined—time cost, adaptation cost, and endurability cost.
topic Experimentation
optimization
self-adaptation
url https://ieeexplore.ieee.org/document/9399075/
work_keys_str_mv AT iliasgerostathopoulos automatedonlineexperimentdrivenadaptationx2013mechanicsandcostaspects
AT frantisekplasil automatedonlineexperimentdrivenadaptationx2013mechanicsandcostaspects
AT christianprehofer automatedonlineexperimentdrivenadaptationx2013mechanicsandcostaspects
AT janekthomas automatedonlineexperimentdrivenadaptationx2013mechanicsandcostaspects
AT berndbischl automatedonlineexperimentdrivenadaptationx2013mechanicsandcostaspects
_version_ 1721519100382937088