Stochastic Smoothing Methods for Nonsmooth Global Optimization

• Main Author: V.I. Norkin
• Format: Article
• Language: English
• Published: V.M. Glushkov Institute of Cybernetics 2020-03-01
• Series: Кібернетика та комп'ютерні технології
• Subjects: global optimization; steklov smoothing; averaged functions; stochastic optimization; nonsmooth nonconvex optimization
• Online Access: http://cctech.org.ua/13-vertikalnoe-menyu-en/89-abstract-20-1-1-arte
• ISSN: 2707-4501; 2707-451X

Abstract. The paper presents the results of testing the stochastic smoothing method for global optimization of a multiextremal function in a convex feasible subset of Euclidean space. Preliminarily, the objective function is extended outside the admissible region so that its global minimum does not change, and it becomes coercive. The smoothing of a function at any point is carried out by averaging the values of the function over some neighborhood of this point. The size of the neighborhood is a smoothing parameter. Smoothing eliminates small local extrema of the original function. With a sufficiently large value of the smoothing parameter, the averaged function can have only one minimum. The smoothing method consists in replacing the original function with a sequence of smoothed approximations with vanishing to zero smoothing parameter and optimization of the latter functions by contemporary stochastic optimization methods. Passing from the minimum of one smoothed function to a close minimum of the next smoothed function, we can gradually come to the region of the global minimum of the original function. The smoothing method is also applicable for the optimization of nonsmooth nonconvex functions. It is shown that the smoothing method steadily solves test global optimization problems of small dimensions from the literature.