Can OneMax help optimizing LeadingOnes using the EA+RL method?
نویسندگان
چکیده
There exist optimization problems with the target objective, which is to be optimized, and several extra objectives, which can be helpful in the optimization process. The EA+RL method is designed to control optimization algorithms which solve problems with extra objectives. The method is based on the use of reinforcement learning for adaptive online selection of objectives. In this paper we investigate whether ONEMAX helps to optimize LEADINGONES when the EA+RL method is used. We consider LEADINGONES+ONEMAX problem where the target objective is LEADINGONES and the only extra objective is ONEMAX. The following theoretical results are proven for the expected running times when optimization starts from a random vector in the case of randomized local search (RLS): n/2 for LEADINGONES, n/3 for LEADINGONES+ONEMAX when reinforcement learning state is equal to the LEADINGONES fitness or when random objective selection is performed, and n/4+o(n) when there is one reinforcement learning state and the greedy exploration strategy is used. The case of starting with all bits set to zero is also considered. So, ONEMAX helps, although not too much, to optimize LEADINGONES when RLS is used. However, it is not true when using the (1 + 1) evolutionary algorithm, which is shown experimentally.
منابع مشابه
Runtime Analysis of Random Local Search with Reinforcement Based Selection of Non-stationary Auxiliary Objectives: Initial Study
It has been shown that single-objective optimization may be improved by introducing auxiliary objectives. In theoretical studies, auxiliary objectives are usually designed to be helpful. However, in practice, some of the auxiliary objectives may change their properties during optimization process. Such objectives may be efficient and obstructive at different steps of optimization. We analyse EA...
متن کاملRuntime Analysis of (1+1) Evolutionary Algorithm Controlled with Q-learning Using Greedy Exploration Strategy on OneMax+ZeroMax Problem
There exist optimization problems with the target objective, which is to be optimized, and several extra objectives. The extra objectives may or may not be helpful in optimization process in terms of the number of objective evaluations necessary to reach an optimum of the target objective. OneMax+ZeroMax is a previously proposed benchmark optimization problem where the target objective is OneMa...
متن کاملA Lower Bound Analysis of Population-Based Evolutionary Algorithms for Pseudo-Boolean Functions
Evolutionary algorithms (EAs) are population-based general-purpose optimization algorithms, and have been successfully applied in various real-world optimization tasks. However, previous theoretical studies often employ EAs with only a parent or offspring population and focus on specific problems. Furthermore, they often only show upper bounds on the running time, while lower bounds are also ne...
متن کاملTowards Analyzing Crossover Operators in Evolutionary Search via General Markov Chain Switching Theorem
Evolutionary algorithms (EAs), simulating the evolution process of natural species, are used to solve optimization problems. Crossover (also called recombination), originated from simulating the chromosomeexchange phenomena in zoogamy reproduction, is widely employed in EAs to generate offspring solutions, of which the effectiveness has been examined empirically in applications. However, due to...
متن کاملOn the Effectiveness of Sampling for Evolutionary Optimization in Noisy Environments
In real-world optimization tasks, the objective (i.e., fitness) function evaluation is often disturbed by noise due to a wide range of uncertainties. Evolutionary algorithms are often employed in noisy optimization, where reducing the negative effect of noise is a crucial issue. Sampling is a popular strategy for dealing with noise: to estimate the fitness of a solution, it evaluates the fitnes...
متن کامل