Abstract
Dynamic multiobjective optimization deals with simultaneous optimization of multiple conflicting objectives that change over time. Several response strategies for dynamic optimization have been proposed, which do not work well for all types of environmental changes. In this article, we propose a new dynamic multiobjective evolutionary algorithm based on objective space decomposition, in which the maxi-min fitness function is adopted for selection and a self-adaptive response strategy integrating a number of different response strategies is designed to handle unknown environmental changes. The self-adaptive response strategy can adaptively select one of the strategies according to their contributions to the tracking performance in the previous environments. Experimental results indicate that the proposed algorithm is competitive and promising for solving different DMOPs in the presence of unknown environmental changes. Meanwhile, the proposed algorithm is applied to solve the parameter tuning problem of a proportional integral derivative (PID) controller of a dynamic system, obtaining better control effect.
1 Introduction
Over the past years, a number of evolutionary algorithms have been proposed to solve multiobjective optimization problems (MOPs) that involve two or more conflicting objectives (Coello Coello, 2002; Deb et al., 2002; Fonseca and Fleming, 1993; Zhang and Li, 2007; Zhang et al., 2008; Zitzler et al., 2002). Many MOPs in the real world, however, are subject to various types of uncertainty, resulting in time-varying objective and / or constraint functions (Deb et al., 2007). These MOPs are referred to as dynamic multiobjective optimizations problems (DMOPs). In recent years, increasing attention has been paid to solving DMOPs in the real world, such as path planning (Michalewicz et al., 2007), evolutionary robotics (Tinós and Yang, 2007), and financial optimization problems (Tezuka et al., 2007).
The goal of a dynamic multiobjective optimization algorithm is to track the changing Pareto-optimal set (PS) (Pelosi and Selleri, 2014). In order to efficiently solve DMOPs, two basic requirements need to be considered. First, the algorithm should be able to effectively respond to environmental changes. Second, the algorithm is able to quickly find the PS of the current environment before the next change occurs. Recently, a large number of dynamic multiobjective evolutionary algorithms have been proposed (Jiang and Yang, 2017b; Zhou et al., 2014, 2007), which, however, usually perform well only for specific types of environmental changes. To address this issue, this article proposes a self-adaptive response strategy (SRS) that is able to adaptively select different response strategies for different environmental changes according to the contribution of each response strategy. We adopt a multiobjective evolutionary algorithm based on objective space decomposition (MOEA-OSD) as the basic optimizer. Therefore, the entire algorithm combining MOEA-OSD with SRS is called MOEA-OSD/SRS.
Note that the main new contribution of MOEA-OSD/SRS lies in SRS, which integrates several popular response strategies, including random diversity introduction (RDI) (Deb et al., 2007), mutational diversity introduction (MDI) (Deb et al., 2007), linear prediction strategy (LPS) (Zhou et al., 2007), feed-forward prediction strategy (FPS) (Hatzakis and Wallace, 2006), and population prediction strategy (PPS) (Zhou et al., 2014). By adding different labels, individuals generated by different response strategies can be traced, and their contributions in the previous environments can be recorded. Once the environment changes, the probability at which each response strategy is selected in the new environment is determined according to its contribution in the previous environments, making the proposed algorithm adaptive to unknown environmental changes.
In order to quickly find the PS of the current environment before the next environmental change occurs, MOEA-OSD is adopted as the basic static multiobjective evolutionary algorithm. MOEA-OSD decomposes the objective space of the MOP into a number of subobjective spaces using a set of uniformly distributed reference vectors. The reference vectors are generated uniformly in the objective space, evenly dividing the objective space into a number of subobjective spaces. The subobjective spaces are treated as an external archive, and the corresponding historical optimal solutions of each reference vector are stored in the corresponding subobjective space. Owing to the evenly divided subobjective spaces, the algorithm can naturally maintain a good diversity. In addition, the algorithm adopts the maxi-min fitness function (Balling, 2003) to calculate the fitness value of each solution, which is believed to be able to simultaneously account for both convergence and diversity of the solutions.
To examine the performance of MOEA-OSD/SRS, three sets of comprehensive empirical studies are performed, including a comparison of SRS with other six effective response strategies, a comparison of MOEA-OSD/SRS with other seven state-of-the-art dynamic multiobjective optimization algorithms, and a comparison of MOEA-OSD with other six multiobjective evolutionary algorithms. Meanwhile, MOEA-OSD/SRS is employed to tune the parameters of a proportional integral derivative (PID) controller for a dynamic system.
The rest of this article is organized as follows. Section 2 presents a brief review of response strategies considered in the current work. The proposed MOEA-OSD/SRS is presented in detail in Section 3. Section 4 introduces the benchmark functions, parameter settings, and performance metrics, followed by a detailed description of the experimental results and analysis. Section 5 applies MOEA-OSD/SRS to optimize the parameters of a PID controller of a dynamic system. Finally, Section 6 draws a conclusion of the work and suggests future research.
2 Background
This section briefly discusses the related work on solving DMOPs and provides a detailed review of the widely used response strategies.
Comprehensive reviews of research on solving DMOPs can be found in Cruz et al. (2011), Goh and Tan (2009b), Helbig and Engelbrecht (2014), Jin and Branke (2005), Nguyen et al. (2012), and Raquel and Yao (2013). Evolutionary algorithms (Avdagić et al., 2009; Jiang and Yang, 2017b; Wu et al., 2015; Zeng et al., 2006), particle swarm optimization algorithms (Greeff and Engelbrecht, 2008, 2010; Helbig and Engelbrecht, 2011, 2012, 2013b; Rong et al., 2018; Salazar Lechuga, 2009), and immune algorithms (Shang et al., 2005, 2014) have been used to solve DMOPs. In addition, cooperative co-evolutionary algorithms have been designed for dynamic multiobjective optimization (Goh and Tan, 2009a; Liu, Chen et al., 2014).
While they have shown better performance in solving static MOPs (Chang et al., 2008; Ishibuchi et al., 2009; Li and Zhang, 2009; Liu and Niu, 2013; Yuen and Ramli, 2010; Zhang and Li, 2007), decomposition-based MOEAs have hardly been used to solve DMOPs. To fill the gap, this work adopts a dynamic multiobjective optimization algorithm based on objective space decomposition.
For a multiobjective optimization algorithm to be capable of solving DMOPs, four basic approaches to responding to environmental changes have been investigated. These approaches are typically used for generating the initial population in the new environment. We review the widely used DMOAs with respect to the adopted response strategy in greater detail.
2.1 Diversity Introduction Strategy
When solving a DMOP, it becomes difficult for an optimization algorithm to quickly locate the global optimum usually due to the lack of diversity in the population when an environmental change occurs. Thus, it is helpful to introduce diversity when environmental changes are detected (Cobb, 1990; Deb et al., 2007; Goh and Tan, 2009a; Greeff and Engelbrecht, 2008; Jin and Branke, 2005; Liu et al., 2017; Vavak et al., 1997).
Two typical diversity introduction strategies are proposed by Deb et al. (2007). In one of the approaches, a certain proportion of the individuals in the population are replaced by randomly generated individuals, which is referred to as DNSGA-II-A. In the other approach, a certain proportion of the individuals in the population are mutated, known as DNSGA-II-B.
The diversity introduction strategy is simple and easy to implement, but it responds to environmental changes fairly arbitrarily, which may mislead the evolutionary search. Meanwhile, the proportion of diversity introduction has a great impact on the performance of the algorithm.
2.2 Diversity Maintenance Strategy
Diversity maintenance strategies (Bui et al., 2005; Grefenstette et al., 1992; Morrison, 2002; Zeng et al., 2006) aim to maintain a certain degree of diversity of the population in the process of evolutionary optimization. For instance, Zeng et al. (2006) proposed a dynamic multiobjective evolutionary algorithm based on an orthogonal evolutionary algorithm (DOMOEA) to solve continuous DMOPs. The idea is simply to adopt the optimal solutions of the previous environment to initialize the population in the new environment. This strategy is therefore computationally very efficient.
Unfortunately, diversity maintenance strategies are mainly suited for solving continuous optimization problems. They are good for solving DMOPs with minor environmental changes, but may perform poorly when the changes are severe.
2.3 Prediction-Based Strategy
If there is a certain relationship between the optimal solutions in the new environment and those in the previous environments, it is desirable to predict the location of the new optimal solutions and include them in the initial population for the new environment. Hatzakis and Wallace (2006) proposed a forward-looking approach as the response mechanism. Once an environmental change is detected, the position of the optimal solution in the new environment is predicted by using an autoregressive model. Zhou et al. (2007) proposed a prediction-based reinitialization strategy (PRI). In PRI, two strategies are introduced when an environmental change is detected. The first strategy is to predict the new position of each individual in the population according to its previous position change. The second strategy is to perturb the current population with Gaussian noise. PRI was further extended in Zhou et al. (2014) by suggesting a prediction strategy based on the whole population (PPS). In PPS, a Pareto set is divided into two parts: a center point and a manifold. A set of center points in the previous environments are used to estimate the center in the new environment, and previous manifolds are used to predict the new manifold. Then, the initial population in the new environment can be generated by combining the predicted center and manifold. Recently, Jiang and Yang (2017b) developed a steady-state and generational evolutionary algorithm (SGEA) that can respond to changes in a steady-state manner. When an environmental change is detected, SGEA reuses multiple outdated solutions with a better distribution and relocates partial solutions to the regions near the new Pareto optimal front (PF) based on the information gathered from the previous and new environments. Other prediction-based strategies have been reported (Liu, 2010; Wu et al., 2015).
Prediction-based strategies work effectively if the prediction is sufficiently reliable. Unfortunately, inaccurate predictions may mislead the evolutionary search. Typically, prediction-based strategies work more efficiently for DMOPs having periodic environmental changes.
2.4 Memory-Based Strategy
Last but not the least, memory-based strategies (Ng and Wong, 1995; Yang, 2006; Zhang and Qian, 2011) have also been designed to respond to environmental changes. These strategies store relevant information about each of the previous environments and reuse the stored information in the new environment. For example, Yang (2006) proposed an associative memory mechanism in which the solutions and a distribution estimation are stored as memory individuals. When an environmental change is detected, all individuals in the memory are re-evaluated. The better an individual is, the more likely its related distribution will be selected to generate the initial population in the new environment.
Similar to the prediction-based strategies, memory-based strategies are useful for solving DMOPs having periodic changes. However, storing information in and retrieving information from the memory can be computationally intensive. Note that this strategy is useful for solving periodic DMOPs only.
Almost all response strategies discussed above have both advantages and disadvantages and work well in dealing with certain types of environmental changes. For this reason, we propose a self-adaptive response strategy for dynamic multiobjective evolutionary algorithms, which is able to automatically select the most suited response strategies for given problems.
3 The Proposed MOEA-OSD/SRS
As discussed before, a DMOA should be able to achieve a set of diverse Pareto optimal solutions of the current environment before a new environmental change occurs. In addition, it should be able to timely detect an environmental change and respond to the environmental change effectively.
To meet the above requirements, the proposed algorithm adopts MOEA-OSD, a decomposition-based approach, as the base optimizer. A self-adaptive response strategy is embedded in MOEA-OSD to quickly respond to unknown environmental changes. In this section, we describe MOEA-OSD, the environmental change detection mechanism, and the self-adaptive response strategy (SRS), before the overall framework of MOEA-OSD/SRS is presented.
3.1 MOEA-OSD
This section introduces the main principle of MOEA-OSD. In MOEA-OSD, firstly, a set of uniformly distributed reference vectors are generated to divide the objective space into a number of subobjective spaces. Then MOEA-OSD will find the closest solution of each reference vector, which will be introduced in the following section. In the evolutionary optimization process, the offspring population is produced by performing the differential crossover operator (Price et al., 2006) and Gaussian mutation operator (Higashi and Iba, 2003) on parent individuals, and then the parent and offspring populations are merged to form a combined population. The maxi-min fitness function is used to calculate the fitness value of all individuals, and the individuals with smaller fitness value are selected to generate the next population. Finally, the closest solution of each reference vector is updated. The above process repeats until a termination criterion is satisfied. The main steps of MOEA-OSD are described in Algorithm 1.
3.1.1 Finding the Closest Solution of Each Reference Vector
In order to generate a set of uniformly distributed reference vectors, we adopt the approach introduced in Cheng et al. (2016).
3.1.2 The Maxi-Min Fitness Function
The maxi-min strategy (Luce and Raiffa, 2012; Rawls, 2009) was first introduced into multiobjective optimization in Balling (2003). Here we also adopt the maxi-min fitness function to compute the fitness of the individual, which can account for both convergence and diversity so that no additional measures for diversity is needed.
We can see from Eq. (6) that if the maxi-min fitness of an individual is greater than 0, this individual is regarded as a dominated individual, while if the maxi-min fitness of an individual is less than 0, this individual is regarded as a nondominated individual. If the maxi-min fitness of an individual is 0, this individual is regarded as a weakly dominated individual. The maxi-min fitness function is well suited for multiobjective optimization, because it can penalize individuals in a crowded region while rewarding those in a less crowded region (Balling, 2003).
3.1.3 Environmental Selection
Before environmental selection, parent population is merged with the offspring population to generate a combined population . According to Eq. (6), the fitness values of all individuals in the population are calculated. The individual with the fitness value being less than 0 is regarded a nondominated individual. If the number of nondominated individuals in is greater than N, all nondominated individuals are retained. If the number of nondominated individuals in is less than or equal to N, then the individuals in are sorted by the maxi-min fitness in an ascending order, and remaining the first N individuals. The final operation is to find the closest individual of each reference vector, which forms the new parent population with N individuals. The main purpose of this selection strategy is to allow the individuals that dominate others and contribute more to the maintenance of the population diversity to have a larger chance to survive.
3.1.4 Update Strategy
During each generation, each reference vector should find its closest solution, and if one of the following conditions is satisfied, the existing solution in the subobjective space will be replaced by the newly generated solution: (1) the new solution dominates the existing one; (2) the two solutions do not dominate each other, but the new one is closer to the reference vector of the related subobjective space. The first condition makes sure that a nondominated solution is preserved so that the population converges gradually to the Pareto front. By contrast, the second condition aims to maintain the diversity of the population.
3.2 Environmental Change Detection
The most common way to detect environmental changes is to re-evaluate a portion of existing solutions (Carlisle and Dozier, 2000). This is realized by randomly choosing a number of individuals from the current population and re-evaluating them, then check the differences of the objective values or the constraint conditions of the chosen individuals between two generations. If there is a significant difference, then an environmental change is considered to have happened.
3.3 Self-Adaptive Response Strategy
This section mainly introduces the ideas of SRS in detail. SRS integrates several widely used response strategies and continuously determines the probability of selecting the response strategies according to their contributions to the performance improvement in the previous environments, thereby adaptively selecting the best response strategy for different problems. This way, the self-adaptive response strategy can be used to handle unknown environmental changes.
In our empirical studies, SRS integrates five commonly used response strategies, namely RDI (Deb et al., 2007), MDI (Deb et al., 2007), LPS (Zhou et al., 2007), FPS (Hatzakis and Wallace, 2006), and PPS (Zhou et al., 2014). The description of the each of these is shown in Section S1 of the Supplementary material, available at https://doi.org/10.1162/evco_a_00289. In the following, we will present the details of SRS.
3.3.1 Proposed SRS
It should be pointed out that according to the original reference, the prediction strategy in PPS and FPS comes into play only after 23 environmental changes. Thus, SRS adopts RDI as the response strategy in the first 23 environmental changes so that the five strategies can fairly compete with each other, because the original LPS, FPS, and PPS all use the RDI strategy when the prediction model is not yet ready to work in the early environmental changes.
When the 24th environmental change is detected, SRS selects the five different response strategies for initializing the new population at an equal probability of 0.2. That is to say, the five different response strategies all generate a new population, then SRS selects 20% of its individuals from each population to form a new population. By assigning a specific label to the individuals generated by each of the five response strategies, SRS is able to track them during the evolution. Suppose RDI is labeled as 1, MDI, LPS, FPS, and PPS are labeled as 2, 3, 4, and 5, respectively. 1, 2, 3, 4, and 5 are considered as the meta labels (MLs). Consequently, the individuals generated by RDI, MDI, LPS, FPS, and PPS are assigned labels as (1,1,1), (2,2,2), (3,3,3), (4,4,4), and (5,5,5), respectively. We will explain at the end of this section why we assign label (1,1,1) (i.e., the label of an individual consists of three MLs) instead of (1) to an individual. In the entire evolutionary process, each individual will always carry a triplet label to trace the origin of the individual, where .
When an environmental change is detected, SRS will respond to the change and generate a new initial population for the new environment. In the new environment, we use MOEA-OSD to search for nondominated solutions starting from the new initial population. Therefore, it is important to assign labels in the format of to these individuals generated by the crossover operator and mutation operator, because the label assignment process determines whether the contribution of each response strategy is correctly calculated.
3.3.2 Determining the Label of an Offspring Individual
When a mutation operator is applied, the label of the offspring individual is the same as the label of its parent individual. For example, if the label of a parent individual is (1,3,2), the label of the offspring individual is (1,3,2), too. When a differential crossover operator is applied to generate offspring, which uses three parent individuals to generate an offspring individual, the label of the offspring individual is difficult to determine.
Algorithm 2 describes the main components of determining the label of an offspring individual generated by the differential crossover operator. We provide the following three instances to elaborate how Algorithm 2 works.
a) Situation 1 (Lines 6–8 in Algorithm 2). The following gives a simple example: suppose the labels of the three parent individuals are (1,2,3), (4,2,4), and (1,2,5), respectively. Now we count the number of different MLs in these three individuals' labels, which is called as the number of labels (NL). Thus, the number of RDI's label (1) is 2, resulting in a probability of 2/9 for the response strategy RDI, this probability is denoted as p. Then, we compute the probability of each ML appearing in the label of the offspring individual generated by the crossover operator, which is denoted as appearing probability (Ap). Ap after being rounded is expressed as a rounded probability (Rp). The difference between Ap and Rp is denoted as difference probability (Dp = Ap − Rp), which could also be considered as a redundancy probability. For RDI, its label (1) will appear in the label of offspring individual with a probability of 3*2/9 = 2/3. This will be rounded to 1; that is, . Thus, based on Rp, we can determine the final label of the offspring individual. In this example, the label of the offspring individual will be (1,2,4). The detailed steps for computing the labels of the offspring individual are listed in Table 1.
. | RDI . | MDI . | LPS . | FPS . | PPS . |
---|---|---|---|---|---|
ML | 1 | 2 | 3 | 4 | 5 |
NL | 2 | 3 | 1 | 2 | 1 |
p | 2/9 | 3/9 | 1/9 | 2/9 | 1/9 |
Ap (Rp) | 2/3 (1) | 1 (1) | 1/3 (0) | 2/3 (1) | 1/3 (0) |
Dp | 1/3 | 0 | 1/3 | 1/3 | 1/3 |
. | RDI . | MDI . | LPS . | FPS . | PPS . |
---|---|---|---|---|---|
ML | 1 | 2 | 3 | 4 | 5 |
NL | 2 | 3 | 1 | 2 | 1 |
p | 2/9 | 3/9 | 1/9 | 2/9 | 1/9 |
Ap (Rp) | 2/3 (1) | 1 (1) | 1/3 (0) | 2/3 (1) | 1/3 (0) |
Dp | 1/3 | 0 | 1/3 | 1/3 | 1/3 |
b) Situation 2 (Lines 10–18 in Algorithm 2). Here is a simple example: suppose the labels of three parent individuals are (1,1,2), (2,3,4), and (3,5,4), respectively. As shown in Table 2, according to Rp, there are four “1”s. Thus the label of the offspring individual will be (1,2,3,4), which is no longer a triplet . Then, according to Dp, the response strategies corresponding to labels 1, 2, 3, 4 will have a negative redundancy (1/3). Therefore, we will randomly select three labels from 1, 2, 3, and 4 to obtain the label of the offspring individual; that is, the offspring individual in this situation will be labeled as (1,2,3) or (1,2,4) or (1,3,4) or (2,3,4).
. | RDI . | MDI . | LPS . | FPS . | PPS . |
---|---|---|---|---|---|
ML | 1 | 2 | 3 | 4 | 5 |
NL | 2 | 2 | 2 | 2 | 1 |
p | 2/9 | 2/9 | 2/9 | 2/9 | 1/9 |
Ap (Rp) | 2/3 (1) | 2/3 (1) | 2/3 (1) | 2/3 (1) | 1/3 (0) |
Dp | 1/3 | 1/3 | 1/3 | 1/3 | 1/3 |
. | RDI . | MDI . | LPS . | FPS . | PPS . |
---|---|---|---|---|---|
ML | 1 | 2 | 3 | 4 | 5 |
NL | 2 | 2 | 2 | 2 | 1 |
p | 2/9 | 2/9 | 2/9 | 2/9 | 1/9 |
Ap (Rp) | 2/3 (1) | 2/3 (1) | 2/3 (1) | 2/3 (1) | 1/3 (0) |
Dp | 1/3 | 1/3 | 1/3 | 1/3 | 1/3 |
c) Situation 3 (Lines 20–23 in Algorithm 2). The following is a simple instance: suppose the labels of the three parent individuals are (1,1,2), (1,2,3), and (2,2,5). As shown in Table 3, according to Rp, we can see that only part of the label of the offspring individual can be determined, which is (1,2), since there are only two ”1”s. According to Dp, the response strategies corresponding to the labels 2, 3, and 5 will have a positive redundancy 1/3, while response strategies of the label 1 and 4 have no redundancy. Thus we can randomly select a label from 2, 3, and 5 to assign the entire label of the offspring individual. As a result, the offspring individual may be labelled as (1,2,2), (1,2,3), or (1,2,5).
. | RDI . | MDI . | LPS . | FPS . | PPS . |
---|---|---|---|---|---|
ML | 1 | 2 | 3 | 4 | 5 |
NL | 3 | 4 | 1 | 0 | 1 |
p | 3/9 | 4/9 | 1/9 | 0 | 1/9 |
Ap (Rp) | 1 (1) | 4/3 (1) | 1/3 (0) | 0 (0) | 1/3 (0) |
Dp | 0 | 1/3 | 1/3 | 0 | 1/3 |
. | RDI . | MDI . | LPS . | FPS . | PPS . |
---|---|---|---|---|---|
ML | 1 | 2 | 3 | 4 | 5 |
NL | 3 | 4 | 1 | 0 | 1 |
p | 3/9 | 4/9 | 1/9 | 0 | 1/9 |
Ap (Rp) | 1 (1) | 4/3 (1) | 1/3 (0) | 0 (0) | 1/3 (0) |
Dp | 0 | 1/3 | 1/3 | 0 | 1/3 |
In summary, in order to use SRS to determine the probability of selecting different response strategies and to generate the new initial population, it is important to determine the individuals' labels in triplet during the evolution process of MOEA-OSD.
The reason why we assign a triplet label instead of a single number to an individual is as follows. Assume the individuals generated by RDI, MDI, LPS, FPS, and PPS are assigned a label of 1, 2, 3, 4, and 5, respectively. Now let us assume that the labels of the three parent individuals are 1, 4, and 5, and then we need to randomly select a label from 1, 4, and 5 to assign a label to the offspring individual, that is, (1) or (4) or (5). If the label of the offspring individual is randomly selected as 1, only RDI will be selected, FPS and PPS may be ignored outright, while RDI, FPS, and PPS are equal in this situation. Therefore, we assign a label (1,1,1) to the individual instead of (1) to increase the accuracy of selecting different response strategies.
3.4 Overall MOEA-OSD/SRS
At the beginning of each generation, the similarity detection operator is applied to detect environmental changes. If a change is detected, SRS is triggered to select the best response strategy. Otherwise, MOEA-OSD continues to evolve using the given strategy. In the process, the assignment of the individual's labels is very important, as presented in Section 3.3.
The above process is repeated until the termination criterion is met. When an environmental change is detected, the PF of the previous environment is outputted.
3.5 Computational Complexity
For MOEA-OSD/SRS, in each generation, computational resources are mainly consumed by MOEA-OSD.
As described in Algorithm 1, MOEA-OSD consists of the following components at each generation: finding the closest solution of each reference vector, performing genetic operations, evaluating the maxi-min fitness value, performing environmental selection and the update strategy. The time complexity for finding the closest solution of each reference vector is , where is the number of objectives and is the population size. The computational complexity for the genetic operations is . The calculation of the maxi-min fitness value holds a computational complexity of . In addition, the computational complexity for environmental selection and the update strategy are and , respectively.
To summarize, the total computational complexity of MOEA-OSD/SRS for one generation is .
4 Empirical Studies
This section verifies the performance of MOEA-OSD/SRS by conducting comprehensive empirical studies, including a comparison of SRS with other six effective response strategies, a comparison of MOEA-OSD/SRS with other seven state-of-the-art dynamic multiobjective optimization algorithms, and a comparison of MOEA-OSD with other six state-of-the-art multiobjective optimization algorithms.
4.1 Benchmark Functions
Eleven benchmark functions F1-F11 are used to test the performance of MOEA-OSD/SRS. F1, F2, and F3 are DMOP1, DMOP2, and DMOP3 of the DMOP suite (Goh and Tan, 2009a), F4, F5, F6, F7, and F8 are FDA1, FDA2, FDA3, FDA4, and FDA5 of the FDA suite (Farina et al., 2004), F9 and F10 are JY2 and JY5 of the JY suite (Jiang and Yang, 2017a), and F11 (Zhou et al., 2014) is a function with noncyclic changes. The definitions and characteristics of those functions are given in Section S2 of the Supplementary material.
To indicate the performance of DMOAs in different types of environmental changes, we define the following settings of , including (10,10), (15,10), and (20,10). For each benchmark function, the environment changes 100 times in each run and each algorithm is performed 20 independent runs on each benchmark function.
4.2 Performance Indicators
In this work, we adopt the following performance indicators to assess the convergence and diversity performance of the solution sets obtained by the algorithms under comparison, which are Inverted generational distance (IGD) (Liu et al., 2017; Zhou et al., 2007), Spacing (Schott, 1995), and Hypervolume (Zitzler and Thiele, 1999). The description of the three performance indicators is presented in Section S3 of the Supplementary material.
4.3 Comparison between SRS and Other Six Effective Response Strategies
To assess the effectiveness of the proposed SRS, here we compared the performance of SRS with six most widely used response strategies on 11 benchmark functions.
4.3.1 Comparison Algorithms and Parameter Settings
This section verifies the better performance of SRS by conducting a comparison with six well-known response strategies, that are RDI, MDI, LPS, FPS, and PPS, and self-adaptive diversity introduction (SADI; Liu, Zheng et al., 2014). For comparisons, each of these response strategies is embedded into MOEA-OSD, which is denoted as MOEA-OSD/SRS, MOEA-OSD/RDI, MOEA-OSD/MDI, MOEA-OSD/LPS, MOEA-OSD/FPS, MOEA-OSD/PPS, and MOEA-OSD/SADI, respectively. Since SRS integrates five response strategies, that is, RDI, MDI, LPS, FPS, and PPS, we therefore compare SRS with the five strategies. We also compare SRS with SADI, as SADI is a self-adaptive response strategy, too. SADI adaptively determines the diversity introduction ratio according to the severity of environmental changes, which is described in Section S1 of the Supplementary material in detail. Most parameter settings of each strategy are based on the recommendations in the original references and the details are presented in Section S4.1 of the Supplementary material.
4.3.2 Experimental Results
Table 4,0 presents the statistical results of of the solution sets obtained by the seven algorithms averaged over 20 runs; and metric values can be found in the Section S4.2 of Supplementary material. In Table 4, the best results of the first five algorithms using a different single response strategy are highlighted. These results indicate the best single response strategy among RDI, MDI, LPS, FPS, and PPS for each benchmark function in the presence of different environmental changes (columns 4 to 8). The experimental results () of the proposed algorithm and the best of the first five algorithms are also analyzed using the Wilcoxon rank-sum test (Derrac et al., 2011). In Table 4, p-value represents the probability of two set of obtained by two different algorithms come from the same distribution, “”, “§”, and “” denote the performance of the proposed algorithm is better than, worse than, or comparable to that of the best of the first five algorithms, respectively.
. | . | . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | . | / . |
---|---|---|---|---|---|---|---|---|---|---|---|
. | . | . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | . | §/ . |
functions . | . | Statistic . | /RDI . | /MDI . | /LPS . | /FPS . | /PPS . | /SADI . | /SRS . | p-value . | . |
F1 | (20,10) | Mean | 0.0044 | 0.0043 | 0.0060 | 0.0043 | 0.0053 | 0.0149 | 0.0042 | 0.0947 | |
Std | 5.71E-04 | 2.17E-04 | 9.62E-05 | 4.83E-04 | 0.0012 | 0.0035 | 3.49E-05 | ||||
(15,10) | Mean | 0.0054 | 0.0049 | 0.0073 | 0.0051 | 0.0061 | 0.0255 | 0.0047 | 0.6761 | ||
Std | 8.45E-04 | 4.05E-04 | 2.49E-04 | 6.58E-04 | 3.88E-04 | 0.0056 | 5.51E-05 | ||||
(10,10) | Mean | 0.0089 | 0.0080 | 0.0156 | 0.0079 | 0.0111 | 0.0507 | 0.0072 | 0.6791 | ||
Std | 0.0016 | 0.0020 | 0.0023 | 0.0014 | 0.0024 | 0.0147 | 1.30E-04 | ||||
F2 | (20,10) | Mean | 0.0082 | 0.0077 | 0.0056 | 0.0071 | 0.0061 | 0.0088 | 0.0056 | 0.5309 | |
Std | 1.08E-04 | 7.07E-04 | 4.78E-05 | 1.23E-04 | 1.01E-04 | 1.40E-04 | 3.27E-05 | ||||
(15,10) | Mean | 0.0118 | 0.0107 | 0.0067 | 0.0096 | 0.0079 | 0.0139 | 0.0067 | 0.6761 | ||
Std | 1.54E-04 | 1.51E-04 | 7.85E-05 | 2.31E-04 | 1.57E-04 | 3.60E-04 | 5.58E-05 | ||||
(10,10) | Mean | 0.0228 | 0.0192 | 0.0099 | 0.0169 | 0.0133 | 0.0297 | 0.0098 | 0.2446 | ||
Std | 3.79E-04 | 7.51E-04 | 2.26E-04 | 7.60E-04 | 4.40E-04 | 0.0016 | 1.35E-04 | ||||
F3 | (20,10) | Mean | 0.0064 | 0.0071 | 0.0050 | 0.0060 | 0.0058 | 0.0064 | 0.0050 | 0.5006 | |
Std | 6.62E-05 | 6.81E-05 | 3.81E-05 | 7.46E-05 | 5.80E-05 | 1.23E-04 | 2.99E-05 | ||||
(15,10) | Mean | 0.0086 | 0.0085 | 0.0059 | 0.0079 | 0.0073 | 0.0085 | 0.0059 | 0.1984 | ||
Std | 1.75E-04 | 1.43E-04 | 7.21E-05 | 1.47E-04 | 1.44E-04 | 1.00E-04 | 5.49E-05 | ||||
(10,10) | Mean | 0.0148 | 0.0150 | 0.0082 | 0.0127 | 0.0126 | 0.0142 | 0.0081 | 0.1258 | ||
Std | 4.22E-04 | 6.64E-04 | 1.09E-04 | 5.16E-04 | 5.69E-04 | 4.64E-04 | 1.71E-04 | ||||
F4 | (20,10) | Mean | 0.0073 | 0.0069 | 0.0054 | 0.0065 | 0.0057 | 0.0088 | 0.0054 | 0.2446 | |
Std | 8.01E-05 | 7.48E-05 | 3.35E-05 | 9.65E-05 | 8.06E-05 | 1.40E-04 | 3.98E-05 | ||||
(15,10) | Mean | 0.0099 | 0.0091 | 0.0063 | 0.0084 | 0.0070 | 0.0113 | 0.0062 | 0.0235 | ||
Std | 1.18E-04 | 1.05E-04 | 5.12E-05 | 1.84E-04 | 1.68E-04 | 2.22E-03 | 1.44E-04 | ||||
(10,10) | Mean | 0.0180 | 0.0151 | 0.0087 | 0.0140 | 0.0108 | 0.0226 | 0.0086 | 0.0982 | ||
Std | 4.18E-04 | 3.57E-04 | 1.59E-04 | 4.71E-04 | 3.39E-04 | 0.0011 | 2.09E-04 | ||||
F5 | (20,10) | Mean | 0.0060 | 0.0058 | 0.0073 | 0.0059 | 0.0065 | 0.0073 | 0.0057 | 0.0122 | |
Std | 6.86E-05 | 1.40E-04 | 1.65E-04 | 9.86E-05 | 1.40E-04 | 6.93E-04 | 7.39E-05 | ||||
(15,10) | Mean | 0.0072 | 0.0066 | 0.0088 | 0.0068 | 0.0079 | 0.0095 | 0.0066 | 0.0367 | ||
Std | 1.88 E-04 | 1.01E-04 | 1.81E-04 | 1.65E-04 | 3.76E-04 | 7.43E-04 | 1.23E-04 | ||||
(10,10) | Mean | 0.0100 | 0.0087 | 0.0130 | 0.0088 | 0.0121 | 0.0198 | 0.0085 | 0.5815 | ||
Std | 2.03E-04 | 2.05E-04 | 2.98E-04 | 1.51E-04 | 0.0015 | 0.0036 | 1.54E-04 | ||||
F6 | (20,10) | Mean | 0.0131 | 0.0156 | 0.0084 | 0.0128 | 0.0109 | 0.0117 | 0.0083 | 0.5815 | |
Std | 8.68E-04 | 0.0016 | 4.69E-04 | 0.0016 | 9.33E-04 | 0.0011 | 7.04E-04 | ||||
(15,10) | Mean | 0.0186 | 0.0206 | 0.0108 | 0.0169 | 0.0160 | 0.0213 | 0.0109 | 0.2979 | ||
Std | 0.0012 | 0.0014 | 8.34E-04 | 0.0020 | 0.0017 | 0.0029 | 0.0011 | ||||
(10,10) | Mean | 0.0273 | 0.0320 | 0.0159 | 0.0242 | 0.0271 | 0.0301 | 0.0160 | 0.2979 | ||
Std | 9.16E-04 | 0.0025 | 8.79E-04 | 0.0018 | 0.0034 | 0.0017 | 0.0010 | ||||
F7 | (20,10) | Mean | 0.0577 | 0.0581 | 0.0541 | 0.0569 | 0.0575 | 0.0630 | 0.0468 | 0.0122 | |
Std | 2.32E-04 | 2.27E-04 | 2.28E-04 | 4.09E-04 | 4.00E-04 | 3.15E-04 | 0.0011 | ||||
(15,10) | Mean | 0.0625 | 0.0633 | 0.0571 | 0.0612 | 0.0628 | 0.0676 | 0.0508 | 0.0027 | ||
Std | 2.93E-04 | 4.18E-04 | 2.45E-04 | 3.86E-04 | 8.25E-04 | 3.82E-04 | 0.0020 | ||||
(10,10) | Mean | 0.0732 | 0.0763 | 0.0630 | 0.0715 | 0.0804 | 0.0730 | 0.0572 | 0.0235 | ||
Std | 7.28E-04 | 0.0011 | 5.21E-04 | 0.0010 | 0.0033 | 0.0018 | 0.0040 | ||||
F8 | (20,10) | Mean | 0.0435 | 0.0446 | 0.0386 | 0.0422 | 0.0441 | 0.0838 | 0.0372 | 0.0963 | |
Std | 0.0011 | 0.0011 | 3.66E-04 | 0.0012 | 0.0012 | 0.0012 | 0.0025 | ||||
(15,10) | Mean | 0.0518 | 0.0539 | 0.0448 | 0.0491 | 0.0544 | 0.0863 | 0.0440 | 0.1542 | ||
Std | 9.43E-04 | 0.0015 | 8.88E-04 | 0.0010 | 0.0018 | 0.0014 | 0.0026 | ||||
(10,10) | Mean | 0.0678 | 0.0781 | 0.0548 | 0.0654 | 0.0874 | 0.1001 | 0.0538 | 0.0583 | ||
Std | 0.0024 | 0.0017 | 0.0019 | 0.0024 | 0.0085 | 0.0030 | 0.0054 | ||||
F9 | (20,10) | Mean | 0.0094 | 0.0086 | 0.0062 | 0.0075 | 0.0064 | 0.0109 | 0.0061 | 0.0216 | |
Std | 1.28E-04 | 7.63E-04 | 4.58E-05 | 1.70E-04 | 1.08E-04 | 4.79E-04 | 7.86E-05 | ||||
(15,10) | Mean | 0.0133 | 0.0177 | 0.0074 | 0.0102 | 0.0079 | 0.0166 | 0.0071 | 0.0122 | ||
Std | 2.21E-04 | 1.40E-04 | 5.86E-05 | 3.49E-04 | 1.83E-04 | 5.95E-04 | 5.76E-05 | ||||
(10,10) | Mean | 0.0245 | 0.0198 | 0.0103 | 0.0170 | 0.0123 | 0.0324 | 0.0097 | 0.0216 | ||
Std | 8.78E-04 | 3.66E-04 | 1.85E-04 | 5.04E-04 | 3.27E-04 | 0.0027 | 3.33E-04 |
. | . | . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | . | / . |
---|---|---|---|---|---|---|---|---|---|---|---|
. | . | . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | . | §/ . |
functions . | . | Statistic . | /RDI . | /MDI . | /LPS . | /FPS . | /PPS . | /SADI . | /SRS . | p-value . | . |
F1 | (20,10) | Mean | 0.0044 | 0.0043 | 0.0060 | 0.0043 | 0.0053 | 0.0149 | 0.0042 | 0.0947 | |
Std | 5.71E-04 | 2.17E-04 | 9.62E-05 | 4.83E-04 | 0.0012 | 0.0035 | 3.49E-05 | ||||
(15,10) | Mean | 0.0054 | 0.0049 | 0.0073 | 0.0051 | 0.0061 | 0.0255 | 0.0047 | 0.6761 | ||
Std | 8.45E-04 | 4.05E-04 | 2.49E-04 | 6.58E-04 | 3.88E-04 | 0.0056 | 5.51E-05 | ||||
(10,10) | Mean | 0.0089 | 0.0080 | 0.0156 | 0.0079 | 0.0111 | 0.0507 | 0.0072 | 0.6791 | ||
Std | 0.0016 | 0.0020 | 0.0023 | 0.0014 | 0.0024 | 0.0147 | 1.30E-04 | ||||
F2 | (20,10) | Mean | 0.0082 | 0.0077 | 0.0056 | 0.0071 | 0.0061 | 0.0088 | 0.0056 | 0.5309 | |
Std | 1.08E-04 | 7.07E-04 | 4.78E-05 | 1.23E-04 | 1.01E-04 | 1.40E-04 | 3.27E-05 | ||||
(15,10) | Mean | 0.0118 | 0.0107 | 0.0067 | 0.0096 | 0.0079 | 0.0139 | 0.0067 | 0.6761 | ||
Std | 1.54E-04 | 1.51E-04 | 7.85E-05 | 2.31E-04 | 1.57E-04 | 3.60E-04 | 5.58E-05 | ||||
(10,10) | Mean | 0.0228 | 0.0192 | 0.0099 | 0.0169 | 0.0133 | 0.0297 | 0.0098 | 0.2446 | ||
Std | 3.79E-04 | 7.51E-04 | 2.26E-04 | 7.60E-04 | 4.40E-04 | 0.0016 | 1.35E-04 | ||||
F3 | (20,10) | Mean | 0.0064 | 0.0071 | 0.0050 | 0.0060 | 0.0058 | 0.0064 | 0.0050 | 0.5006 | |
Std | 6.62E-05 | 6.81E-05 | 3.81E-05 | 7.46E-05 | 5.80E-05 | 1.23E-04 | 2.99E-05 | ||||
(15,10) | Mean | 0.0086 | 0.0085 | 0.0059 | 0.0079 | 0.0073 | 0.0085 | 0.0059 | 0.1984 | ||
Std | 1.75E-04 | 1.43E-04 | 7.21E-05 | 1.47E-04 | 1.44E-04 | 1.00E-04 | 5.49E-05 | ||||
(10,10) | Mean | 0.0148 | 0.0150 | 0.0082 | 0.0127 | 0.0126 | 0.0142 | 0.0081 | 0.1258 | ||
Std | 4.22E-04 | 6.64E-04 | 1.09E-04 | 5.16E-04 | 5.69E-04 | 4.64E-04 | 1.71E-04 | ||||
F4 | (20,10) | Mean | 0.0073 | 0.0069 | 0.0054 | 0.0065 | 0.0057 | 0.0088 | 0.0054 | 0.2446 | |
Std | 8.01E-05 | 7.48E-05 | 3.35E-05 | 9.65E-05 | 8.06E-05 | 1.40E-04 | 3.98E-05 | ||||
(15,10) | Mean | 0.0099 | 0.0091 | 0.0063 | 0.0084 | 0.0070 | 0.0113 | 0.0062 | 0.0235 | ||
Std | 1.18E-04 | 1.05E-04 | 5.12E-05 | 1.84E-04 | 1.68E-04 | 2.22E-03 | 1.44E-04 | ||||
(10,10) | Mean | 0.0180 | 0.0151 | 0.0087 | 0.0140 | 0.0108 | 0.0226 | 0.0086 | 0.0982 | ||
Std | 4.18E-04 | 3.57E-04 | 1.59E-04 | 4.71E-04 | 3.39E-04 | 0.0011 | 2.09E-04 | ||||
F5 | (20,10) | Mean | 0.0060 | 0.0058 | 0.0073 | 0.0059 | 0.0065 | 0.0073 | 0.0057 | 0.0122 | |
Std | 6.86E-05 | 1.40E-04 | 1.65E-04 | 9.86E-05 | 1.40E-04 | 6.93E-04 | 7.39E-05 | ||||
(15,10) | Mean | 0.0072 | 0.0066 | 0.0088 | 0.0068 | 0.0079 | 0.0095 | 0.0066 | 0.0367 | ||
Std | 1.88 E-04 | 1.01E-04 | 1.81E-04 | 1.65E-04 | 3.76E-04 | 7.43E-04 | 1.23E-04 | ||||
(10,10) | Mean | 0.0100 | 0.0087 | 0.0130 | 0.0088 | 0.0121 | 0.0198 | 0.0085 | 0.5815 | ||
Std | 2.03E-04 | 2.05E-04 | 2.98E-04 | 1.51E-04 | 0.0015 | 0.0036 | 1.54E-04 | ||||
F6 | (20,10) | Mean | 0.0131 | 0.0156 | 0.0084 | 0.0128 | 0.0109 | 0.0117 | 0.0083 | 0.5815 | |
Std | 8.68E-04 | 0.0016 | 4.69E-04 | 0.0016 | 9.33E-04 | 0.0011 | 7.04E-04 | ||||
(15,10) | Mean | 0.0186 | 0.0206 | 0.0108 | 0.0169 | 0.0160 | 0.0213 | 0.0109 | 0.2979 | ||
Std | 0.0012 | 0.0014 | 8.34E-04 | 0.0020 | 0.0017 | 0.0029 | 0.0011 | ||||
(10,10) | Mean | 0.0273 | 0.0320 | 0.0159 | 0.0242 | 0.0271 | 0.0301 | 0.0160 | 0.2979 | ||
Std | 9.16E-04 | 0.0025 | 8.79E-04 | 0.0018 | 0.0034 | 0.0017 | 0.0010 | ||||
F7 | (20,10) | Mean | 0.0577 | 0.0581 | 0.0541 | 0.0569 | 0.0575 | 0.0630 | 0.0468 | 0.0122 | |
Std | 2.32E-04 | 2.27E-04 | 2.28E-04 | 4.09E-04 | 4.00E-04 | 3.15E-04 | 0.0011 | ||||
(15,10) | Mean | 0.0625 | 0.0633 | 0.0571 | 0.0612 | 0.0628 | 0.0676 | 0.0508 | 0.0027 | ||
Std | 2.93E-04 | 4.18E-04 | 2.45E-04 | 3.86E-04 | 8.25E-04 | 3.82E-04 | 0.0020 | ||||
(10,10) | Mean | 0.0732 | 0.0763 | 0.0630 | 0.0715 | 0.0804 | 0.0730 | 0.0572 | 0.0235 | ||
Std | 7.28E-04 | 0.0011 | 5.21E-04 | 0.0010 | 0.0033 | 0.0018 | 0.0040 | ||||
F8 | (20,10) | Mean | 0.0435 | 0.0446 | 0.0386 | 0.0422 | 0.0441 | 0.0838 | 0.0372 | 0.0963 | |
Std | 0.0011 | 0.0011 | 3.66E-04 | 0.0012 | 0.0012 | 0.0012 | 0.0025 | ||||
(15,10) | Mean | 0.0518 | 0.0539 | 0.0448 | 0.0491 | 0.0544 | 0.0863 | 0.0440 | 0.1542 | ||
Std | 9.43E-04 | 0.0015 | 8.88E-04 | 0.0010 | 0.0018 | 0.0014 | 0.0026 | ||||
(10,10) | Mean | 0.0678 | 0.0781 | 0.0548 | 0.0654 | 0.0874 | 0.1001 | 0.0538 | 0.0583 | ||
Std | 0.0024 | 0.0017 | 0.0019 | 0.0024 | 0.0085 | 0.0030 | 0.0054 | ||||
F9 | (20,10) | Mean | 0.0094 | 0.0086 | 0.0062 | 0.0075 | 0.0064 | 0.0109 | 0.0061 | 0.0216 | |
Std | 1.28E-04 | 7.63E-04 | 4.58E-05 | 1.70E-04 | 1.08E-04 | 4.79E-04 | 7.86E-05 | ||||
(15,10) | Mean | 0.0133 | 0.0177 | 0.0074 | 0.0102 | 0.0079 | 0.0166 | 0.0071 | 0.0122 | ||
Std | 2.21E-04 | 1.40E-04 | 5.86E-05 | 3.49E-04 | 1.83E-04 | 5.95E-04 | 5.76E-05 | ||||
(10,10) | Mean | 0.0245 | 0.0198 | 0.0103 | 0.0170 | 0.0123 | 0.0324 | 0.0097 | 0.0216 | ||
Std | 8.78E-04 | 3.66E-04 | 1.85E-04 | 5.04E-04 | 3.27E-04 | 0.0027 | 3.33E-04 |
. | . | . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | . | / . |
---|---|---|---|---|---|---|---|---|---|---|---|
. | . | . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | . | §/ . |
functions . | . | Statistic . | /RDI . | /MDI . | /LPS . | /FPS . | /PPS . | /SADI . | /SRS . | p-value . | . |
F10 | (20,10) | Mean | 0.0062 | 0.0060 | 0.0068 | 0.0060 | 0.0062 | 0.0103 | 0.0060 | 0.8345 | |
Std | 2.79E-05 | 1.73E-05 | 2.18E-05 | 1.73E-05 | 4.93E-05 | 4.48E-04 | 3.24E-05 | ||||
(15,10) | Mean | 0.0065 | 0.0062 | 0.0076 | 0.0062 | 0.0064 | 0.0154 | 0.0062 | 0.0601 | ||
Std | 3.05E-05 | 2.79E-05 | 6.39E-05 | 2.52E-05 | 7.65E-05 | 0.0010 | 3.80E-05 | ||||
(10,10) | Mean | 0.0073 | 0.0067 | 0.0094 | 0.0066 | 0.0072 | 0.0286 | 0.0067 | 0.1437 | ||
Std | 9.04E-05 | 5.76E-05 | 1.31E-04 | 9.42E-05 | 2.10E-04 | 0.0030 | 3.01E-04 | ||||
F11 | (20,10) | Mean | 0.2911 | 0.4092 | 0.1174 | 0.1654 | 0.1393 | 0.0555 | 0.1156 | 0.0122 | |
Std | 0.0217 | 0.0661 | 5.41E-04 | 0.0147 | 0.0435 | 0.0354 | 0.0033 | ||||
(15,10) | Mean | 0.3552 | 0.7125 | 0.1666 | 0.2651 | 0.3119 | 0.4015 | 0.1632 | 0.2453 | ||
Std | 0.0227 | 0.0088 | 0.0015 | 0.0368 | 0.1604 | 0.0133 | 0.0038 | ||||
(10,10) | Mean | 0.5452 | 0.9708 | 0.2780 | 0.5454 | 0.6613 | 0.6536 | 0.2785 | 0.6985 | ||
Std | 0.0178 | 0.1062 | 0.0249 | 0.0057 | 0.3908 | 0.0180 | 0.0116 |
. | . | . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | MOEA . | . | / . |
---|---|---|---|---|---|---|---|---|---|---|---|
. | . | . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | -OSD . | . | §/ . |
functions . | . | Statistic . | /RDI . | /MDI . | /LPS . | /FPS . | /PPS . | /SADI . | /SRS . | p-value . | . |
F10 | (20,10) | Mean | 0.0062 | 0.0060 | 0.0068 | 0.0060 | 0.0062 | 0.0103 | 0.0060 | 0.8345 | |
Std | 2.79E-05 | 1.73E-05 | 2.18E-05 | 1.73E-05 | 4.93E-05 | 4.48E-04 | 3.24E-05 | ||||
(15,10) | Mean | 0.0065 | 0.0062 | 0.0076 | 0.0062 | 0.0064 | 0.0154 | 0.0062 | 0.0601 | ||
Std | 3.05E-05 | 2.79E-05 | 6.39E-05 | 2.52E-05 | 7.65E-05 | 0.0010 | 3.80E-05 | ||||
(10,10) | Mean | 0.0073 | 0.0067 | 0.0094 | 0.0066 | 0.0072 | 0.0286 | 0.0067 | 0.1437 | ||
Std | 9.04E-05 | 5.76E-05 | 1.31E-04 | 9.42E-05 | 2.10E-04 | 0.0030 | 3.01E-04 | ||||
F11 | (20,10) | Mean | 0.2911 | 0.4092 | 0.1174 | 0.1654 | 0.1393 | 0.0555 | 0.1156 | 0.0122 | |
Std | 0.0217 | 0.0661 | 5.41E-04 | 0.0147 | 0.0435 | 0.0354 | 0.0033 | ||||
(15,10) | Mean | 0.3552 | 0.7125 | 0.1666 | 0.2651 | 0.3119 | 0.4015 | 0.1632 | 0.2453 | ||
Std | 0.0227 | 0.0088 | 0.0015 | 0.0368 | 0.1604 | 0.0133 | 0.0038 | ||||
(10,10) | Mean | 0.5452 | 0.9708 | 0.2780 | 0.5454 | 0.6613 | 0.6536 | 0.2785 | 0.6985 | ||
Std | 0.0178 | 0.1062 | 0.0249 | 0.0057 | 0.3908 | 0.0180 | 0.0116 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F1 | (20,10) | Mean | 0.0158 | 0.0124 | 0.009 5 | 0.0095 | 0.0087 | 0.0101 | 0.0094 | 0.0042 |
Std | 0.0075 | 0.0064 | 0.0025 | 0.0025 | 0.0022 | 0.0040 | 0.0020 | 3.49E-05 | ||
(15,10) | Mean | 0.0238 | 0.0194 | 0.0128 | 0.0127 | 0.0112 | 0.0145 | 0.0120 | 0.0047 | |
Std | 0.0088 | 0.0078 | 0.0020 | 0.0025 | 0.0028 | 0.0028 | 0.0088 | 5.51E-05 | ||
(10,10) | Mean | 0.0360 | 0.0307 | 0.0244 | 0.0253 | 0.0156 | 0.0264 | 0.0220 | 0.0072 | |
Std | 0.0125 | 0.0097 | 0.0064 | 0.0125 | 0.0039 | 7.78E-04 | 0.0125 | 1.30E-04 | ||
F2 | (20,10) | Mean | 0.0113 | 0.0111 | 0.0109 | 0.0093 | 0.0074 | 0.0098 | 0.0089 | 0.0056 |
Std | 5.83E-04 | 2.76E-04 | 3.00E-05 | 6.03E-04 | 5.57E-04 | 1.31E-04 | 6.42E-04 | 3.27E-05 | ||
(15,10) | Mean | 0.0168 | 0.0169 | 0.0197 | 0.0171 | 0.0096 | 0.0115 | 0.0101 | 0.0067 | |
Std | 5.69E-04 | 5.78E-04 | 9.71E-04 | 0.0020 | 8.70E-04 | 7.43E-04 | 5.69E-04 | 5.58E-05 | ||
(10,10) | Mean | 0.0368 | 0.0381 | 0.0430 | 0.0973 | 0.0144 | 0.0236 | 0.0153 | 0.0098 | |
Std | 0.0024 | 0.0035 | 0.0021 | 0.0444 | 9.15E-04 | 0.0074 | 0.0014 | 1.35E-04 | ||
F3 | (20,10) | Mean | 0.0099 | 0.0096 | 0.0084 | 0.0119 | 0.0718 | 0.0088 | 0.0085 | 0.0050 |
Std | 7.23E-04 | 5.75E-05 | 2.92E-04 | 9.47E-04 | 0.0088 | 1.63E-04 | 6.16E-04 | 2.99E-05 | ||
(15,10) | Mean | 0.0158 | 0.0163 | 0.0116 | 0.0229 | 0.0869 | 0.0121 | 0.0118 | 0.0059 | |
Std | 0.0010 | 0.0011 | 4.06E-04 | 0.0015 | 0.0103 | 5.09E-04 | 0.0020 | 5.49E-05 | ||
(10,10) | Mean | 0.0508 | 0.0542 | 0.0210 | 0.0655 | 0.1303 | 0.0256 | 0.0189 | 0.0081 | |
Std | 0.0031 | 0.0064 | 0.0010 | 0.0114 | 0.0105 | 0.0049 | 0.0018 | 1.71E-04 | ||
F4 | (20,10) | Mean | 0.0099 | 0.0096 | 0.0084 | 0.0119 | 0.0718 | 0.0088 | 0.0085 | 0.0050 |
Std | 3.05E-04 | 2.54E-05 | 1.60E-04 | 4.02E-04 | 7.63E-04 | 5.42E-04 | 1.41E-04 | 3.98E-05 | ||
(15,10) | Mean | 0.0137 | 0.0141 | 0.0129 | 0.0130 | 0.0091 | 0.0121 | 0.0108 | 0.0062 | |
Std | 5.41E-04 | 9.29E-04 | 4.97E-04 | 0.0014 | 0.0012 | 3.05E-04 | 5.86E-04 | 1.44E-04 | ||
(10,10) | Mean | 0.0299 | 0.0297 | 0.0266 | 0.0626 | 0.0135 | 0.0263 | 0.0228 | 0.0086 | |
Std | 0.0026 | 0.0019 | 0.0012 | 0.0233 | 0.0012 | 0.0016 | 0.0026 | 2.09E-04 | ||
F5 | (20,10) | Mean | 0.1547 | 0.1548 | 0.0071 | 0.0107 | 0.0067 | 0.0087 | 0.0079 | 0.0057 |
Std | 8.89E-05 | 2.90E-04 | 1.54E-04 | 0.0012 | 0.0011 | 8.47E-05 | 7.75E-04 | 7.39E-05 | ||
(15,10) | Mean | 0.1553 | 0.1552 | 0.0079 | 0.0153 | 0.0084 | 0.0094 | 0.0088 | 0.0066 | |
Std | 2.65E-04 | 1.77E-04 | 2.20E-04 | 0.0014 | 0.0028 | 1.93E-04 | 8.95E-04 | 1.23E-04 | ||
(10,10) | Mean | 0.1565 | 0.1564 | 0.0111 | 0.0385 | 0.0099 | 0.0138 | 0.0118 | 0.0085 | |
Std | 6.42E-04 | 7.24E-04 | 3.88E-04 | 0.0084 | 0.0014 | 0.0021 | 5.58E-04 | 1.54E-04 | ||
F6 | (20,10) | Mean | 0.1436 | 0.1435 | 0.0110 | 0.0173 | 0.0108 | 0.0153 | 0.0144 | 0.0083 |
Std | 0.0043 | 0.0041 | 5.57E-04 | 0.0020 | 0.0042 | 2.84E-04 | 0.0010 | 7.04E-04 | ||
(15,10) | Mean | 0.1516 | 0.1461 | 0.0114 | 0.0362 | 0.0134 | 0.0176 | 0.0153 | 0.0109 | |
Std | 0.0090 | 0.0039 | 4.53E-04 | 0.0075 | 0.0033 | 0.0012 | 0.0040 | 0.0011 | ||
(10,10) | Mean | 0.1713 | 0.1872 | 0.0199 | 0.1972 | 0.0175 | 0.0213 | 0.0195 | 0.0160 | |
Std | 0.0594 | 0.0707 | 0.0011 | 0.0582 | 0.0051 | 0.0046 | 0.0018 | 0.0010 | ||
F7 | (20,10) | Mean | 0.1372 | 0.1585 | 0.0994 | 0.0988 | 0.0764 | 0.0910 | 0.0795 | 0.0468 |
Std | 0.0122 | 0.0091 | 0.0012 | 0.0016 | 0.0012 | 0.0076 | 0.0012 | 0.0011 | ||
(15,10) | Mean | 0.2255 | 0.2424 | 0.1033 | 0.1076 | 0.0907 | 0.1053 | 0.0948 | 0.0508 | |
Std | 0.0227 | 0.0218 | 0.0017 | 0.0020 | 0.0018 | 0.0021 | 0.0020 | 0.0020 | ||
(10,10) | Mean | 0.4007 | 0.4180 | 0.1138 | 0.1303 | 0.1307 | 0.1206 | 0.1181 | 0.0572 | |
Std | 0.0348 | 0.0324 | 0.0016 | 0.0067 | 0.0058 | 0.0034 | 0.0040 | 0.0040 | ||
F8 | (20,10) | Mean | 0.2609 | 0.2595 | 0.0998 | 0.0988 | 0.0622 | 0.0713 | 0.0680 | 0.0372 |
Std | 0.0074 | 0.0078 | 0.0043 | 0.0016 | 0.0044 | 0.0018 | 0.0017 | 0.0025 | ||
(15,10) | Mean | 0.2797 | 0.2833 | 0.0948 | 0.1059 | 0.0746 | 0.0833 | 0.0785 | 0.0440 | |
Std | 0.0073 | 0.0080 | 0.0017 | 0.0073 | 0.0045 | 0.0042 | 0.0043 | 0.0026 | ||
(10,10) | Mean | 0.3504 | 0.3566 | 0.0840 | 0.1204 | 0.0980 | 0.1072 | 0.1001 | 0.0538 | |
Std | 0.0143 | 0.0145 | 0.0016 | 0.0093 | 0.0079 | 0.0044 | 0.0041 | 0.0054 | ||
F9 | (20,10) | Mean | 0.0153 | 0.0156 | 0.0468 | 0.0541 | 0.0077 | 0.0098 | 0.0095 | 0.0061 |
Std | 6.25E-04 | 7.24E-04 | 1.28E-04 | 0.0155 | 1.76E-04 | 1.77E-04 | 4.55E-04 | 7.86E-05 | ||
(15,10) | Mean | 0.0257 | 0.0255 | 0.0471 | 0.0477 | 0.0103 | 0.0114 | 0.0110 | 0.0071 | |
Std | 0.0012 | 0.0013 | 2.01E-04 | 3.91E-04 | 3.05E-04 | 0.0013 | 0.0010 | 5.76E-05 | ||
(10,10) | Mean | 0.0607 | 0.0625 | 0.0514 | 0.0667 | 0.0158 | 0.0159 | 0.0168 | 0.0097 | |
Std | 0.0048 | 0.0054 | 6.13E-04 | 0.0141 | 4.33E-04 | 0.0026 | 0.0030 | 3.33E-04 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F1 | (20,10) | Mean | 0.0158 | 0.0124 | 0.009 5 | 0.0095 | 0.0087 | 0.0101 | 0.0094 | 0.0042 |
Std | 0.0075 | 0.0064 | 0.0025 | 0.0025 | 0.0022 | 0.0040 | 0.0020 | 3.49E-05 | ||
(15,10) | Mean | 0.0238 | 0.0194 | 0.0128 | 0.0127 | 0.0112 | 0.0145 | 0.0120 | 0.0047 | |
Std | 0.0088 | 0.0078 | 0.0020 | 0.0025 | 0.0028 | 0.0028 | 0.0088 | 5.51E-05 | ||
(10,10) | Mean | 0.0360 | 0.0307 | 0.0244 | 0.0253 | 0.0156 | 0.0264 | 0.0220 | 0.0072 | |
Std | 0.0125 | 0.0097 | 0.0064 | 0.0125 | 0.0039 | 7.78E-04 | 0.0125 | 1.30E-04 | ||
F2 | (20,10) | Mean | 0.0113 | 0.0111 | 0.0109 | 0.0093 | 0.0074 | 0.0098 | 0.0089 | 0.0056 |
Std | 5.83E-04 | 2.76E-04 | 3.00E-05 | 6.03E-04 | 5.57E-04 | 1.31E-04 | 6.42E-04 | 3.27E-05 | ||
(15,10) | Mean | 0.0168 | 0.0169 | 0.0197 | 0.0171 | 0.0096 | 0.0115 | 0.0101 | 0.0067 | |
Std | 5.69E-04 | 5.78E-04 | 9.71E-04 | 0.0020 | 8.70E-04 | 7.43E-04 | 5.69E-04 | 5.58E-05 | ||
(10,10) | Mean | 0.0368 | 0.0381 | 0.0430 | 0.0973 | 0.0144 | 0.0236 | 0.0153 | 0.0098 | |
Std | 0.0024 | 0.0035 | 0.0021 | 0.0444 | 9.15E-04 | 0.0074 | 0.0014 | 1.35E-04 | ||
F3 | (20,10) | Mean | 0.0099 | 0.0096 | 0.0084 | 0.0119 | 0.0718 | 0.0088 | 0.0085 | 0.0050 |
Std | 7.23E-04 | 5.75E-05 | 2.92E-04 | 9.47E-04 | 0.0088 | 1.63E-04 | 6.16E-04 | 2.99E-05 | ||
(15,10) | Mean | 0.0158 | 0.0163 | 0.0116 | 0.0229 | 0.0869 | 0.0121 | 0.0118 | 0.0059 | |
Std | 0.0010 | 0.0011 | 4.06E-04 | 0.0015 | 0.0103 | 5.09E-04 | 0.0020 | 5.49E-05 | ||
(10,10) | Mean | 0.0508 | 0.0542 | 0.0210 | 0.0655 | 0.1303 | 0.0256 | 0.0189 | 0.0081 | |
Std | 0.0031 | 0.0064 | 0.0010 | 0.0114 | 0.0105 | 0.0049 | 0.0018 | 1.71E-04 | ||
F4 | (20,10) | Mean | 0.0099 | 0.0096 | 0.0084 | 0.0119 | 0.0718 | 0.0088 | 0.0085 | 0.0050 |
Std | 3.05E-04 | 2.54E-05 | 1.60E-04 | 4.02E-04 | 7.63E-04 | 5.42E-04 | 1.41E-04 | 3.98E-05 | ||
(15,10) | Mean | 0.0137 | 0.0141 | 0.0129 | 0.0130 | 0.0091 | 0.0121 | 0.0108 | 0.0062 | |
Std | 5.41E-04 | 9.29E-04 | 4.97E-04 | 0.0014 | 0.0012 | 3.05E-04 | 5.86E-04 | 1.44E-04 | ||
(10,10) | Mean | 0.0299 | 0.0297 | 0.0266 | 0.0626 | 0.0135 | 0.0263 | 0.0228 | 0.0086 | |
Std | 0.0026 | 0.0019 | 0.0012 | 0.0233 | 0.0012 | 0.0016 | 0.0026 | 2.09E-04 | ||
F5 | (20,10) | Mean | 0.1547 | 0.1548 | 0.0071 | 0.0107 | 0.0067 | 0.0087 | 0.0079 | 0.0057 |
Std | 8.89E-05 | 2.90E-04 | 1.54E-04 | 0.0012 | 0.0011 | 8.47E-05 | 7.75E-04 | 7.39E-05 | ||
(15,10) | Mean | 0.1553 | 0.1552 | 0.0079 | 0.0153 | 0.0084 | 0.0094 | 0.0088 | 0.0066 | |
Std | 2.65E-04 | 1.77E-04 | 2.20E-04 | 0.0014 | 0.0028 | 1.93E-04 | 8.95E-04 | 1.23E-04 | ||
(10,10) | Mean | 0.1565 | 0.1564 | 0.0111 | 0.0385 | 0.0099 | 0.0138 | 0.0118 | 0.0085 | |
Std | 6.42E-04 | 7.24E-04 | 3.88E-04 | 0.0084 | 0.0014 | 0.0021 | 5.58E-04 | 1.54E-04 | ||
F6 | (20,10) | Mean | 0.1436 | 0.1435 | 0.0110 | 0.0173 | 0.0108 | 0.0153 | 0.0144 | 0.0083 |
Std | 0.0043 | 0.0041 | 5.57E-04 | 0.0020 | 0.0042 | 2.84E-04 | 0.0010 | 7.04E-04 | ||
(15,10) | Mean | 0.1516 | 0.1461 | 0.0114 | 0.0362 | 0.0134 | 0.0176 | 0.0153 | 0.0109 | |
Std | 0.0090 | 0.0039 | 4.53E-04 | 0.0075 | 0.0033 | 0.0012 | 0.0040 | 0.0011 | ||
(10,10) | Mean | 0.1713 | 0.1872 | 0.0199 | 0.1972 | 0.0175 | 0.0213 | 0.0195 | 0.0160 | |
Std | 0.0594 | 0.0707 | 0.0011 | 0.0582 | 0.0051 | 0.0046 | 0.0018 | 0.0010 | ||
F7 | (20,10) | Mean | 0.1372 | 0.1585 | 0.0994 | 0.0988 | 0.0764 | 0.0910 | 0.0795 | 0.0468 |
Std | 0.0122 | 0.0091 | 0.0012 | 0.0016 | 0.0012 | 0.0076 | 0.0012 | 0.0011 | ||
(15,10) | Mean | 0.2255 | 0.2424 | 0.1033 | 0.1076 | 0.0907 | 0.1053 | 0.0948 | 0.0508 | |
Std | 0.0227 | 0.0218 | 0.0017 | 0.0020 | 0.0018 | 0.0021 | 0.0020 | 0.0020 | ||
(10,10) | Mean | 0.4007 | 0.4180 | 0.1138 | 0.1303 | 0.1307 | 0.1206 | 0.1181 | 0.0572 | |
Std | 0.0348 | 0.0324 | 0.0016 | 0.0067 | 0.0058 | 0.0034 | 0.0040 | 0.0040 | ||
F8 | (20,10) | Mean | 0.2609 | 0.2595 | 0.0998 | 0.0988 | 0.0622 | 0.0713 | 0.0680 | 0.0372 |
Std | 0.0074 | 0.0078 | 0.0043 | 0.0016 | 0.0044 | 0.0018 | 0.0017 | 0.0025 | ||
(15,10) | Mean | 0.2797 | 0.2833 | 0.0948 | 0.1059 | 0.0746 | 0.0833 | 0.0785 | 0.0440 | |
Std | 0.0073 | 0.0080 | 0.0017 | 0.0073 | 0.0045 | 0.0042 | 0.0043 | 0.0026 | ||
(10,10) | Mean | 0.3504 | 0.3566 | 0.0840 | 0.1204 | 0.0980 | 0.1072 | 0.1001 | 0.0538 | |
Std | 0.0143 | 0.0145 | 0.0016 | 0.0093 | 0.0079 | 0.0044 | 0.0041 | 0.0054 | ||
F9 | (20,10) | Mean | 0.0153 | 0.0156 | 0.0468 | 0.0541 | 0.0077 | 0.0098 | 0.0095 | 0.0061 |
Std | 6.25E-04 | 7.24E-04 | 1.28E-04 | 0.0155 | 1.76E-04 | 1.77E-04 | 4.55E-04 | 7.86E-05 | ||
(15,10) | Mean | 0.0257 | 0.0255 | 0.0471 | 0.0477 | 0.0103 | 0.0114 | 0.0110 | 0.0071 | |
Std | 0.0012 | 0.0013 | 2.01E-04 | 3.91E-04 | 3.05E-04 | 0.0013 | 0.0010 | 5.76E-05 | ||
(10,10) | Mean | 0.0607 | 0.0625 | 0.0514 | 0.0667 | 0.0158 | 0.0159 | 0.0168 | 0.0097 | |
Std | 0.0048 | 0.0054 | 6.13E-04 | 0.0141 | 4.33E-04 | 0.0026 | 0.0030 | 3.33E-04 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F10 | (20,10) | Mean | 0.0067 | 0.0066 | 0.0058 | 0.0058 | 0.0042 § | 0.0063 | 0.0060 | 0.0060 |
Std | 5.62E-04 | 4.45E-04 | 3.14E-05 | 5.51E-05 | 1.25E-05 | 9.70E-05 | 3.85E-04 | 3.24E-05 | ||
(15,10) | Mean | 0.0060 | 0.0062 | 0.0060 | 0.0062 | 0.0043 § | 0.0068 | 0.0065 | 0.0062 | |
Std | 3.17E-04 | 3.82E-04 | 4.25E-05 | 8.53E-05 | 2.35E-05 | 2.89E-04 | 4.28E-04 | 3.80E-05 | ||
(10,10) | Mean | 0.0059 § | 0.0060 | 0.0067 | 0.0073 | 0.0044 | 0.0087 | 0.0070 | 0.0067 | |
Std | 3.60E-04 | 2.91E-04 | 1.10E-04 | 4.03E-04 | 5.45E-05 | 6.01E-04 | 5.55E-04 | 3.01E-04 | ||
F11 | (20,10) | Mean | 0.4826 | 0.5418 | 0.2260 | 0.2560 | 0.1241 | 0.8585 | 0.3746 | 0.1156 |
Std | 0.0127 | 0.0242 | 0.0035 | 0.0053 | 0.0019 | 0.0160 | 0.0252 | 0.0033 | ||
(15,10) | Mean | 0.5971 | 0.5576 | 0.3376 | 0.3988 | 0.1889 | 0.8673 | 0.2150 | 0.1632 | |
Std | 0.0269 | 0.0331 | 0.0046 | 0.0101 | 0.0154 | 0.1085 | 0.0146 | 0.0038 | ||
(10,10) | Mean | 0.9034 | 0.8868 | 0.7904 | 0.8852 | 0.4915 | 0.8484 | 0.5976 | 0.2785 | |
Std | 0.1505 | 0.0053 | 0.0215 | 0.0232 | 0.0718 | 0.0975 | 0.0127 | 0.0116 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F10 | (20,10) | Mean | 0.0067 | 0.0066 | 0.0058 | 0.0058 | 0.0042 § | 0.0063 | 0.0060 | 0.0060 |
Std | 5.62E-04 | 4.45E-04 | 3.14E-05 | 5.51E-05 | 1.25E-05 | 9.70E-05 | 3.85E-04 | 3.24E-05 | ||
(15,10) | Mean | 0.0060 | 0.0062 | 0.0060 | 0.0062 | 0.0043 § | 0.0068 | 0.0065 | 0.0062 | |
Std | 3.17E-04 | 3.82E-04 | 4.25E-05 | 8.53E-05 | 2.35E-05 | 2.89E-04 | 4.28E-04 | 3.80E-05 | ||
(10,10) | Mean | 0.0059 § | 0.0060 | 0.0067 | 0.0073 | 0.0044 | 0.0087 | 0.0070 | 0.0067 | |
Std | 3.60E-04 | 2.91E-04 | 1.10E-04 | 4.03E-04 | 5.45E-05 | 6.01E-04 | 5.55E-04 | 3.01E-04 | ||
F11 | (20,10) | Mean | 0.4826 | 0.5418 | 0.2260 | 0.2560 | 0.1241 | 0.8585 | 0.3746 | 0.1156 |
Std | 0.0127 | 0.0242 | 0.0035 | 0.0053 | 0.0019 | 0.0160 | 0.0252 | 0.0033 | ||
(15,10) | Mean | 0.5971 | 0.5576 | 0.3376 | 0.3988 | 0.1889 | 0.8673 | 0.2150 | 0.1632 | |
Std | 0.0269 | 0.0331 | 0.0046 | 0.0101 | 0.0154 | 0.1085 | 0.0146 | 0.0038 | ||
(10,10) | Mean | 0.9034 | 0.8868 | 0.7904 | 0.8852 | 0.4915 | 0.8484 | 0.5976 | 0.2785 | |
Std | 0.1505 | 0.0053 | 0.0215 | 0.0232 | 0.0718 | 0.0975 | 0.0127 | 0.0116 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F1 | (20,10) | Mean | 0.0089 | 0.0089 | 0.0109 | 0.0119 | 0.0059 | 0.0080 | 0.0075 | 0.0058 |
Std | 0.0017 | 0.0017 | 0.0151 | 0.0039 | 1.70E-04 | 1.59E-04 | 2.60E-04 | 9.94E-05 | ||
(15,10) | Mean | 0.0145 | 0.0123 | 0.0145 | 0.0196 | 0.0077 | 0.0087 | 0.0082 | 0.0064 | |
Std | 0.0045 | 0.0044 | 0.0371 | 0.0103 | 1.15E-04 | 8.46E-04 | 0.0088 | 1.14E-04 | ||
(10,10) | Mean | 0.0210 | 0.0206 | 0.0195 | 0.0171 | 0.0085 | 0.0099 | 0.0095 | 0.0075 | |
Std | 0.0053 | 0.0099 | 0.0385 | 0.0144 | 5.62E-04 | 1.85E-04 | 0.0125 | 1.20E-04 | ||
F2 | (20,10) | Mean | 0.0073 | 0.0073 | 0.0222 | 0.0077 | 0.0073 | 0.0085 | 0.0080 | 0.0069 |
Std | 1.28E-04 | 1.15E-04 | 0.0089 | 1.97E-04 | 1.79E-04 | 1.06E-04 | 5.83E-04 | 5.88E-05 | ||
(15,10) | Mean | 0.0098 | 0.0098 | 0.0437 | 0.0123 | 0.0086 | 0.0101 | 0.0092 | 0.0076 | |
Std | 3.21E-04 | 2.23E-04 | 0.0133 | 0.0011 | 2.49E-04 | 1.21E-04 | 5.69E-04 | 4.92E-05 | ||
(10,10) | Mean | 0.0168 | 0.0166 | 0.0919 | 0.0243 | 0.0093 | 0.0115 | 0.0100 | 0.0090 | |
Std | 9.60E-04 | 7.80E-04 | 0.0161 | 0.0043 | 1.91E-04 | 5.23E-04 | 4.58E-04 | 7.43E-05 | ||
F3 | (20,10) | Mean | 0.0068 § | 0.0067 § | 0.0155 | 0.0079 § | 0.0060 § | 0.0115 | 0.0099 § | 0.0108 |
Std | 1.66E-04 | 1.07E-05 | 0.0016 | 0.0010 | 4.30E-04 | 8.81E-05 | 7.23E-04 | 7.99E-05 | ||
(15,10) | Mean | 0.008 § | 0.0088 § | 0.0155 | 0.0111 | 0.0062 § | 0.0158 | 0.0088 § | 0.0112 | |
Std | 1.35E-04 | 1.69E-04 | 0.0050 | 0.0022 | 5.28E-04 | 1.61E-04 | 0.0010 | 5.01E-05 | ||
(10,10) | Mean | 0.0164 | 0.0166 | 0.0234 | 0.0153 | 0.0075 § | 0.0145 | 0.0080 § | 0.0116 | |
Std | 6.98E-04 | 6.11E-04 | 0.0051 | 0.0011 | 4.79E-04 | 3.60E-04 | 0.0031 | 4.72E-05 | ||
F4 | (20,10) | Mean | 0.0067 § | 0.0067 § | 0.0118 | 0.0074 § | 0.0050 § | 0.0118 | 0.0065 § | 0.0109 |
Std | 1.30E-04 | 1.03E-04 | 0.0018 | 0.0012 | 8.94E-05 | 8.83E-05 | 3.05E-04 | 6.80E-05 | ||
(15,10) | Mean | 0.0083 § | 0.0083 § | 0.0387 | 0.0092 § | 0.0062 § | 0.0135 | 0.0085 § | 0.0112 | |
Std | 2.87E-04 | 2.19E-04 | 0.0128 | 8.80E-04 | 2.48E-04 | 4.52E-04 | 5.41E-04 | 1.50E-04 | ||
(10,10) | Mean | 0.0137 | 0.0137 | 0.0650 | 0.0236 | 0.0089 § | 0.0154 | 0.0120 | 0.0117 | |
Std | 7.39E-04 | 8.04E-04 | 0.0211 | 0.0085 | 3.86E-04 | 1.92E-03 | 0.0026 | 8.76E-05 | ||
F5 | (20,10) | Mean | 0.0066 § | 0.0066 § | 0.0086 § | 0.0064 § | 0.0053 § | 0.0123 | 0.0084 § | 0.0113 |
Std | 1.17E-04 | 7.90E-05 | 0.0017 | 2.92E-04 | 2.26E-04 | 2.04E-04 | 8.89E-04 | 7.24E-05 | ||
(15,10) | Mean | 0.0066 § | 0.0066 § | 0.0089 § | 0.0068 § | 0.0058 § | 0.0138 | 0.0088 § | 0.0115 | |
Std | 1.76E-04 | 2.02E-04 | 0.0016 | 1.89E-04 | 1.98E-04 | 2.28E-04 | 2.65E-04 | 3.70E-05 | ||
(10,10) | Mean | 0.0069 § | 0.0068 § | 0.0137 | 0.0100 § | 0.0071 § | 0.0155 | 0.0089 § | 0.0118 | |
Std | 3.54E-04 | 2.81E-04 | 0.0034 | 5.88E-04 | 2.44E-04 | 1.91E-04 | 6.42E-04 | 5.33E-05 | ||
F6 | (20,10) | Mean | 0.0296 | 0.0305 | 0.0184 | 0.0167 | 0.0456 | 0.0432 | 0.0285 | 0.0128 |
Std | 0.0079 | 0.0081 | 0.0028 | 0.0027 | 0.0011 | 0.0075 | 0.0043 | 2.03E-04 | ||
(15,10) | Mean | 0.0229 | 0.0319 | 0.0300 | 0.0288 | 0.0472 | 0.0577 | 0.0299 | 0.0131 | |
Std | 0.0133 | 0.0071 | 0.0081 | 0.0087 | 7.51E-04 | 0.0019 | 0.0090 | 7.09E-05 | ||
(10,10) | Mean | 0.0383 | 0.0350 | 0.0647 | 0.0626 | 0.0542 | 0.0690 | 0.0305 | 0.0142 | |
Std | 0.0117 | 0.0136 | 0.0154 | 0.0144 | 0.0013 | 0.0019 | 0.0059 | 3.70E-04 | ||
F7 | (20,10) | Mean | 0.0667 | 0.0686 | 0.1118 | 0.0705 | 0.0332 § | 0.0925 | 0.0825 | 0.0553 |
Std | 0.0014 | 0.0018 | 0.0124 | 0.0016 | 6.52E-04 | 0.0012 | 0.0012 | 0.0016 | ||
(15,10) | Mean | 0.0801 | 0.0794 | 0.1239 | 0.0837 | 0.0398 § | 0.0927 | 0.0766 | 0.0586 | |
Std | 0.0015 | 0.0029 | 0.0095 | 0.0079 | 0.0020 | 1.99E-04 | 0.0022 | 0.0020 | ||
(10,10) | Mean | 0.0989 | 0.0982 | 0.1408 | 0.0975 | 0.0529 § | 0.0930 | 0.0959 | 0.0617 | |
Std | 0.0040 | 0.0029 | 0.0069 | 0.0075 | 0.0016 | 6.19E-04 | 0.0034 | 7.90E-04 | ||
F8 | (20,10) | Mean | 0.1008 | 0.1002 | 0.1537 | 0.0804 § | 0.0436 § | 0.1451 | 0.0899 § | 0.0999 |
Std | 0.0013 | 0.0012 | 0.0066 | 0.0044 | 6.05E-04 | 0.0012 | 0.0074 | 0.0024 | ||
(15,10) | Mean | 0.1056 | 0.1076 | 0.1239 | 0.1403 | 0.0470 § | 0.1488 | 0.0988 | 0.1035 | |
Std | 0.0020 | 0.0014 | 0.0095 | 0.0052 | 6.20E-04 | 0.0015 | 0.0073 | 0.0022 | ||
(10,10) | Mean | 0.1188 | 0.1181 | 0.1869 | 0.1539 | 0.0550 § | 0.1551 | 0.1095 | 0.1083 | |
Std | 0.0021 | 0.0014 | 0.0071 | 0.0068 | 0.0015 | 0.0016 | 0.0143 | 0.0027 | ||
F9 | (20,10) | Mean | 0.0114 | 0.0116 | 0.0177 | 0.0086 | 0.0064 § | 0.0188 | 0.0099 | 0.0085 |
Std | 6.02E-04 | 5.46E-04 | 0.0058 | 7.97E-04 | 1.44E-04 | 1.74E-04 | 6.25E-04 | 5.75E-05 | ||
(15,10) | Mean | 0.0157 | 0.0153 | 0.0315 | 0.0131 | 0.0084 § | 0.0320 | 0.0115 | 0.0091 | |
Std | 0.0012 | 7.15E-04 | 0.0058 | 0.0012 | 2.70E-04 | 2.05E-04 | 0.0012 | 4.07E-05 | ||
(10,10) | Mean | 0.0271 | 0.0273 | 0.0640 | 0.0268 | 0.0124 | 0.0642 | 0.0138 | 0.0099 | |
Std | 0.0014 | 0.0012 | 0.0077 | 0.0056 | 3.47E-04 | 2.38E-04 | 0.0048 | 4.95E-05 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F1 | (20,10) | Mean | 0.0089 | 0.0089 | 0.0109 | 0.0119 | 0.0059 | 0.0080 | 0.0075 | 0.0058 |
Std | 0.0017 | 0.0017 | 0.0151 | 0.0039 | 1.70E-04 | 1.59E-04 | 2.60E-04 | 9.94E-05 | ||
(15,10) | Mean | 0.0145 | 0.0123 | 0.0145 | 0.0196 | 0.0077 | 0.0087 | 0.0082 | 0.0064 | |
Std | 0.0045 | 0.0044 | 0.0371 | 0.0103 | 1.15E-04 | 8.46E-04 | 0.0088 | 1.14E-04 | ||
(10,10) | Mean | 0.0210 | 0.0206 | 0.0195 | 0.0171 | 0.0085 | 0.0099 | 0.0095 | 0.0075 | |
Std | 0.0053 | 0.0099 | 0.0385 | 0.0144 | 5.62E-04 | 1.85E-04 | 0.0125 | 1.20E-04 | ||
F2 | (20,10) | Mean | 0.0073 | 0.0073 | 0.0222 | 0.0077 | 0.0073 | 0.0085 | 0.0080 | 0.0069 |
Std | 1.28E-04 | 1.15E-04 | 0.0089 | 1.97E-04 | 1.79E-04 | 1.06E-04 | 5.83E-04 | 5.88E-05 | ||
(15,10) | Mean | 0.0098 | 0.0098 | 0.0437 | 0.0123 | 0.0086 | 0.0101 | 0.0092 | 0.0076 | |
Std | 3.21E-04 | 2.23E-04 | 0.0133 | 0.0011 | 2.49E-04 | 1.21E-04 | 5.69E-04 | 4.92E-05 | ||
(10,10) | Mean | 0.0168 | 0.0166 | 0.0919 | 0.0243 | 0.0093 | 0.0115 | 0.0100 | 0.0090 | |
Std | 9.60E-04 | 7.80E-04 | 0.0161 | 0.0043 | 1.91E-04 | 5.23E-04 | 4.58E-04 | 7.43E-05 | ||
F3 | (20,10) | Mean | 0.0068 § | 0.0067 § | 0.0155 | 0.0079 § | 0.0060 § | 0.0115 | 0.0099 § | 0.0108 |
Std | 1.66E-04 | 1.07E-05 | 0.0016 | 0.0010 | 4.30E-04 | 8.81E-05 | 7.23E-04 | 7.99E-05 | ||
(15,10) | Mean | 0.008 § | 0.0088 § | 0.0155 | 0.0111 | 0.0062 § | 0.0158 | 0.0088 § | 0.0112 | |
Std | 1.35E-04 | 1.69E-04 | 0.0050 | 0.0022 | 5.28E-04 | 1.61E-04 | 0.0010 | 5.01E-05 | ||
(10,10) | Mean | 0.0164 | 0.0166 | 0.0234 | 0.0153 | 0.0075 § | 0.0145 | 0.0080 § | 0.0116 | |
Std | 6.98E-04 | 6.11E-04 | 0.0051 | 0.0011 | 4.79E-04 | 3.60E-04 | 0.0031 | 4.72E-05 | ||
F4 | (20,10) | Mean | 0.0067 § | 0.0067 § | 0.0118 | 0.0074 § | 0.0050 § | 0.0118 | 0.0065 § | 0.0109 |
Std | 1.30E-04 | 1.03E-04 | 0.0018 | 0.0012 | 8.94E-05 | 8.83E-05 | 3.05E-04 | 6.80E-05 | ||
(15,10) | Mean | 0.0083 § | 0.0083 § | 0.0387 | 0.0092 § | 0.0062 § | 0.0135 | 0.0085 § | 0.0112 | |
Std | 2.87E-04 | 2.19E-04 | 0.0128 | 8.80E-04 | 2.48E-04 | 4.52E-04 | 5.41E-04 | 1.50E-04 | ||
(10,10) | Mean | 0.0137 | 0.0137 | 0.0650 | 0.0236 | 0.0089 § | 0.0154 | 0.0120 | 0.0117 | |
Std | 7.39E-04 | 8.04E-04 | 0.0211 | 0.0085 | 3.86E-04 | 1.92E-03 | 0.0026 | 8.76E-05 | ||
F5 | (20,10) | Mean | 0.0066 § | 0.0066 § | 0.0086 § | 0.0064 § | 0.0053 § | 0.0123 | 0.0084 § | 0.0113 |
Std | 1.17E-04 | 7.90E-05 | 0.0017 | 2.92E-04 | 2.26E-04 | 2.04E-04 | 8.89E-04 | 7.24E-05 | ||
(15,10) | Mean | 0.0066 § | 0.0066 § | 0.0089 § | 0.0068 § | 0.0058 § | 0.0138 | 0.0088 § | 0.0115 | |
Std | 1.76E-04 | 2.02E-04 | 0.0016 | 1.89E-04 | 1.98E-04 | 2.28E-04 | 2.65E-04 | 3.70E-05 | ||
(10,10) | Mean | 0.0069 § | 0.0068 § | 0.0137 | 0.0100 § | 0.0071 § | 0.0155 | 0.0089 § | 0.0118 | |
Std | 3.54E-04 | 2.81E-04 | 0.0034 | 5.88E-04 | 2.44E-04 | 1.91E-04 | 6.42E-04 | 5.33E-05 | ||
F6 | (20,10) | Mean | 0.0296 | 0.0305 | 0.0184 | 0.0167 | 0.0456 | 0.0432 | 0.0285 | 0.0128 |
Std | 0.0079 | 0.0081 | 0.0028 | 0.0027 | 0.0011 | 0.0075 | 0.0043 | 2.03E-04 | ||
(15,10) | Mean | 0.0229 | 0.0319 | 0.0300 | 0.0288 | 0.0472 | 0.0577 | 0.0299 | 0.0131 | |
Std | 0.0133 | 0.0071 | 0.0081 | 0.0087 | 7.51E-04 | 0.0019 | 0.0090 | 7.09E-05 | ||
(10,10) | Mean | 0.0383 | 0.0350 | 0.0647 | 0.0626 | 0.0542 | 0.0690 | 0.0305 | 0.0142 | |
Std | 0.0117 | 0.0136 | 0.0154 | 0.0144 | 0.0013 | 0.0019 | 0.0059 | 3.70E-04 | ||
F7 | (20,10) | Mean | 0.0667 | 0.0686 | 0.1118 | 0.0705 | 0.0332 § | 0.0925 | 0.0825 | 0.0553 |
Std | 0.0014 | 0.0018 | 0.0124 | 0.0016 | 6.52E-04 | 0.0012 | 0.0012 | 0.0016 | ||
(15,10) | Mean | 0.0801 | 0.0794 | 0.1239 | 0.0837 | 0.0398 § | 0.0927 | 0.0766 | 0.0586 | |
Std | 0.0015 | 0.0029 | 0.0095 | 0.0079 | 0.0020 | 1.99E-04 | 0.0022 | 0.0020 | ||
(10,10) | Mean | 0.0989 | 0.0982 | 0.1408 | 0.0975 | 0.0529 § | 0.0930 | 0.0959 | 0.0617 | |
Std | 0.0040 | 0.0029 | 0.0069 | 0.0075 | 0.0016 | 6.19E-04 | 0.0034 | 7.90E-04 | ||
F8 | (20,10) | Mean | 0.1008 | 0.1002 | 0.1537 | 0.0804 § | 0.0436 § | 0.1451 | 0.0899 § | 0.0999 |
Std | 0.0013 | 0.0012 | 0.0066 | 0.0044 | 6.05E-04 | 0.0012 | 0.0074 | 0.0024 | ||
(15,10) | Mean | 0.1056 | 0.1076 | 0.1239 | 0.1403 | 0.0470 § | 0.1488 | 0.0988 | 0.1035 | |
Std | 0.0020 | 0.0014 | 0.0095 | 0.0052 | 6.20E-04 | 0.0015 | 0.0073 | 0.0022 | ||
(10,10) | Mean | 0.1188 | 0.1181 | 0.1869 | 0.1539 | 0.0550 § | 0.1551 | 0.1095 | 0.1083 | |
Std | 0.0021 | 0.0014 | 0.0071 | 0.0068 | 0.0015 | 0.0016 | 0.0143 | 0.0027 | ||
F9 | (20,10) | Mean | 0.0114 | 0.0116 | 0.0177 | 0.0086 | 0.0064 § | 0.0188 | 0.0099 | 0.0085 |
Std | 6.02E-04 | 5.46E-04 | 0.0058 | 7.97E-04 | 1.44E-04 | 1.74E-04 | 6.25E-04 | 5.75E-05 | ||
(15,10) | Mean | 0.0157 | 0.0153 | 0.0315 | 0.0131 | 0.0084 § | 0.0320 | 0.0115 | 0.0091 | |
Std | 0.0012 | 7.15E-04 | 0.0058 | 0.0012 | 2.70E-04 | 2.05E-04 | 0.0012 | 4.07E-05 | ||
(10,10) | Mean | 0.0271 | 0.0273 | 0.0640 | 0.0268 | 0.0124 | 0.0642 | 0.0138 | 0.0099 | |
Std | 0.0014 | 0.0012 | 0.0077 | 0.0056 | 3.47E-04 | 2.38E-04 | 0.0048 | 4.95E-05 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F10 | (20,10) | Mean | 0.0113 | 0.0117 | 0.0090 § | 0.0065 § | 0.0034 § | 0.0128 | 0.0098 § | 0.0108 |
Std | 0.0026 | 0.0040 | 0.0015 | 1.48E-04 | 6.68E-05 | 1.27E-04 | 5.62E-04 | 6.55E-05 | ||
(15,10) | Mean | 0.0142 | 0.0157 | 0.0130 | 0.0069 § | 0.0037 § | 0.0158 | 0.0106 § | 0.0111 | |
Std | 0.0025 | 0.0031 | 0.0034 | 4.19E-04 | 5.36E-04 | 3.01E-05 | 3.17E-04 | 9.43E-05 | ||
(10,10) | Mean | 0.0213 | 0.0207 | 0.0221 | 0.0082 § | 0.0039 § | 0.0209 | 0.0125 | 0.0118 | |
Std | 0.0049 | 0.0042 | 0.0052 | 8.03E-04 | 5.53E-4 | 2.23E-04 | 3.60E-04 | 1.03E-04 | ||
F11 | (20,10) | Mean | 0.0828 | 0.0801 | 0.6646 | 0.4047 | 0.0649 | 0.0885 | 0.0778 | 0.0633 |
Std | 0.0088 | 0.0092 | 0.0572 | 0.0326 | 0.0207 | 0.0060 | 0.0019 | 0.0032 | ||
(15,10) | Mean | 0.1054 | 0.1566 | 0.7423 | 0.5610 | 0.0907 | 0.1083 | 0.1022 | 0.0807 | |
Std | 0.0132 | 0.0225 | 0.0656 | 0.0329 | 0.0134 | 0.0043 | 0.0102 | 0.0113 | ||
(10,10) | Mean | 0.2448 | 0.2996 | 0.7673 | 0.5560 | 0.1623 | 0.2480 | 0.2470 | 0.1323 | |
Std | 0.0168 | 0.0261 | 0.0427 | 0.0440 | 0.0238 | 0.0279 | 0.0062 | 0.0155 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F10 | (20,10) | Mean | 0.0113 | 0.0117 | 0.0090 § | 0.0065 § | 0.0034 § | 0.0128 | 0.0098 § | 0.0108 |
Std | 0.0026 | 0.0040 | 0.0015 | 1.48E-04 | 6.68E-05 | 1.27E-04 | 5.62E-04 | 6.55E-05 | ||
(15,10) | Mean | 0.0142 | 0.0157 | 0.0130 | 0.0069 § | 0.0037 § | 0.0158 | 0.0106 § | 0.0111 | |
Std | 0.0025 | 0.0031 | 0.0034 | 4.19E-04 | 5.36E-04 | 3.01E-05 | 3.17E-04 | 9.43E-05 | ||
(10,10) | Mean | 0.0213 | 0.0207 | 0.0221 | 0.0082 § | 0.0039 § | 0.0209 | 0.0125 | 0.0118 | |
Std | 0.0049 | 0.0042 | 0.0052 | 8.03E-04 | 5.53E-4 | 2.23E-04 | 3.60E-04 | 1.03E-04 | ||
F11 | (20,10) | Mean | 0.0828 | 0.0801 | 0.6646 | 0.4047 | 0.0649 | 0.0885 | 0.0778 | 0.0633 |
Std | 0.0088 | 0.0092 | 0.0572 | 0.0326 | 0.0207 | 0.0060 | 0.0019 | 0.0032 | ||
(15,10) | Mean | 0.1054 | 0.1566 | 0.7423 | 0.5610 | 0.0907 | 0.1083 | 0.1022 | 0.0807 | |
Std | 0.0132 | 0.0225 | 0.0656 | 0.0329 | 0.0134 | 0.0043 | 0.0102 | 0.0113 | ||
(10,10) | Mean | 0.2448 | 0.2996 | 0.7673 | 0.5560 | 0.1623 | 0.2480 | 0.2470 | 0.1323 | |
Std | 0.0168 | 0.0261 | 0.0427 | 0.0440 | 0.0238 | 0.0279 | 0.0062 | 0.0155 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F1 | (20,10) | Mean | 0.6436 | 0.6405 | 0.6456 | 0.6448 | 0.6488 | 0.6434 | 0.6425 | 0.6550 |
Std | 0.0047 | 0.0017 | 8.76E-04 | 0.0015 | 2.35E-04 | 5.69E-04 | 6.75E-04 | 6.69E-05 | ||
(15,10) | Mean | 0.6411 | 0.6403 | 0.6429 | 0.6439 | 0.6446 | 0.6391 | 0.6399 | 0.6538 | |
Std | 0.0023 | 0.0029 | 6.85E-04 | 1.59E-04 | 6.11E-04 | 0.0030 | 0.0040 | 1.59E-04 | ||
(10,10) | Mean | 0.6368 | 0.6330 | 0.6356 | 0.6321 | 0.6435 | 0.6356 | 0.6365 | 0.6500 | |
Std | 0.0039 | 0.0024 | 0.0015 | 0.0018 | 0.0029 | 1.04E-04 | 0.0054 | 3.63E-04 | ||
F2 | (20,10) | Mean | 0.6404 | 0.6403 | 0.6398 | 0.6424 | 0.6468 | 0.6417 | 0.6406 | 0.6511 |
Std | 3.19E-04 | 7.82E-04 | 0.0010 | 2.97E-04 | 0.0010 | 1.62E-04 | 5.83E-04 | 6.37E-05 | ||
(15,10) | Mean | 0.6303 | 0.6299 | 0.6231 | 0.6254 | 0.6426 | 0.6248 | 0.6250 | 0.6488 | |
Std | 7.78E-04 | 6.27E-04 | 0.0013 | 0.0032 | 0.0016 | 0.0011 | 5.69E-04 | 1.43E-04 | ||
(10,10) | Mean | 0.5962 | 0.5888 | 0.5800 | 0.5894 | 0.6340 | 0.5846 | 0.5885 | 0.6429 | |
Std | 0.0041 | 0.0121 | 0.0011 | 0.0270 | 8.67E-04 | 0.0079 | 0.0024 | 2.93E-04 | ||
F3 | (20,10) | Mean | 0.8597 | 0.8586 | 0.8611 | 0.8542 | 0.7645 | 0.7694 | 0.8588 | 0.8682 |
Std | 9.54E-04 | 4.75E-05 | 3.82E-04 | 0.0012 | 0.0106 | 1.02E-04 | 7.23E-04 | 7.26E-05 | ||
(15,10) | Mean | 0.8491 | 0.8491 | 0.8557 | 0.8383 | 0.7312 | 0.7606 | 0.8221 | 0.8665 | |
Std | 9.74E-04 | 0.0025 | 1.61E-04 | 0.0031 | 0.0045 | 8.70E-04 | 0.0010 | 1.12E-04 | ||
(10,10) | Mean | 0.7949 | 0.7904 | 0.8392 | 0.7627 | 0.6759 | 0.7502 | 0.7895 | 0.8619 | |
Std | 0.0042 | 0.0045 | 0.0012 | 0.0020 | 0.0034 | 1.56E-04 | 0.0031 | 1.89E-04 | ||
F4 | (20,10) | Mean | 0.8607 | 0.8605 | 0.8617 | 0.8632 | 0.8646 | 0.8602 | 0.8622 | 0.8674 |
Std | 2.11E-04 | 5.38E-05 | 1.94E-04 | 1.64E-04 | 1.23E-04 | 2.04E-04 | 3.05E-04 | 3.86E-05 | ||
(15,10) | Mean | 0.8516 | 0.8526 | 0.8531 | 0.8492 | 0.8611 | 0.8529 | 0.8541 | 0.8658 | |
Std | 0.0011 | 2.45E-04 | 9.69E-04 | 0.0020 | 1.63E-04 | 1.41E-04 | 5.41E-04 | 3.37E-04 | ||
(10,10) | Mean | 0.8216 | 0.8250 | 0.8313 | 0.8295 | 0.8539 | 0.8301 | 0.8342 | 0.8612 | |
Std | 0.0054 | 0.0053 | 0.0021 | 0.0011 | 8.65E-04 | 0.0016 | 0.0026 | 1.73E-04 | ||
F5 | (20,10) | Mean | 0.7030 | 0.7029 | 0.6598 | 0.6516 | 0.7034 | 0.6256 | 0.6556 | 0.7043 |
Std | 1.32E-04 | 1.39E-05 | 2.55E-04 | 0.0011 | 8.67E-04 | 1.76E-05 | 8.89E-04 | 1.00E-04 | ||
(15,10) | Mean | 0.7005 | 0.7011 | 0.6579 | 0.6459 | 0.7006 | 0.6239 | 0.6531 | 0.7029 | |
Std | 2.63E-04 | 1.02E-04 | 6.92E-04 | 7.59E-04 | 0.0028 | 6.34E-04 | 2.65E-04 | 1.22E-04 | ||
(10,10) | Mean | 0.6966 | 0.6964 | 0.6529 | 0.6037 | 0.6986 | 0.6175 | 0.6428 | 0.6997 | |
Std | 1.08E-04 | 1.77E-04 | 2.91E-04 | 0.0020 | 9.37E-04 | 0.0024 | 6.42E-04 | 1.28E-04 | ||
F6 | (20,10) | Mean | 1.0147 | 1.0154 | 1.0170 | 0.9985 | 1.0169 | 0.9788 | 0.9988 | 1.0214 |
Std | 0.0038 | 0.0018 | 0.0017 | 0.0055 | 0.0079 | 9.14E-04 | 0.0043 | 0.0056 | ||
(15,10) | Mean | 1.0010 | 1.0060 | 1.0040 | 0.9923 | 1.0105 | 0.9773 | 0.9956 | 1.0115 | |
Std | 0.0126 | 0.0116 | 0.0020 | 0.0107 | 0.0034 | 0.0049 | 0.0090 | 0.0026 | ||
(10,10) | Mean | 0.9988 | 0.9985 | 0.9934 | 0.9857 | 1.0015 | 0.9758 | 0.9915 | 1.0056 | |
Std | 0.0083 | 0.0038 | 0.0117 | 0.0518 | 0.0079 | 0.0048 | 0.0059 | 0.0010 | ||
F7 | (20,10) | Mean | 0.5294 | 0.5201 | 0.5886 | 0.5821 | 0.6724 | 0.5977 | 0.6022 | 0.7351 |
Std | 0.0214 | 0.0102 | 0.0021 | 0.0026 | 9.74E-04 | 3.31E-04 | 0.0021 | 1.50E-04 | ||
(15,10) | Mean | 0.4084 | 0.4119 | 0.5776 | 0.5642 | 0.6524 | 0.5887 | 0.5999 | 0.7220 | |
Std | 0.0026 | 0.0228 | 3.53E-04 | 0.0018 | 0.0027 | 2.22E-04 | 0.0022 | 0.0076 | ||
(10,10) | Mean | 0.2902 | 0.3036 | 0.5571 | 0.5007 | 0.6416 | 0.5690 | 0.5901 | 0.7166 | |
Std | 0.0057 | 0.0033 | 0.0065 | 0.0070 | 0.0010 | 5.84E-04 | 0.0034 | 2.40E-04 | ||
F8 | (20,10) | Mean | 3.0936 | 3.0475 | 2.8990 | 2.7988 | 3.4270 | 3.2993 | 3.3345 | 3.5342 |
Std | 0.0642 | 0.0467 | 0.0174 | 0.0165 | 0.0044 | 0.0013 | 0.0074 | 0.0019 | ||
(15,10) | Mean | 2.8396 | 2.8047 | 2.7445 | 2.4886 | 3.3664 | 3.2760 | 3.2985 | 3.4784 | |
Std | 0.0019 | 0.0532 | 0.0517 | 0.1279 | 0.0023 | 0.0011 | 0.0073 | 0.0023 | ||
(10,10) | Mean | 2.4662 | 2.4445 | 2.3414 | 2.0190 | 3.2432 | 3.2101 | 3.2564 | 3.4415 | |
Std | 0.0089 | 0.0874 | 0.0213 | 0.0126 | 0.0084 | 0.0053 | 0.0143 | 0.0475 | ||
F9 | (20,10) | Mean | 0.6891 | 0.6878 | 0.6937 | 0.6979 | 0.6999 | 0.6874 | 0.6957 | 0.7022 |
Std | 9.54E-04 | 1.36E-04 | 2.02E-04 | 2.72E-04 | 1.09E-04 | 8.49E-04 | 6.25E-04 | 2.17E-05 | ||
(15,10) | Mean | 0.6730 | 0.6689 | 0.6819 | 0.6904 | 0.6964 | 0.6246 | 0.6942 | 0.7011 | |
Std | 0.0014 | 0.0054 | 7.05E-04 | 3.47E-04 | 1.75E-04 | 0.0013 | 0.0012 | 2.72E-04 | ||
(10,10) | Mean | 0.6117 | 0.6055 | 0.6508 | 0.6307 | 0.6893 | 0.6173 | 0.6921 | 0.7001 | |
Std | 0.0022 | 0.0081 | 0.0035 | 0.0082 | 2.69E-04 | 0.0041 | 0.0048 | 2.17E-04 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F1 | (20,10) | Mean | 0.6436 | 0.6405 | 0.6456 | 0.6448 | 0.6488 | 0.6434 | 0.6425 | 0.6550 |
Std | 0.0047 | 0.0017 | 8.76E-04 | 0.0015 | 2.35E-04 | 5.69E-04 | 6.75E-04 | 6.69E-05 | ||
(15,10) | Mean | 0.6411 | 0.6403 | 0.6429 | 0.6439 | 0.6446 | 0.6391 | 0.6399 | 0.6538 | |
Std | 0.0023 | 0.0029 | 6.85E-04 | 1.59E-04 | 6.11E-04 | 0.0030 | 0.0040 | 1.59E-04 | ||
(10,10) | Mean | 0.6368 | 0.6330 | 0.6356 | 0.6321 | 0.6435 | 0.6356 | 0.6365 | 0.6500 | |
Std | 0.0039 | 0.0024 | 0.0015 | 0.0018 | 0.0029 | 1.04E-04 | 0.0054 | 3.63E-04 | ||
F2 | (20,10) | Mean | 0.6404 | 0.6403 | 0.6398 | 0.6424 | 0.6468 | 0.6417 | 0.6406 | 0.6511 |
Std | 3.19E-04 | 7.82E-04 | 0.0010 | 2.97E-04 | 0.0010 | 1.62E-04 | 5.83E-04 | 6.37E-05 | ||
(15,10) | Mean | 0.6303 | 0.6299 | 0.6231 | 0.6254 | 0.6426 | 0.6248 | 0.6250 | 0.6488 | |
Std | 7.78E-04 | 6.27E-04 | 0.0013 | 0.0032 | 0.0016 | 0.0011 | 5.69E-04 | 1.43E-04 | ||
(10,10) | Mean | 0.5962 | 0.5888 | 0.5800 | 0.5894 | 0.6340 | 0.5846 | 0.5885 | 0.6429 | |
Std | 0.0041 | 0.0121 | 0.0011 | 0.0270 | 8.67E-04 | 0.0079 | 0.0024 | 2.93E-04 | ||
F3 | (20,10) | Mean | 0.8597 | 0.8586 | 0.8611 | 0.8542 | 0.7645 | 0.7694 | 0.8588 | 0.8682 |
Std | 9.54E-04 | 4.75E-05 | 3.82E-04 | 0.0012 | 0.0106 | 1.02E-04 | 7.23E-04 | 7.26E-05 | ||
(15,10) | Mean | 0.8491 | 0.8491 | 0.8557 | 0.8383 | 0.7312 | 0.7606 | 0.8221 | 0.8665 | |
Std | 9.74E-04 | 0.0025 | 1.61E-04 | 0.0031 | 0.0045 | 8.70E-04 | 0.0010 | 1.12E-04 | ||
(10,10) | Mean | 0.7949 | 0.7904 | 0.8392 | 0.7627 | 0.6759 | 0.7502 | 0.7895 | 0.8619 | |
Std | 0.0042 | 0.0045 | 0.0012 | 0.0020 | 0.0034 | 1.56E-04 | 0.0031 | 1.89E-04 | ||
F4 | (20,10) | Mean | 0.8607 | 0.8605 | 0.8617 | 0.8632 | 0.8646 | 0.8602 | 0.8622 | 0.8674 |
Std | 2.11E-04 | 5.38E-05 | 1.94E-04 | 1.64E-04 | 1.23E-04 | 2.04E-04 | 3.05E-04 | 3.86E-05 | ||
(15,10) | Mean | 0.8516 | 0.8526 | 0.8531 | 0.8492 | 0.8611 | 0.8529 | 0.8541 | 0.8658 | |
Std | 0.0011 | 2.45E-04 | 9.69E-04 | 0.0020 | 1.63E-04 | 1.41E-04 | 5.41E-04 | 3.37E-04 | ||
(10,10) | Mean | 0.8216 | 0.8250 | 0.8313 | 0.8295 | 0.8539 | 0.8301 | 0.8342 | 0.8612 | |
Std | 0.0054 | 0.0053 | 0.0021 | 0.0011 | 8.65E-04 | 0.0016 | 0.0026 | 1.73E-04 | ||
F5 | (20,10) | Mean | 0.7030 | 0.7029 | 0.6598 | 0.6516 | 0.7034 | 0.6256 | 0.6556 | 0.7043 |
Std | 1.32E-04 | 1.39E-05 | 2.55E-04 | 0.0011 | 8.67E-04 | 1.76E-05 | 8.89E-04 | 1.00E-04 | ||
(15,10) | Mean | 0.7005 | 0.7011 | 0.6579 | 0.6459 | 0.7006 | 0.6239 | 0.6531 | 0.7029 | |
Std | 2.63E-04 | 1.02E-04 | 6.92E-04 | 7.59E-04 | 0.0028 | 6.34E-04 | 2.65E-04 | 1.22E-04 | ||
(10,10) | Mean | 0.6966 | 0.6964 | 0.6529 | 0.6037 | 0.6986 | 0.6175 | 0.6428 | 0.6997 | |
Std | 1.08E-04 | 1.77E-04 | 2.91E-04 | 0.0020 | 9.37E-04 | 0.0024 | 6.42E-04 | 1.28E-04 | ||
F6 | (20,10) | Mean | 1.0147 | 1.0154 | 1.0170 | 0.9985 | 1.0169 | 0.9788 | 0.9988 | 1.0214 |
Std | 0.0038 | 0.0018 | 0.0017 | 0.0055 | 0.0079 | 9.14E-04 | 0.0043 | 0.0056 | ||
(15,10) | Mean | 1.0010 | 1.0060 | 1.0040 | 0.9923 | 1.0105 | 0.9773 | 0.9956 | 1.0115 | |
Std | 0.0126 | 0.0116 | 0.0020 | 0.0107 | 0.0034 | 0.0049 | 0.0090 | 0.0026 | ||
(10,10) | Mean | 0.9988 | 0.9985 | 0.9934 | 0.9857 | 1.0015 | 0.9758 | 0.9915 | 1.0056 | |
Std | 0.0083 | 0.0038 | 0.0117 | 0.0518 | 0.0079 | 0.0048 | 0.0059 | 0.0010 | ||
F7 | (20,10) | Mean | 0.5294 | 0.5201 | 0.5886 | 0.5821 | 0.6724 | 0.5977 | 0.6022 | 0.7351 |
Std | 0.0214 | 0.0102 | 0.0021 | 0.0026 | 9.74E-04 | 3.31E-04 | 0.0021 | 1.50E-04 | ||
(15,10) | Mean | 0.4084 | 0.4119 | 0.5776 | 0.5642 | 0.6524 | 0.5887 | 0.5999 | 0.7220 | |
Std | 0.0026 | 0.0228 | 3.53E-04 | 0.0018 | 0.0027 | 2.22E-04 | 0.0022 | 0.0076 | ||
(10,10) | Mean | 0.2902 | 0.3036 | 0.5571 | 0.5007 | 0.6416 | 0.5690 | 0.5901 | 0.7166 | |
Std | 0.0057 | 0.0033 | 0.0065 | 0.0070 | 0.0010 | 5.84E-04 | 0.0034 | 2.40E-04 | ||
F8 | (20,10) | Mean | 3.0936 | 3.0475 | 2.8990 | 2.7988 | 3.4270 | 3.2993 | 3.3345 | 3.5342 |
Std | 0.0642 | 0.0467 | 0.0174 | 0.0165 | 0.0044 | 0.0013 | 0.0074 | 0.0019 | ||
(15,10) | Mean | 2.8396 | 2.8047 | 2.7445 | 2.4886 | 3.3664 | 3.2760 | 3.2985 | 3.4784 | |
Std | 0.0019 | 0.0532 | 0.0517 | 0.1279 | 0.0023 | 0.0011 | 0.0073 | 0.0023 | ||
(10,10) | Mean | 2.4662 | 2.4445 | 2.3414 | 2.0190 | 3.2432 | 3.2101 | 3.2564 | 3.4415 | |
Std | 0.0089 | 0.0874 | 0.0213 | 0.0126 | 0.0084 | 0.0053 | 0.0143 | 0.0475 | ||
F9 | (20,10) | Mean | 0.6891 | 0.6878 | 0.6937 | 0.6979 | 0.6999 | 0.6874 | 0.6957 | 0.7022 |
Std | 9.54E-04 | 1.36E-04 | 2.02E-04 | 2.72E-04 | 1.09E-04 | 8.49E-04 | 6.25E-04 | 2.17E-05 | ||
(15,10) | Mean | 0.6730 | 0.6689 | 0.6819 | 0.6904 | 0.6964 | 0.6246 | 0.6942 | 0.7011 | |
Std | 0.0014 | 0.0054 | 7.05E-04 | 3.47E-04 | 1.75E-04 | 0.0013 | 0.0012 | 2.72E-04 | ||
(10,10) | Mean | 0.6117 | 0.6055 | 0.6508 | 0.6307 | 0.6893 | 0.6173 | 0.6921 | 0.7001 | |
Std | 0.0022 | 0.0081 | 0.0035 | 0.0082 | 2.69E-04 | 0.0041 | 0.0048 | 2.17E-04 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F10 | (20,10) | Mean | 0.7061 | 0.7066 | 0.7057 | 0.7054 | 0.7090 | 0.7064 | 0.7068 | 0.7086 |
Std | 5.67E-04 | 3.21E-04 | 1.18E-05 | 8.30E-05 | 3.96E-05 | 1.42E-04 | 5.62E-04 | 2.17E-05 | ||
(15,10) | Mean | 0.7043 | 0.7041 | 0.7053 | 0.7046 | 0.7089 | 0.7048 | 0.7049 | 0.7082 | |
Std | 1.38E-04 | 3.77E-04 | 8.95E-05 | 5.22E-04 | 2.08E-05 | 4.39E-04 | 3.17E-04 | 1.64E-04 | ||
(10,10) | Mean | 0.7021 | 0.7027 | 0.7034 | 0.7017 | 0.7084 § | 0.7032 | 0.7038 | 0.7064 | |
Std | 2.31E-04 | 3.05E-04 | 4.33E-04 | 4.06E-04 | 9.22E-05 | 3.29E-04 | 3.60E-04 | 0.0013 | ||
F11 | (20,10) | Mean | 0.0734 | 0.1444 | 0.4341 | 0.2560 | 0.5887 | 0.3369 | 0.4823 | 0.6009 |
Std | 0.0033 | 0.0229 | 0.0017 | 0.0053 | 0.0023 | 0.0116 | 0.0127 | 9.01E-04 | ||
(15,10) | Mean | 0.0639 | 0.0943 | 0.3046 | 0.1155 | 0.5166 | 0.3217 | 0.4092 | 0.5463 | |
Std | 0.0132 | 0.0531 | 0.0130 | 0.0319 | 0.0122 | 0.0243 | 0.0099 | 0.0054 | ||
(10,10) | Mean | 0.0900 | 0.0413 | 0.0896 | 0.0445 | 0.2651 | 0.2673 | 0.1993 | 0.4142 | |
Std | 9.56E-04 | 0.0076 | 0.0136 | 0.0266 | 0.0365 | 0.0133 | 0.0085 | 4.68E-04 |
. | . | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|---|
. | . | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
functions . | . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
F10 | (20,10) | Mean | 0.7061 | 0.7066 | 0.7057 | 0.7054 | 0.7090 | 0.7064 | 0.7068 | 0.7086 |
Std | 5.67E-04 | 3.21E-04 | 1.18E-05 | 8.30E-05 | 3.96E-05 | 1.42E-04 | 5.62E-04 | 2.17E-05 | ||
(15,10) | Mean | 0.7043 | 0.7041 | 0.7053 | 0.7046 | 0.7089 | 0.7048 | 0.7049 | 0.7082 | |
Std | 1.38E-04 | 3.77E-04 | 8.95E-05 | 5.22E-04 | 2.08E-05 | 4.39E-04 | 3.17E-04 | 1.64E-04 | ||
(10,10) | Mean | 0.7021 | 0.7027 | 0.7034 | 0.7017 | 0.7084 § | 0.7032 | 0.7038 | 0.7064 | |
Std | 2.31E-04 | 3.05E-04 | 4.33E-04 | 4.06E-04 | 9.22E-05 | 3.29E-04 | 3.60E-04 | 0.0013 | ||
F11 | (20,10) | Mean | 0.0734 | 0.1444 | 0.4341 | 0.2560 | 0.5887 | 0.3369 | 0.4823 | 0.6009 |
Std | 0.0033 | 0.0229 | 0.0017 | 0.0053 | 0.0023 | 0.0116 | 0.0127 | 9.01E-04 | ||
(15,10) | Mean | 0.0639 | 0.0943 | 0.3046 | 0.1155 | 0.5166 | 0.3217 | 0.4092 | 0.5463 | |
Std | 0.0132 | 0.0531 | 0.0130 | 0.0319 | 0.0122 | 0.0243 | 0.0099 | 0.0054 | ||
(10,10) | Mean | 0.0900 | 0.0413 | 0.0896 | 0.0445 | 0.2651 | 0.2673 | 0.1993 | 0.4142 | |
Std | 9.56E-04 | 0.0076 | 0.0136 | 0.0266 | 0.0365 | 0.0133 | 0.0085 | 4.68E-04 |
In Table 4, column 10 provides the results of MOEA-OSD/SRS in terms of for different settings, which are all as good as or better than the best results obtained by the five algorithms. From the statistical results of Wilcoxon rank-sum test, we can see that on these 11 benchmark functions with three environmental settings (33 instances in total), the proposed SRS significantly outperforms the best of the first five compared response strategies on 11 instances and performs equally well on the rest 22 instances.
All the above results confirm that SRS can indeed select the most suited response strategy for different benchmark functions, thereby being capable of solving DMOPs subject to unknown environmental changes.
In addition, the 9th column of Table 4 also presents the results of obtained by MOEA-OSD/SADI. Based on these results, we can conclude that MOEA-OSD/SRS has a better performance than MOEA-OSD/SADI on all instances.
In addition, the average running time of 20 independent runs of all algorithms on all benchmark functions when is set to (10,10), is listed in Table 5,0 of60 the Supplementary material. On average, MOEA-OSD/SRS is a little bit time-consuming. This is reasonable since SRS needs to implement all five response strategies. When an environmental change occurs, the five response strategies all generate a new population, then SRS selects different ratios of individuals from each population to form a new population to respond to the environmental change. It should be pointed out that the increase in computational complexity might be negligible compared to the very time-consuming fitness evaluations in many expensive real-world optimization problems (Jin and Sendhoff, 2002; Jin et al., 2018).
4.4 Comparison between MOEA-OSD/SRS and the Other Seven DMOAs
To evaluate the performances of the entire MOEA-OSD/SRS for dynamic multiobjective optimization, we compare it with seven popular DMOAs.
4.4.1 Compared Algorithms and Parameter Settings
To further demonstrate the effectiveness of MOEA-OSD/SRS, we compare it with the other seven state-of-the-art DMOAs, which are DNSGA-II-A (Deb et al., 2007), DNSGA-II-B (Deb et al., 2007), RM-MEDA based on FPS (denoted as FPS-RM-MEDA) (Zhou et al., 2014), RM-MEDA based on PPS (denoted as PPS-RM-MEDA) (Zhou et al., 2014), SGEA (Jiang and Yang, 2017b), and multiobjective evolutionary algorithm based on decomposition (MOEA/D) (Zhang and Li, 2007), and Immune Generalized Differential Evolution 3 (Immune-GDE3) (Martínez-Peñaloza and Mezura-Montes, 2018). The detailed parameter settings can be found in Section S5.1 of the Supplementary material.
4.4.2 Experimental Results of , , and
Tables 5–7,0 list the statistical results of , , and obtained by MOEA-OSD/SRS and seven compared algorithms over 20 runs when is set as (10,10), (15,10), and (20,10). In those tables, the results of the best performing algorithm, that is, the one obtaining the smallest mean values of , the smallest mean values of , and the largest values of , are highlighted. The Wilcoxon rank-sum test (Derrac et al., 2011) is conducted to compare the significance of difference between MOEA-OSD/SRS and the seven compared algorithms. Since it is necessary to compare the performance difference between MOEA-OSD/SRS and each of comparison algorithm, in order to better present the experimental results, we just use symbols “”, “§”, and “” to express the statistical analysis results. “”, “§”, and “” indicate that the performance of MOEA-OSD/SRS is better than, worse than, or comparable to that of the algorithm under comparison, respectively.
Meanwhile, it can be seen from Tables 5–7, among the three different types of environmental changes, when is set as (20,10), the performance of different algorithms is better than the situations that is set as (10,10) and (15,10), and the performance of the algorithm is getting better and better with the increasing of .
a) From Table 5 (): we observe that MOEA-OSD/SRS outperforms other algorithms on most benchmark functions, except on F10, while SGEA performs significantly better than all compared algorithms on F10. For F10, as seen from Table 4, MOEA-OSD/SRS is able to select the most effective response strategy for F10, so the poor performance of MOEA-OSD/SRS on F10 may be attributed to the poor performance of the static algorithm MOEA-OSD on F10.
b) From Table 6 (): it is noted that MOEA-OSD/SRS obtains the best results on F1, F2, F6, and F11, while SGEA performs the best on other seven benchmark functions. It implies that MOEA-OSD/SRS only maintains better distribution on few benchmark functions, and MOEA-OSD/SRS is inferior to SGEA. From these experimental results, we can conclude that MOEA-OSD/SRS should incorporate some strategy to improve the diversity when dealing with DMOPs.
c) From Table 7 (): we can see that the values obtained by the compared algorithms are largely consistent with the values presented in Table 7. Clearly, MOEA-OSD/SRS is more promising than the compared algorithms for solving DMOPs, although it is outperformed by SGEA on F10. The possible reason for this has been discussed previously in the analysis of .
Last but not least, recall that and measure the performance of a solution set in terms of both convergence and distribution. As a result, if an algorithm achieves solutions with a poor performance in diversity, it is possible that it exhibits a good and value on account of a superior performance in convergence.
Meanwhile, MOEA-OSD/SRS is relatively better than the seven compared algorithms on F11, which is a nonperiodic function, although all the algorithms are not able to obtain better performance in terms of , , and .
4.4.3 Comparison of the Tracking Ability of the Eight Algorithms
In addition to the above experimental results, the comparison results of the obtained PF of the eight compared algorithms are also presented in Section S5.2 of the Supplementary material. Meanwhile, the average runtime of 20 independent runs of the compared algorithms are presented in Section S5.3 of the Supplementary material, verifying that MOEA-OSD/SRS is the fastest algorithm among the eight algorithms.
Furthermore, it should be noted that the baseline multiobjective optimization algorithm is also an important component of a DMOA, which heavily affects the performance of DMOAs. Thus, we also make a comparison of MOEA-OSD with other six well-known multiobjective optimization algorithms, indicating that MOEA-OSD is the best-performing and computationally most efficient algorithm. The details are shown in Section S6 of the Supplementary material.
Last but not least, we also conduct a sensitivity analysis to investigate the influence of some parameters on the performance of MOEA-OSD/SRS, including the severity of the environmental changes, that is, , the proportion of diversity introduction in RDI and MDI, differential crossover probability (CR), differential scale factor (F), and Gaussian mutation probability. The details are in Section S7 of the Supplementary material.
5 PID Controller Parameter Turning
To verify the performance of the proposed MOEA-OSD/SRS on real applications, we use it to tune the coefficients of the PID controller of a dynamic system.
The PID controller is very widely used to obtain the control according to the deviation between the desired input value and the actual output value of the system. In fact, the parameters of the system may change due to the aging of the equipment or the interference of the environmental noise (Farina et al., 2004). So in order to obtain the satisfactory control effect, the parameters of PID controller should be adjusted adaptively with the change of the system parameters.
We assume that the range of the controller parameters are known; that is, , , and .
To verify the performance of MOEA-OSD/SRS for tuning the PID parameters of the dynamic system, we compare MOEA-OSD/SRS with seven DMOAs as described in Section 4.4.1.
Table 8 shows the statistical results of , and obtained by MOEA-OSD/SRS and other seven compared algorithms. Note, the PF corresponding to the nondominant solutions in the PS obtained by all eight algorithms makes up the real PF of each environment. It is obvious that MOEA-OSD/SRSA is of better performance, that is to say, the control effect of the PID controller optimized by MOEA-OSD/SRS is much better. Therefore, MOEA-OSD/SRS is promising to be applied to tune the parameters of the PID controller of the dynamic system.
. | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|
. | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
Metrics . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
Mean | 4.9289 | 4.8479 | 3.7097 | 3.6284 | 3.9999 | 4.0811 | 4.6840 | 3.4995 | |
Std | 0.0579 | 0.1245 | 0.1196 | 0.0373 | 0.0815 | 0.1001 | 0.0968 | 0.0128 | |
Mean | 1.8673 | 1.6659 | 0.1303 | 3.6284 | 0.0417 § | 0.0639 | 0.0491 | 0.0451 | |
Std | 0.3479 | 0.5166 | 0.1156 | 0.0373 | 0.0019 | 0.0108 | 0.0030 | 0.0028 | |
Mean | 2.3793 | 2.3823 | 2.4038 | 2.4050 | 2.4005 | 2.3891 | 2.4089 | 2.6319 | |
Std | 0.0093 | 0.0164 | 0.0033 | 0.0011 | 0.0030 | 0.0032 | 0.0125 | 1.15E-04 |
. | . | . | . | FPS . | PPS . | . | . | . | MOEA . |
---|---|---|---|---|---|---|---|---|---|
. | . | DNSGA . | DNSGA . | -RM . | -RM . | . | . | Immune . | -OSD . |
Metrics . | Statistic . | -II-A . | -II-B . | -MEDA . | -MEDA . | SGEA . | MOEA/D . | GDE3 . | /SRS . |
Mean | 4.9289 | 4.8479 | 3.7097 | 3.6284 | 3.9999 | 4.0811 | 4.6840 | 3.4995 | |
Std | 0.0579 | 0.1245 | 0.1196 | 0.0373 | 0.0815 | 0.1001 | 0.0968 | 0.0128 | |
Mean | 1.8673 | 1.6659 | 0.1303 | 3.6284 | 0.0417 § | 0.0639 | 0.0491 | 0.0451 | |
Std | 0.3479 | 0.5166 | 0.1156 | 0.0373 | 0.0019 | 0.0108 | 0.0030 | 0.0028 | |
Mean | 2.3793 | 2.3823 | 2.4038 | 2.4050 | 2.4005 | 2.3891 | 2.4089 | 2.6319 | |
Std | 0.0093 | 0.0164 | 0.0033 | 0.0011 | 0.0030 | 0.0032 | 0.0125 | 1.15E-04 |
6 Conclusion
In this article, we propose a self-adaptive response strategy together with a decomposition-based evolutionary algorithm, MOEA-OSD/SRS for short, for optimization of DMOPs. MOEA-OSD aims to find the Pareto optimal solution for each subobjective space, making it easier to maintain the diversity of the obtained solution set. MOEA-OSD adopts the maxi-min fitness function to compute the fitness value of each individual in each subobjective space, which is able to take into account both diversity and convergence properties of the solutions.
The proposed self-adaptive response strategy (SRS) integrates five popular response strategies developed for dynamic optimization and determines the probability of selecting each of the response strategies based on their previous performance. As a result, SRS is able to adaptively select the most effective response strategy for different dynamic problems, thereby being able to more effectively cope with unknown environmental changes than a single prespecified response strategy. It is worth noting that SRS can be embedded in any high-performance multiobjective optimization algorithm to solve DMOPs. Extensive empirical studies are conducted to demonstrate the effectiveness of the proposal self-adaptive response strategy. We first compare SRS with six state-of-the-art response strategies taken from the literature. Our results show that SRS is able to adaptively select the best response strategy for an unknown environment. Then, our comparisons of MOEA-OSD/SRS with seven state-of-the-art dynamic evolutionary multiobjective algorithms demonstrate its competitiveness for solving DMOPs. Finally, MOEA-OSD, as the base optimizer, is compared with six popular MOEAs to verify that MOEA-OSD is well suited for dynamic multiobjective optimization. In addition, a sensitivity analysis of the parameters in MOEA-OSD/SRS has been performed. Finally, an application of the proposed algorithm to the PID controller parameter tuning problem demonstrates the competitiveness of the proposed algorithm.
Although MOEA-OSD/SRS has provided encouraging performance on the DMOPs considered in this article, it still has much room for improvement. Our future work will be dedicated to design more efficient response strategies to integrate into SRS to solve challenging DMOPs. It is also of interest to extend the proposed MOEA-OSD/SRS to solve constrained DMOPs.
Acknowledgments
This work was supported by the Provincial Natural Science Foundation of Shaanxi of China (No. 2019JZ-26) and the National Natural Science Foundation of China (Nos. 61876141 and 61373111).