Abstract

Lightning attachment procedure optimization (LAPO) is a new global optimization algorithm inspired by the attachment procedure of lightning in nature. However, similar to other metaheuristic algorithms, LAPO also has its own disadvantages. To obtain better global searching ability, an enhanced version of LAPO called ELAPO has been proposed in this paper. A quasi-opposition-based learning strategy is incorporated to improve both exploration and exploitation abilities by considering an estimate and its opposite simultaneously. Moreover, a dimensional search enhancement strategy is proposed to intensify the exploitation ability of the algorithm. 32 benchmark functions including unimodal, multimodal, and CEC 2014 functions are utilized to test the effectiveness of the proposed algorithm. Numerical results indicate that ELAPO can provide better or competitive performance compared with the basic LAPO and other five state-of-the-art optimization algorithms.

1. Introduction

Optimization problems can be found in many engineering application domains and scientific fields which have a complex and nonlinear nature. It is usually difficult to solve these optimization problems using classical mathematical methods since such methods are often inefficient and have a requirement of strong math assumptions. Due to the limitations of classical approaches, many natural-inspired stochastic optimization algorithms have been proposed to conduct global optimization problems in the last two decades. Such optimization algorithms were commonly simple and easy to implement, and these features make the possibility to solve highly complex optimization problems. These metaheuristics can be roughly classified into three categories: evolutionary algorithms, swarm intelligence, and physical-based algorithms.

Evolutionary algorithms are generic population-based metaheuristics, which imitate the evolutionary behavior of biology in nature such as reproduction, mutation, recombination, and selection. The first generation starts with randomly initialized solutions and further evolves over successive generations. The best individual among the whole population in the final evolution is considered to be the optimization solution. Some of the popular evolutionary algorithms are genetic algorithm (GA) [1], genetic programming (GP) [2], evolution strategy (ES) [3], differential evolution (DE) algorithm [4], and biogeography-based optimizer (BBO) [5].

Swarm intelligence algorithms mimic the collective behavior of swarms, herds, schools, or flocks of creatures in nature, which interact with each other and utilize full information about their environment with the progress of algorithm. For example, honey bees are capable of guaranteeing the survival of a colony without any external guidance. In other words, no one tells honey bees how and where to find food sources; instead, they cooperatively seek the food sources even that is located far away from their nests. In this category, particle swarm optimization (PSO) [6], ant colony optimization (ACO) [7], and artificial bee colony algorithm (ABC) [8] can be regarded as representative algorithms. Some other popular swarm intelligence algorithms are firefly mating algorithm (FMA) [9], shuffled frog leaping algorithm (SFLA) [10], bee collecting pollen algorithm (BCPA) [11], cuckoo search (CS) algorithm [12], dolphin partner optimization (DPO) [13], bat-inspired algorithm (BA) [14], firefly algorithm (FA) [15], and hunting search (HUS) algorithm [16]. Some of the recent swarm intelligence algorithms are fruit fly optimization algorithm (FOA) [17], dragonfly algorithm (DA) [18], artificial algae algorithm (AAA) [19], ant lion optimizer (ALO) [20], shark smell optimization algorithm (DSOA) [21], whale optimization algorithm (WOA) [22], crow search algorithm (CSA) [23], grasshopper optimization algorithm (GOA) [24], mouth brooding fish algorithm (MBFA) [25], spotted hyena optimizer (SHO) [26], butterfly-inspired algorithm (BFA) [27], squirrel search algorithm (SSA) [28], Andean condor algorithm (ACA) [29], and pity beetle algorithm (PBA) [30].

The third category is physical-based algorithms which are based on the basic physical laws such as gravitational force, electromagnetic force, and inertia force. Some of the prevailing algorithms of this category are simulated annealing (SA) [31], gravitational search algorithm (GSA) [32], big-bang big-crunch (BBBC) algorithm [33], charged system search (CSS) [34], black hole (BH) algorithm [35], central force optimization (CFO) [36], small-world optimization algorithm (SWOA) [37], artificial chemical reaction optimization algorithm (ACROA) [38], ray optimization (RO) algorithm [39], galaxy-based search algorithm (GbSA) [40], and curved space optimization (CSO) [41], gravitational search algorithm (GSA) [32], and multiverse optimizer (MVO) [42].

Regardless of the difference among the three categories of algorithms, a common point lies in that besides tuning of common control parameters such as population size and number of generations, the metaheuristic algorithms necessitate tuning of algorithm-specific parameters during the course of optimization. For instance, GA requires tuning of cross-over probability, mutation probability, and selection operator [43]; SA requires tuning of initial temperature and cooling rate [31]; PSO requires tuning of inertia weight and learning factors [6]. The improper tuning of these parameters either increases the computational cost or leads to the local optimal solution.

Recently, a new physical-based metaheuristic algorithm named lightning attachment procedure optimization (LAPO) [44] was proposed, which does not require tuning of any algorithm-specific parameters. Instead, an average value of all solutions was employed to adjust the lightning jump behavior of moving towards or away from a jumping point (or position) in a self-adaptive manner. This is an important reason that LAPO is not easily stuck in the local optimal solution and has a good exploration and exploitation abilities. LAPO has already proved its superiority in solving a number of constrained numerical optimization problems [44].

In this paper, an enhanced lightning attachment procedure optimization, namely, ELAPO is developed to increase the convergence speed during the search process of LAPO while maintaining the key feature of the LAPO as free from algorithm-specific parameters tuning. In ELAPO, a concept of opposition-based learning (OBL) is incorporated for enhancing the searching ability of metaheuristic algorithms. The motivation is that the current estimates and their corresponding opposites are considered simultaneously to find the better solutions, thereby enabling the algorithm to explore a large region of the search space in every generation. This concept was found to be effective in improving the performance of well-known optimization algorithms such as genetic algorithms (GA) [45], differential evolution (DE) [46, 47], particle swarm optimization (PSO) [48, 49], biogeography-based optimization (BBO) [50, 51], harmony search (HS) algorithm [52, 53], gravitational search optimization (GSO) [54, 55], group search algorithm (GSA) [56, 57], and artificial bee colony (ABC) [58]. Meanwhile, a dimensional search strategy is proposed to intensively exploit a local search for each variable of the best solution in each iteration, thus resulting in a higher quality of solution at the end of iteration and strengthening the exploitation of the algorithm. To evaluate the effectiveness of the proposed algorithms, ELAPO is applied to 32 benchmark functions and compared with the basic LAPO and six representative swarm intelligence algorithms (SSA [28], Jaya [59], IBB-BC [60], ODE1 [61], and ALO [20]). The effectiveness of the two strategies is also discussed.

The rest of this paper is organized as follows: Section 2 briefly recapitulates the basic LAPO. Next, the proposed ELAPO is presented in a detailed way in Section 3. Numerical comparisons are illustrated in Section 4. Finally, Section 5 gives the concluding remarks.

2. Basic Algorithm

LAPO is a new nature-inspired global optimization, which mimics the lightning attachment procedure including the downward leader movement and the upward leader propagation. The lightning is a sudden electrostatic discharge occurring between electrically charged regions of a cloud, which moves toward or away from the ground in a stepwise movement. After each step, the downward leader stops and then moves to a randomly selected potential point that may have higher value of electrical field. The upward leader starts from sharp points and goes towards the downward leader. The branch fading feature of lightning is taken effect when the charge of a branch is lower than a critical value. In the case where the two leaders join together, a final strike occurs and the charge of the cloud is neutralized.

2.1. Parameters and Initialization of Test Points

Main parameters of the LAPO consist of the maximum number of iterations , the number of test points , the number of decision variables n, and the upper and lower bounds for decision variable and . These parameters are given at the beginning of the algorithm. Similar to other nature-inspired optimization algorithms, an initial population is required. Each population is regarded as a test point in the feasible search space, which could be an emitting point of the downward or upward leader. The test points are randomly initialized as follows:where is a uniformly distributed random number in the range [0, 1]. The electric field (i.e., fitness value) of each test point is calculated based on the objective function:

2.2. Downward Leader Movement toward the Ground

In this phase, all the test points are considered as the downward leader and move down towards the ground. The average value of all test points and its corresponding fitness value are calculated as follows:

Given the fact that the lightning has a random behavior, for test point i, a random point k is selected among the population (ik), and the new test point is updated based on the following rules: (i) if the electric field of point k is higher than the average electric field, thenand (ii) if the electric field of point k is lower than the average electric field, then

If the electric field of the new test point is better than the old one, the branch sustains; otherwise, it fades. This feature is mathematically formulated as

2.3. Upward Leader Movement

In the upward movement phase, all the test points are considered as the upward leader towards the cloud. The new test points are generated as follows:where and are the best and the worst solutions of the population and S is an exponent factor that is a function of the number of iterations and the maximum number of iterations :

From a computational point of view, this iteration-dependent exponent factor is important for the balance of exploration and exploitation capabilities of the algorithm. Similar to the downward movement, the branch fading feature also occurs in this phase.

2.4. Enhancement of the Performance

In order to enhance the performance of LAPO, in each iteration, the worst test point is replaced by the average test point if the fitness of the former is worse than the latter:

2.5. Stopping Criterion

The algorithm terminates if the maximum number of iterations is satisfied. Otherwise, the procedures of downward and upward leader movements and of performance enhancement are repeated.

2.6. Procedure of the Basic LAPO

The complete computational procedure of the basic LAPO is provided in Algorithm 1.

(1)Set , , n, and
(2)Randomly initialize the test points
(3)
(4)Calculate fitness value
(5)
(6)while
(7) Calculate average value of all test points and its fitness value
(8)
(9)
(10)if
(11)  
(12)end
(13) Downward leader movement toward the ground
(14)for i = 1: 
(15) randomly select
(16)  if
(17)   
(18)  else
(19)   
(20)  end
(21)  Calculate fitness value of new test points
(22)  if
(23)   
(24)  end
(25)end
(26) Upward leader movement
(27)for i = 1: 
(28)  
(29)  
(30)  if
(31)   
(32)  end
(33)end
(34)
(35)end

3. The Enhanced Lightning Attachment Procedure Optimization

The enhanced lightning attachment procedure optimization (ELAPO) is presented in this section. Two main strategies exist in the ELAPO. First, a quasi-opposition-based learning strategy is developed and employed randomly to diversify the population. Second, the dimensional search strategy is proposed to improve the quality of the best solution in each iteration. The key ideas behind ELAPO are illustrated as follows.

3.1. Quasi-Opposition-Based Learning

In order to prevent the proposed algorithm from being trapped in local optimal solutions, a monitoring condition is introduced and checked in each iteration. Following steps are involved. First, a distance constant between the average test point and the best test point is calculated:

Second, the minimum value of the distance constant condition is computed:and the monitoring condition is then checked. If , the concept of opposition-based learning is employed to further diversify the population and improve the convergence rage of the algorithm. In the strategy, a portion of test points is randomly selected, based on which the corresponding opposite test points are generated and both are considered at the same time. Then, the fitness of the original test points and the quasi-opposite test points are calculated and ranked in a descending order, from which the first solutions are selected for proceeding the downward leader movement and the upward leader movement. In order to maintain the stochastic nature of ELAPO, a quasi-opposite solution is randomly generated between the center of the search space CS and the mirror point of the corresponding test point MP:where Nq is the number of randomly chosen test points for the generation of opposite test points, and it is set to be 5 in this paper.

3.2. Enhancing Dimensional Search

During the search process of the basic LAPO, all dimensions of each test point are updated simultaneously after each iteration. In other words, different variables in each dimension are dependent. However, this procedure has one obvious drawback: the change in one dimensional variable may cause negative impacts on other dimensional variables, thereby leading to poor convergence performance in each dimension. In order to enhance the dimensional search for each variable, the following four steps are carried out in each iteration: (a) find the best test point, (b) generate one new solution based on the best test point in a way that the value of one variable is revised while the rest of variables are preserved, (c) compare fitness values of the new-generated solution with the old solution, and reserve the better one, and (d) repeat steps (b) and (c) for other dimensional variables. The new-generated solution is produced according the following rule:

3.3. Procedure of ELAPO

The complete computational procedure of the enhanced ELAPO is provided in Algorithm 2.

(1)Set , , , n, and
(2)Randomly initialize the test points
(3)
(4)Calculate fitness value
(5)
(6)while
(7) Calculate average value of all test points and its fitness value
(8)
(9)
(10)if
(11)  
(12)end
(13) Generate quasi-opposite test points
(14),
(15)if
(16)  ;
(17)  
(18)end
(19) Select good solutions from the original test points and the quasi-opposite test points
(20) Downward leader movement toward the ground
(21)for i = 1: 
(22) randomly select
(23)  if
(24)   
(25)  else
(26)   
(27)  end
(28)  Calculate fitness value of new test points
(28)  if
(29)   
(30)  end
(31)end
(32) Upward leader movement
(33)for i = 1: 
(34)  
(35)  
(36)  if
(37)   
(38)  end
(39)end
(40) Enhance intensive dimensional search
(41) Find
(42)for j = 1: n
(43)  
(44)  Calculate fitness value of the new solution
(45)  
(46)  if
(47)   
(48)   
(49)  end
(50)end
(51)
(52)End

4. Experimental Results and Analysis

In this section, the performance of ELPAO is evaluated by means of 32 different benchmark functions and the results are compared to those of several state-of-the art metaheuristic optimization algorithms. The benchmark functions are listed in Tables 13, among which F1–F11 are unimodal functions, F13–F25 belong to multimodal functions, and F26–F32 are composite functions provided by IEEE CEC 2014 special section [62]. In these tables, n refers to dimension of functions, Range donates the search space, and Fmin is the true optimal value of the test functions. Two kinds of dimension (n = 30, and 100) are chosen in order to evaluate the capability of the proposed algorithm for solving different scale test functions.

Six metaheuristic optimization algorithms are utilized in this section as a comparison with the proposed algorithm, including the basic LAPO, squirrel search algorithm (SSA) [28], Jaya [59], improved big bang-big crunch algorithm (IBB-BC) [60], opposition-based differential evolution algorithm (ODE1) [61], and ant lion optimizer (ALO) [20]. The population size and the maximal iteration number are set to be 50 and 1000, respectively. The same set of initial random populations is used to evaluate different algorithms. The error value, defined as f(x) − Fmin, is recorded for the solution x, where f(x) is the optimal fitness value of the function calculated by the algorithms. The widely used parametric settings of all algorithms are listed in Table 4. Each algorithm is applied on the test functions in 10 independent runs. The average and standard deviation of the error values over all independent runs is calculated. Meanwhile, all algorithms are compared in terms of convergence behavior with different curves (Figures 16). In addition, the effectiveness of each strategy is tested.

4.1. Experimental Test 1: Unimodal Functions

Unimodal benchmark functions have one global optimal solution, and they are commonly used for evaluating the exploitation ability of optimization algorithms. Tables 5 and 6 list the statistical results (the mean error and standard deviation) by different algorithms through 10 independent runs at n = 30 and 100, respectively. In these tables, the best values are highlighted in bold. It is obvious from the results that ELAPO has an extremely high level of accuracy and convergence precision for most of unimodal functions in comparison to other six counterpart algorithms. Taken F10 as an example, ELAPO can reach a mean error level of 10E − 195 with zero standard deviation at , while the accuracy of the rest algorithms is ranked in an order of LAPO (10E − 27), ODE1 (10E − 11), ALO (10E − 7), SSA (10E − 6), IBB-BC (10E − 4), and Jaya (10E − 2). It is also found that ELAPO is able to achieve the true minimal value of F3 and F11, while the rest of algorithms fail to obtain the same level of accuracy except for LAPO on F3. The increase in the number of dimensions seems to not affect the outstanding accuracy of ELAPO in comparison to other algorithms, though the accuracy of all algorithms tends to decrease.

Figures 1 and 2 show the convergence behaviors of some test functions for ELAPO and its competitors at n = 30 and 100, respectively. As can be seem from these figures, for most of test functions, ELAPO dramatically outperforms its competitors in terms of both convergence rate and precision. For F5 and F6, the convergence performance of ELAPO is still the best, though LAPO tends to have similar behaviors, and the difference between ELAPO and the rest five algorithms seems to be not very significant. Such excellent performance of ELAPO may be due to the introduction of quasi-opposition-based learning strategy as well as the dimensional search strategy.

4.2. Experimental Test 2: Multimodal Functions

Different from unimodal function, multimodal test functions have multiple local optimal solutions and thus are commonly adopted by researchers for testing the exploration ability of an algorithm. Tables 7 and 8 provide the recorded results of statistical analysis over 10 independent runs for n = 30 and 100, respectively. From these tables, it is clear that ELAPO can get better level of accuracy for most of test functions compared with other six algorithms. Particularly, ELAPO is able to obtain the exact true values of F17, F18, F21, F22, and F24. It is also interesting to find that ELAPO is still better than LAPO on F20 although both cannot match with SSA at all dimensions involved. Similar to the observation in the unimodal functions, ELAPO seems to be insensitive to the increase of dimensional number.

The convergence performance of all algorithms for several multimodal benchmark functions at n = 30 and 100 are presented in Figures 3 and 4, respectively. As can be found in these figures, ELAPO always has the fastest convergence rate and can reach the best (at least comparable) convergence precision in comparison to other six algorithms. For some multimodal functions such as F13, F14, and F16, the convergence performance of LAPO is unsatisfactory, while the global convergence ability of ELAPO is improved greatly. This is mainly contributed by the quasi-opposition-based strategy in which new opposite test points are generated according to a portion of randomly selected test points and both are simultaneously employed for global searching.

4.3. Experimental Test 3: CEC 2014 Benchmark Functions

In this experimental study, most intensely investigated benchmark functions used in IEEE CEC 2014 are considered for evaluating both exploration and exploitation capabilities of ELAPO. Seven CEC 2014 functions are considered, which consist of several novel basic problems (e.g., with shifting and rotation) and hybrid and composite test problems. These modern benchmark functions are specially developed with complex features; consequently, all the algorithms can hardly reach the global optimum. However, as per statistical results obtained from different algorithms through 10 independent runs in Tables 9 and 10, ELAPO is able to yield highly competitive results for all CEC 2014 functions under consideration as compared with other six algorithms. For example, the mean error of F27 is as low as a level of 10E − 1 for ELAPO, while the corresponding mean errors are dramatically larger for LAPO (10E + 2), ODE1 (10E + 3), SSA, IBB-BC and ALO (10E + 4), and Jaya (10E + 9). As the number of dimension increases, all algorithms produce relatively larger mean errors for F26–29 with higher standard deviations, among which ELAPO still ranks No. 1. For the composite functions (F30–32), the increase of dimension seems to not affect the statistical results of all algorithms and ELAPO tends to give slightly better results than other six algorithms.

Figures 5 and 6 show the average convergence curves for four selected CEC 2014 benchmark functions at n = 30 and 100, respectively. It is clear that ELAPO has promising convergence behavior compared with other six algorithms, and thus ELAPO proves to be the best among all algorithms on seven CEC 2014 functions. This serves as a further confirmation that ELAPO possesses excellent balance between exploration and exploitation.

4.4. Effectiveness of the Two Strategies

In order to verify the effectiveness of the two strategies in the proposed algorithm, this subsection performs the previous three experiments for ELAPO, LAPO with quasi-opposition-based learning only (denoted as ELAPO1), and LAPO with dimensional search strategy only (denoted as ELAPO2), respectively. The statistical results (the minimum, mean and maximum fitness values, and the standard deviation) of different ELAPO variants are recorded in Tables 1116 for various test functions at n = 30 and 100. For each function, the overall best results among the three algorithms are highlighted in bold.

For most of the unimodal functions, as shown in Tables 11 and 12, ELAPO outperforms the other two variants in terms of the minimum, mean and maximum fitness values, and the standard deviation. This confirms that for most of the functions, both strategies take effects on enhancing the global search ability and the contribution of the quasi-opposition-based learning strategy is more important. As for F6, it seems that the dimensional search strategy has bigger contributions on the exploitation ability of ELAPO. It is also noted that ELAPO and its two variants have almost the same statistical results because, as per Table 5, the basic LAPO has already converged to desirable accuracy and thus the two strategies seem to have no effects.

Tables 13 and 14 show the minimum, mean and maximum fitness values, and the standard deviation of the multimodal benchmark functions using ELAPO and its two variants. It is clear to find that for most of benchmark functions, both strategies are beneficial to the global search performance and their individual contributions vary for a specific function. For example, the quasi-opposition-based learning strategy has more important effects on F13, F14, and F17; the dimensional search strategy plays a more important role on F15, F16, and F20; both strategies have almost equal contributions on F12 and F23. For F21, F22, and F24, both strategies seem to have no effect. This is because, as per Table 8, the basic LAPO has already obtained the exact optimum. It is also interesting to find that negative effect may be exerted on the global optimization capability. Taking F25 as an example, the best minimum, mean, and maximum fitness values all lied on ELAPO2. In other words, the dimensional search strategy and the quasi-opposition-based learning strategy take positive and negative effects on F25, respectively; the combination of both (ELAPO) can only achieve a middle place of statistical results between ELAPO1 and ELAPO2. This phenomenon is expected and reasonable according to the “no free lunch” (NFL) theorem [59] that stated that no any single algorithm is able to efficiently solve all optimization problems. For some other multimodal functions, the two strategies are sensitive to the number of dimensions. For instance, the contribution of F18 mainly comes from the quasi-opposition-based learning strategy under the condition at , while at the main contribution is from the dimensional search strategy. For F19, ELAPO1 seems to have equal contribution as ELAPO2 at , while at , the former tends to have negative effect on the global search performance.

The statistical results for CEC 2014 benchmark functions are presented in Tables 15 and 16. It can be seen from the tables that both strategies have positive influences on F26, F27, F28, and F29, and the dimensional search strategy tends to take greater effects especially when the number of dimensions is higher. For composite functions, as the complexity of the function increases, the two strategies are still able to make slight contributions, and thus, as per Tables 9 and 10, ELAPO can get competitive results over all other algorithms.

In summary, equipping with any individual strategy only is insufficient to achieve the desired results, but integrating the two strategies results in excellent performance for most of benchmark functions. This superior performance of ELAPO verifies its appropriate taking care of the exploration-exploitation trade-off problem with the introduction of the proposed two strategies.

4.5. Statistical Analysis

In order to analyze the performance of any two algorithms, the Wilcoxon signed-rank test and Friedman test [63] are considered for the present work. The results of Wilcoxon’s test for ELAPO against other six algorithms are summarized in Tables 17 and 18 for n = 30 and 100, respectively. The test is carried out by considering the best solution of each algorithm on each benchmark function with 10 independent runs and a significance level of α = 0.05. In Tables 17 and 18, “+” sign indicates that the reference algorithm outperforms the compared one, “−” sign indicates that the reference algorithm is inferior to the compared one, and “=” sign indicates that both algorithms have comparable performances. The results of last row of the tables show that the proposed ELAPO has a larger number of “+” counts in comparison to other algorithms, confirming that ELAPO is better than the other six compared algorithms under 95% level of significance. The results of the Friedman test are presented in Tables 19 and 20 for n = 30 and 100, respectively. The last row of the tables depicts the ranks computed through the Friedman test. As can be seen in the table, ELAPO is the best performing algorithm of seven optimization algorithms.

The quantitative analysis is also carried out for seven algorithms with an index of mean absolute error (MAE) which is an effective performance index for ranking the optimization algorithms and is defined by [64]where is the mean of optimal values, is the actual global optimal value, and is the number of samples. In the present work, is the number of benchmark functions. The MAE of all algorithms and their ranking for all functions are given in Table 19. It is clear to find that ELAPO ranks No. 1 and provides the minimum MAE in all cases. ELAPO reaches the optimum solution 436 times out of 640 runs (10 runs for each test function for n = 30 and 100, respectively) and comes in the first rank as shown in Figure 7. It is concluded that ELAPO provides the best performance in comparison to other six optimization algorithms.

5. Conclusions

In this paper, an enhanced lightning attachment procedure optimization called ELAPO is proposed for global optimization problems. The exploration and exploitation abilities of the basic LAPO are appropriately balanced in the search process. The quasi-opposition-based learning strategy is applied to control the convergence speed and to improve both exploration and exploitation abilities of the algorithm. To further enhance the exploitation capability, the dimensional search strategy is employed, which inherits the good information from the best solution in each iteration and thus increases the convergence precision of the proposed algorithm. The efficiency of ELAPO is examined on unimodal, multimodal, and CEC 2014 benchmark functions. The statistic results show that the proposed algorithm has superior performance in terms of accuracy and convergence rates when compared with other six state-of-the-art algorithms including LAPO, SSA, Jaya, IBB-BC, ODE1, and ALO.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported by a research grant from the National Key Research and Development Program of China (project no. 2017YFC1500400) and the National Natural Science Foundation of China (51808147).