Open Access Paper
28 December 2022 Optimization of nonlinear functions based on improved genetic algorithm
Tailong Shi, Su Meng
Author Affiliations +
Proceedings Volume 12506, Third International Conference on Computer Science and Communication Technology (ICCSCT 2022); 1250616 (2022) https://doi.org/10.1117/12.2661863
Event: International Conference on Computer Science and Communication Technology (ICCSCT 2022), 2022, Beijing, China
Abstract
Premature convergence and falling into local optimum easily are important problems for genetic algorithm. Therefore a new algorithm is constructed in this paper, which can be performed among multiple populations by introducing different optimization parameters. The final formation is aggregated into an elite population, where genetic operations such as selection, crossover, mutation, etc. do not exist, for the purpose of ensuring that the optimal individuals selected between different populations are not destroyed and lost. The simulation results show that the algorithm used in this paper has better optimization ability and higher calculation accuracy for solving local optimal problems of nonlinear functions.

1.

INTRODUCTION

Many problems, such as engineering design, combinatorial optimization, decision-making, optimal path selection, etc., can be reduced to function optimization problems after mathematical modelling1. Finally, the optimal results can be solved under certain constraints, which can reduce manpower expenditure. Therefore, it is meaningful to discuss the problem of function optimization in theory and application.

Genetic Algorithm (GA) is first proposed by John Holland in the 1970s in the United States2. Genetic algorithm comes from the natural evolution process of nature. The algorithm solves the optimal solution through mathematical coding, and uses the selection, crossover and mutation process to search for the optimal result. Because the optimization is independent of gradients and has strong robustness and global search ability, combinatorial optimization problems can be quickly and accurately solved. GA had been widely used in combinatorial optimization, machine learning, signal processing, adaptive control and other fields3.

However, many of its deficiencies and defects have also been exposed, such as poor local search ability, slow convergence speed and it is easy to fall into local optima4. With the expansion of the dimensions of the problem to be optimized, these deficiencies are becoming more and more prominent, and the most prominent problem is the problem of premature convergence. All individuals in the group tend to the same state and stop evolving, the biodiversity is lost, and it is meaningless to iterate again.

A multi-population genetic algorithm (MPGA) can be used to replace the conventional standard genetic algorithm. Multi-population genetic algorithm performs among multiple populations by introducing different optimization parameters, and the optimization results are derived from the final elite population. Compared with the traditional GA, the improved MPGA has better adaptability and result accuracy for solving the multimodal function optimization problem with high difficulty coefficient5.

This paper proposes to use the new algorithm to solve the overall optimization problem of multimodal nonlinear functions, and changes the relevant variables to observe the stability of the algorithm and compared it with the traditional genetic algorithm. Simulation results show that the MPGA has better optimization ability and higher calculation accuracy for solving local optimal problems of nonlinear multimodal functions.

2.

DISADVANTAGES OF GENETIC ALGORITHMS

Genetic algorithm is a random search algorithm. The first step is to randomly generate a population, then searches for the optimal solution of the optimization problem through genetic operations to generate a new population. After gradual evolution, the GA converges to the optimization accurately with a high probability, so as to obtain the optimal solution or sub-optimal solution of the optimization problem6. The GA structure is shown in Figure 1.

Figure 1.

GA flow chart.

00066_PSISDG12506_1250616_page_2_1.jpg

Premature convergence problem is one of the biggest problems of GA7. All individuals in the group tend to the same state and stop evolving, the biodiversity is lost, and it is meaningless to iterate again.

The occurrence of premature convergence is mainly related to the following aspects8:

  • The selection operation is carried out according to the probability determined by the fitness value of the individual. When there is an individual abnormal individual in the group (the individual’s fitness is much higher than other individuals). Under the action, the next generation group will soon be controlled by this one, which will cause the group to stagnate.

  • The frequency of crossover and mutation operations is controlled by the probability of crossover and mutation. Optimization results are heavily influenced by the values of the crossover probability and mutation probability. Different values are likely to lead to different calculation results.

  • The size of the population also affects the optimization results. When the size of the group is small, the degree of diversity in the group is low, and the competition among individuals is weak. Relying on mutation operations to maintain, the population will soon terminate the evolution; when the value of the population size is large, it will inevitably cause an increase in the amount of calculation, and the calculation efficiency will be affected.

  • In the case that the user’s goal is not fully achieved, the program judges that the optimization has reached the optimal solution, and ends the optimization cycle.

3.

MULTI-POPULATION GENETIC ALGORITHM

3.1

Algorithm improvement

Based on the original standard GA, MPGA mainly introduces the following concepts9:

  • Breaking through the framework of the standard genetic algorithm that only relies on a single population for genetic evolution, which can be performed among multiple populations by introducing different optimization parameters.

  • The various populations are connected through the migration operator. The optimal solution is obtained through the co-evolution of multiple populations.

  • The optimal individuals in each evolutionary generation of each group are preserved and selected to decide whether to achieve optimal convergence.

The structural flow chart of the MPGA is shown in Figure 2.

Figure 2.

Schematic diagram of the structure of MPGA.

00066_PSISDG12506_1250616_page_3_1.jpg

In this paper, binary coding is used for individuals, which has high stability and large population diversity. The decision variables x1 and x2 are represented by binary strings. For example, the domain of xj is [aj, bj], and the accuracy requirement is ten thousandths, which requires the domain of xj to be divided at least(bj, − aj) × 105 spaces, and the binary string length required by the set variable xj is mj, which should satisfy:

00066_PSISDG12506_1250616_page_3_2.jpg

3.2

Immigration operator

Through a certain probability, the selection operator selects excellent individuals from the current population to form a new population, so that the excellent individuals can reproduce in the offspring10. In the multi-swarm genetic algorithm, various groups are independent of each other. The immigration operator is a medium for the exchange of information among various groups, and it introduces the optimal individuals that appear in the evolution of each group into other groups.

3.3

Elite population

The elite population is the re-selected population and the basis for judging termination. In each generation of evolution, the best individuals from other populations are selected and stored in the elite population11. The formed elite population does not carry out genetic operations to ensure that the optimal individuals generated by each population are not destroyed and lost during the evolution process.

4.

EXPERIMENTAL DESIGN AND RESULTS

This paper selected the following typical nonlinear multimodal functions for research and analysis

00066_PSISDG12506_1250616_page_3_3.jpg

We set a small area for calculation. The value range of x in f(x, y) is [-2,2], and the value range of y is [-2,2]. Through the initial derivation, it is concluded that the stagnation point range is not within the definition domain, and the optimal value of the function should be obtained at the boundary. Near (0,0), the function will oscillate, and it is easy to generate local extrema.

In order to test and evaluate the performance of MPGA for multimodal function optimization, this paper defines the optimal solution value, iterative stability, and optimal time as the algorithm evaluation indicators.

This paper compares the standard GA and the improved MPGA. Table 1 shows the initial setting of the genetic algorithm and the influence on the results after considering the changes of the crossover probability and mutation probability.

Table 1.

Initial parameters and variables of GA.

GACrossover probabilityMutation probabilityNumber of individualsGenetic algebraGeneration gap
10.70.05405000.9
20.80.05405000.9
30.70.02405000.9

The variation of the optimal solution of the GA with the evolution number is shown in Figure 3.

Figure 3.

Optimal solution change.

00066_PSISDG12506_1250616_page_4_1.jpg

Table 2 shows the parameter settings of the improved multi-population genetic algorithm. Since the immigration operator between multiple populations can communicate with each population, the crossover probability and mutation probability will take a random probability between each population.

Table 2.

Improved initial parameters of MPGA.

MPGACrossover probabilityMutation probabilityNumber of individualsGenetic algebraGeneration gap
/[0.7,0.9] Random number[0.001,0.05] Random number40100.9

Table 3 shows the calculation results. The standard genetic algorithm was calculated 7 times. Due to the existence of crossover and mutation probability, the results are different each time. However, the improved genetic algorithm can better obtain a stable optimal value.

Table 3.

GA and MPGA algorithm optimization results.

GAX valueY valueOptimal solutionOptimal time (evolutionary algebra)
11.7894-1.98793.7116258
2-1.73951.52123.2421130
3-1.75391.53513.2461153
4-1.72551.50863.2136106
51.7856-1.98233.7075398
6-1.7657-1.49073.2462263
71.7576-1.98553.7335437
MGPAX valueY valueOptimal solutionOptimal time (evolutionary algebra)
11.7627-23.756315
21.7627-23.756310
31.7627-23.75639
41.7627-23.756313
51.7627-23.75639
61.7627-23.756316
71.7627-23.756313

The variation of the optimal solution of the GA and the MPGA with the evolution number is shown in Figure 4.

Figure 4.

Evolution process diagram.

00066_PSISDG12506_1250616_page_6_1.jpg

The optimization results obtained each time are different by using genetic algorithm, (as shown in Table 3 above), and even the signs of x and y are opposite. It could be seen that the standard genetic algorithm is very unstable, and sometimes it is still not stable when it is close to 500 generations, the convergence speed is slow, and the convergence accuracy is poor.

Using the improved multi-population genetic algorithm, the optimization results obtained each time are completely consistent, the stability is good, the genetic algebra is within 30 generations, the convergence speed is fast, and the convergence accuracy is high, which is suitable for the optimization of such complex functions.

5.

CONCLUSION

The improved MPGA expands the structure of the standard GA, and introduces multiple populations to search the solution space at the same time, and greatly reduces the inappropriate genetic control parameters. The influence of the settings on the optimization results has a significant effect on suppressing the occurrence of immature convergence. The examples show that the multi-population genetic algorithm has better optimization ability and higher calculation accuracy and stability for solving the local optimal problem of nonlinear multimodal functions.

REFERENCES

[1] 

Tong, W. Y., “A new whale optimisation algorithm based on self-adapting parameter adjustment and mix mutation strategy,” International Journal of Computer Integrated Manufacturing, 33 10 –11 (2020). https://doi.org/10.1080/0951192X.2020.1736717 Google Scholar

[2] 

Zheng, S. Q., Industrial Intelligence Technology and Application, 250 –251 Shanghai Scientific & Technical Publishers, Shanghai (2019). Google Scholar

[3] 

Andrea, D. P., Claudia, A. and Carminic, “A genetic algorithm for the close-enough traveling salesman problem with application to solar panels diagnostic reconnaissance,” Computers and Operations Research, 145 (2022). Google Scholar

[4] 

Zhang, P. L., Wang, J. Q., Tian, Z. W., Sun, S. Z., Li, J. T. and Yang, J. N., “A genetic algorithm with jumping gene and heuristic operators for traveling salesman problem,” Applied Soft Computing Journal, 127 (2022). https://doi.org/10.1016/j.asoc.2022.109339 Google Scholar

[5] 

Yao, X. Y., Li, W. H. and Pan, X. G., “Multimodal multi-objective evolutionary algorithm for multiple path planning,” Computers & Industrial Engineering, 169 (2022). https://doi.org/10.1016/j.cie.2022.108145 Google Scholar

[6] 

Qin, B. Y., “Application of genetic algorithm for nonlinear programming in multimodal function optimization,” Journal of Guangxi University of Science and Technology, 24 (02), 25 –31 (2013). Google Scholar

[7] 

Jin, X. P., Liu, J. Y., Jiang, C. and Guo, Q., “Joint optimization of dispersion matrix and 3D constellation of STSK system based on improved genetic algorithm,” Telecommunications Science, 37 (09), 86 –94 (2021). Google Scholar

[8] 

Sama, K., Przemyslaw, G., Shad, M.Y., “The benefits of co-evolutionary genetic algorithms in voyage optimisation,” Ocean Engineering, 245 (2022). Google Scholar

[9] 

Yang, C, “Feedback multi-agent genetic algorithm for solving high-dimensional function optimization,” Journal of Software, 41 (07), 81 –90 (2020). Google Scholar

[10] 

Wang, C. L., Wang, Y., Zeng, Z. Y., Lin, C. Y. and Yu, Q. L., “Research on logistics distribution vehicle scheduling based on heuristic genetic algorithm,” COMPLEXITY, (20212021). Google Scholar

[11] 

Yang, Y. G., “Multi-aircraft cooperative air combat target allocation method based on improved artificial immune algorithm,” in Proceedings of Workshop, 193 (2018). Google Scholar
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Tailong Shi and Su Meng "Optimization of nonlinear functions based on improved genetic algorithm", Proc. SPIE 12506, Third International Conference on Computer Science and Communication Technology (ICCSCT 2022), 1250616 (28 December 2022); https://doi.org/10.1117/12.2661863
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Genetic algorithms

Optimization (mathematics)

Genetics

Binary data

Analytical research

Computer simulations

Machine learning

Back to Top