Combining the cross-entropy algorithm and ∈-constraint method for multiobjective optimization

Ezzine, Abdelmajid; Alla, Abdellah; Raissi, Nadia

doi:10.2478/mjpaa-2021-0019

Abstract

This paper aims to propose a new hybrid approach for solving multiobjective optimization problems. This approach is based on a combination of global and local search procedures.

The cross-entropy method is used as a stochastic model-based method to solve the multiobjective optimization problem and reach a first elite set of global solutions. In the local search step, an ∈-constraint method converts the multiobjective optimization problem to a series of parameterized single-objective optimization problems. Then, sequential quadratic programming (SQP) is used to solve the derived single-objective optimization problems allowing to reinforce and improve the global results. Numerical examples are used to demonstrate the efficiency and effectiveness of the proposed approach.

References

[1] P. Xidonas, C. Hassapis, G. Mavrotas, C. Staikouras and C. Zopounidis, Flots d’Anosov a distributions stable et instable, Annals of Operations Research, 267 (2018), 585-606.10.1007/s10479-016-2346-6
Search in Google Scholar Back to article
[2] H. Ren, Y. Lu, Q. Wu, X. Yang and A. Zhou, Multi-objective optimization of a hybrid distributed energy system using NSGA-II algorithm, Frontiers in Energy, 12 (2018), 518-528.10.1007/s11708-018-0594-7
Search in Google Scholar Back to article
[3] J. Huang, Z. Zhou, Z. Gao, M. Zhang and L. Yu, Aerodynamic multi-objective integrated optimization based on principal component analysis, Chinese Journal of Aeronautics, 30 (2017), 1336–1348.10.1016/j.cja.2017.05.003
Search in Google Scholar Back to article
[4] J. Branke, K. Deb, K. Miettinen and S. Roman, Multiobjective Optimization, Interactive and Evolutionary Approaches, 1st edition. Springer-Verlag Berlin Heidelberg, 2008.10.1007/978-3-540-88908-3
Search in Google Scholar Back to article
[5] A. Lpez Jaimes, S. Zapotecas-Martnez and C. Coello, An Introduction to Multiobjective Optimization Techniques, in Optimization in Polymer Processing (eds. A. Gaspar-Cunha, J. A. Covas), Nova Science Publishers, (2011), 29–57.
Search in Google Scholar Back to article
[6] Y. Collette and P. Siarry, Multiobjective Optimization. Principles and Case Studies, 1st edition, Springer-Verlag Berlin Heidelberg, 2004.10.1007/978-3-662-08883-8
Search in Google Scholar Back to article
[7] F. Logist, B. Houska, M. Diehl and J.F. Van Impe, A Toolkit for Multi-Objective Optimal Control in Bioprocess Engineering, IFAC Proceedings Volumes, 43 (2010), 281–286.10.3182/20100707-3-BE-2012.0063
Search in Google Scholar Back to article
[8] Xin Zhang and Xiu Zhang, Cross Entropy Method Meets Local Search for Continuous Optimization Problems, International Journal on Artificial Intelligence Tools, 26 (2017).10.1142/S0218213017500208
Search in Google Scholar Back to article
[9] Z. Botev, D. Kroese, R. Rubinstein and P. LEcuyer, The Cross-Entropy Method for Optimizations, in Handbook of Statistics (eds. Govindaraju. D.Venu and C.R. Rao), Elsevier, (2013), 35–59.10.1016/B978-0-444-53859-8.00003-5
Search in Google Scholar Back to article
[10] R.Y. Rubinstein, Optimization of computer simulation models with rare events, European Journal of Operational Research, 99 (1997), 89–112.10.1016/S0377-2217(96)00385-2
Search in Google Scholar Back to article
[11] R.Y. Rubinstein and D.P. Kroese, The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning, 1st edition, Springer-Verlag New York, 2004.
Search in Google Scholar Back to article
[12] K. Sebaa, A. Tlemani, M. Bouhedda and N. Henini, Multiobjective Optimization Using Cross-Entropy Approach, Journal of Optimization, (2013), 1–9.10.1155/2013/270623
Search in Google Scholar Back to article
[13] I. Plik and T. Terlaky, Interior Point Methods for Nonlinear Optimization,in Nonlinear Optimization (eds. I. M. Bomze, V. F. Demyanov, R. Fletcher and T. Terlaky), Springer, Berlin, Heidelberg, (2010), 215–276.10.1007/978-3-642-11339-0_4
Search in Google Scholar Back to article
[14] M. Lalee, J. Nocedal and T. Planteng, On the Implementation of an Algorithm for Large-Scale Equality Constrained Optimization, SIAM Journal on Optimization, 8 (1998), 682-706.10.1137/S1052623493262993
Search in Google Scholar Back to article
[15] R. H. Byrd, J. C. Gilbert and J. Nocedal, A trust region method based on interior point techniques for nonlinear programming, Mathematical Programming, 89 (2000), 149-185.10.1007/PL00011391
Search in Google Scholar Back to article
[16] Y. Pei and D. Zhu, Local convergence of a trust-region algorithm with line search filter technique for nonlinear constrained optimization, Applied Mathematics and Computation, 273 (2016), 797–808.10.1016/j.amc.2015.10.060
Search in Google Scholar Back to article
[17] T. Binh and U. Korn, A parallel multiobjective evolutionary algorithm, Technical report. Barleben, Germany: Institute for Automation and Communication, 1999.
Search in Google Scholar Back to article
[18] M. Tanaka, GA-based decision support system for multi-criteria optimization, IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century, 1995.
Search in Google Scholar Back to article
[19] H. Tamaki, H. Kita and S. Kobayashi, Multi-objective optimization by genetic algorithms: a review, Proceedings of IEEE International Conference on Evolutionary Computation, 1996.
Search in Google Scholar Back to article
[20] J. Nocedal and S.J. Wright, Numerical Optimization, 2nd edition, Springer, New York, 2006.
Search in Google Scholar Back to article
[21] K. Deb, A. Pratap, S. Agarwal and T. Meyarivan, A Fast and Elitist Multiobjective Genetic Algorithm : NSGA-II, IEEE Transactions on Evolutionary Computation, 6 (2002), 182–197.10.1109/4235.996017
Search in Google Scholar Back to article
[22] Y.X. Su and R. Chi, Multi-objective particle swarm-differential evolution algorithm, Neural Computing and Applications, 28 (2015), 407-418.10.1007/s00521-015-2073-y
Search in Google Scholar Back to article
[23] J. Fliege and A. I.F. Vaz, A method for constrained multiobjective optimization based on SQP techniques, SIAM Journal on Optimization, 26 (2019), 2091-2119.10.1137/15M1016424
Search in Google Scholar Back to article
[24] N. Srinivas and K. Deb, Muiltiobjective optimization using nondominated sorting in genetic algorithms, Evolutionary Computation, 2 (1994), 221–248.10.1162/evco.1994.2.3.221
Search in Google Scholar Back to article
[25] E. Zitzler, K. Deb, and L. Thiele, Comparison of Multiobjective Evolutionary Algorithms, Evolutionary Computation, 8 (2000), 173–195.10.1162/10636560056820210843520
Search in Google Scholar Back to article
[26] G. P. Rangaiah and A. Bonilla-Petriciolet, Multi-objective Optimization in Chemical Engineering: Developments and Applications, 1st edition, John Wiley & Sons, Ltd, 2013.10.1002/9781118341704.ch1
Search in Google Scholar Back to article
[27] L. Sun, G. DePuy and G. W.Evans, Multi-objective optimization models for patient allocation during a pandemic influenza outbreak, Computers & Operations Research, 51 (2014), 350-359.10.1016/j.cor.2013.12.001
Search in Google Scholar Back to article
[28] Y. Jin, Multi-Objective Machine Learning, 1st edition, Springer-Verlag Berlin Heidelberg, 2006.10.1007/3-540-33019-4
Search in Google Scholar Back to article

Combining the cross-entropy algorithm and ∈-constraint method for multiobjective optimization

Abstract

Paradigm

My account