List of Evolutionary Algorithms
List of Evolutionary Algorithms
List of Evolutionary Algorithms
E NGLISH EDITION
University of Maribor
Faculty of electrical engineering and computer science, Smetanova 17, 2000 Maribor, Slovenia
E-mail: iztok.fister@guest.arnes.si
2
University of Middlesex
School of Science and Technology, Middlesex University, London NW4 4BT, United Kingdom
E-mail: xy227@cam.ac.uk
Abstract. Swarm intelligence and bio-inspired algorithms form a hot topic in the developments of new algorithms
inspired by nature. These nature-inspired metaheuristic algorithms can be based on swarm intelligence, biological
systems, physical and chemical systems. Therefore, these algorithms can be called swarm-intelligence-based,
bio-inspired, physics-based and chemistry-based, depending on the sources of inspiration. Though not all of
them are efficient, a few algorithms have proved to be very efficient and thus have become popular tools for
solving real-world problems. Some algorithms are insufficiently studied. The purpose of this review is to present
a relatively comprehensive list of all the algorithms in the literature, so as to inspire further research.
Key words: swarm intelligence, bio-inspired algorithms, physics/chemistry algorithms, optimization
1 I NTRODUCTION
Real-world optimization problems are often very challenging to solve, and many applications have to deal with
NP-hard problems. To solve such problems, optimization
tools have to be used, though there is no guarantee that
the optimal solution can be obtained. In fact, for NPproblems, there are no efficient algorithms at all. As
a result, many problems have to be solved by trial and
errors using various optimization techniques. In addition,
new algorithms have been developed to see if they can
cope with these challenging optimization problems.
Among these new algorithms, many algorithms such
as particle swarm optimization, cuckoo search and firefly
algorithm, have gained popularity due to their high
efficiency. In the current literature, there are about 40
different algorithms. It is really a challenging task to
classify these algorithms systematically. Obviously, the
classifications can largely depend on the criteria, and
there is no easy guideline to set out the criteria in the
literature. As criteria may vary, detailed classifications
can be an impossible task for a research paper. However,
in this short paper, we only attempt to focus on one
aspect of the characteristics of these algorithms. That
is, we will focus on the source of inspiration when
developing algorithms.
Therefore, the rest of this paper is organized as
follows: Section 2 analyzes the sources of inspiration,
while Section 3 provides a brief and yet comprehensive
Received ???
Accepted 15 July 2013
2 S OURCES
OF I NSPIRATION
3 C LASSIFICATION
OF
A LGORITHMS
/ bio-inspired algorithms
Physics algorithms
Chemistry algorithms
nature-inspired algorithms
Though physics and chemistry are two different subjects,
however, it is not useful to subdivide this subcategory
further into physics-based and chemistry. After all, many
fundamental laws are the same. So we simply group
them as physics and chemistry based algorithms.
4 C ONCLUSION
The sources of inspiration for algorithm development
are very diverse, and consequently the algorithms are
equally diverse. In this paper, we have briefly summarized all the algorithms into 4 categories. This can be a
comprehensive source of information to form a basis or
starting point for further research. It is worth pointing
out that the classifications may not be unique, and this
present table is just for the purpose of information only.
Based on many studies in the literature, some algorithms are more efficient and popular than others. It
would be helpful to carry out more studies, but this
does not mean that we should encourage researchers to
develop more algorithms such as grass, sky, or ocean
algorithms.
Currently, there may be some confusion and distraction in the research of metaheuristic algorithms. On the
one hand, researchers have focused on important novel
ideas for solving difficult problems. On the other hand,
some researchers artificially invent new algorithms for
the sake of publications with little improvement and
no novelty. Researchers should be encouraged to carry
out truly novel and important studies that are really
useful to solve hard problems. Therefore, our aim is to
inspire more research to gain better insight into efficient
algorithms and solve large-scale real-world problems.
[54]
[9]
[11]
[10]
[51]
[2]
[32]
[66]
Reference
[67]
[56]
[55]
[57]
[33]
[28]
[45]
[59]
[14], [3]
[72], [76]
[19]
[43]
[26]
[80]
[42]
[1]
[41]
[48]
[25]
[30]
[18]
[27]
[79]
[24]
[21]
[34]
[13]
[53]
[50]
[23]
[52]
[49]
[64]
[36]
[4]
[60]
[17]
Reference
[69], [71]
[15]
[31]
[46]
[6]
[78]
[62]
[40]
[65]
[61]
[47]
[16]
[12]
[7]
[29]
[74]
[75]
[8]
[70]
[39]
[58]
[37], [38]
[5]
[22]
[44]
[35]
[77]
[68]
[63]
R EFERENCES
[1] Hussein A Abbass. Mbo: Marriage in honey bees optimization-a
haplometrosis polygynous swarming approach. In Evolutionary
Computation, 2001. Proceedings of the 2001 Congress on, volume 1, pages 207214. IEEE, 2001.
[2] Esmaeil Atashpaz-Gargari and Caro Lucas. Imperialist competitive algorithm: an algorithm for optimization inspired by
imperialistic competition. In Evolutionary Computation, 2007.
CEC 2007. IEEE Congress on, pages 46614667. IEEE, 2007.
[3] Carmelo JA Bastos Filho, Fernando B de Lima Neto, Anthony JCC Lins, Antonio IS Nascimento, and Marlia P Lima.
Fish school search. In Nature-Inspired Algorithms for Optimisation, pages 261277. Springer, 2009.
[4] JM Bishop. Stochastic searching networks. In Artificial Neural
Networks, 1989., First IEE International Conference on (Conf.
Publ. No. 313), pages 329331. IET, 1989.
[5] Hanning Chen, Yunlong Zhu, Kunyuan Hu, and Xiaoxian He.
Hierarchical swarm model: a new approach to optimization.
Discrete Dynamics in Nature and Society, 2010, 2010.
[6] Tai-Chen Chen, Pei-Wei Tsai, Shu-Chuan Chu, and Jeng-Shyang
Pan. A novel optimization approach: bacterial-ga foraging.
In Innovative Computing, Information and Control, 2007. ICICIC07. Second International Conference on, pages 391391.
IEEE, 2007.
[7] S.-A. Chu, P.-W. Tsai, and J.-S. Pan. Cat swarm optimization.
Lecture Notes in Computer Science (including subseries Lecture
Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 4099 LNAI:854858, 2006. cited By (since 1996) 8.
[8] Ying Chu, Hua Mi, Huilian Liao, Zhen Ji, and QH Wu. A fast
bacterial swarming algorithm for high-dimensional function optimization. In Evolutionary Computation, 2008. CEC 2008.(IEEE
World Congress on Computational Intelligence). IEEE Congress
on, pages 31353140. IEEE, 2008.
[9] P. Civicioglu. Artificial cooperative search algorithm for numerical optimization problems. Information Sciences, 229:5876,
2013.
[10] Pinar Civicioglu. Transforming geocentric cartesian coordinates
to geodetic coordinates by using differential search algorithm.
Computers & Geosciences, 46:229247, 2012.
[11] Pinar Civicioglu. Backtracking search optimization algorithm
for numerical optimization problems. Applied Mathematics and
Computation, 219(15):81218144, 2013.
[12] Francesc de Paula Comellas Padro, Jesus Martnez Navarro, et al.
Bumblebees: a multiagent combinatorial optimization algorithm
inspired by social insect behaviour. 2011.
[13] Erik Cuevas, Diego Oliva, Daniel Zaldivar, Marco PerezCisneros, and Humberto Sossa. Circle detection using electromagnetism optimization. Information Sciences, 182(1):4055,
2012.
[14] FB de Lima Neto, AJCC Lins, Antonio IS Nascimento, Marlia P
Lima, et al. A novel search algorithm based on fish school
behavior. In Systems, Man and Cybernetics, 2008. SMC 2008.
IEEE International Conference on, pages 26462651. IEEE,
2008.
[15] Marco Dorigo. Optimization, learning and natural algorithms.
Ph. D. Thesis, Politecnico di Milano, Italy, 1992.
[16] Habiba Drias, Souhila Sadeg, and Safa Yahi. Cooperative bees
swarm for solving the maximum weighted satisfiability problem.
In Computational Intelligence and Bioinspired Systems, pages
318325. Springer, 2005.
[17] Hadi Eskandar, Ali Sadollah, Ardeshir Bahreininejad, and Mohd
Hamdi. Water cycle algorithma novel metaheuristic optimization method for solving constrained engineering optimization
problems. Computers & Structures, 2012.
[18] M.M. Eusuff and K.E. Lansey. Optimization of water distribution
network design using the shuffled frog leaping algorithm. Journal of Water Resources Planning and Management, 129(3):210
225, 2003. cited By (since 1996) 297.
[19] Candida Ferreira. Gene expression programming: a new adaptive
algorithm for solving problems. arXiv preprint cs/0102027,
2001.
[20] Iztok Fister, Iztok Fister Jr., Xin-She Yang, and Janez Brest.
A comprehensive review of firefly algorithms. Swarm and
Evolutionary Computation, 2013.
[21] Richard A Formato. Central force optimization: A new metaheuristic with applications in applied electromagnetics. Progress
In Electromagnetics Research, 77:425491, 2007.
[22] Amir Hossein Gandomi and Amir Hossein Alavi. Krill herd:
a new bio-inspired optimization algorithm. Communications in
Nonlinear Science and Numerical Simulation, 2012.
[23] Zong Woo Geem, Joong Hoon Kim, and GV Loganathan. A new
heuristic optimization algorithm: harmony search. Simulation,
76(2):6068, 2001.
[24] Abdolreza Hatamlou. Black hole: A new heuristic optimization
approach for data clustering. Information Sciences, 2012.
[25] Timothy C Havens, Christopher J Spain, Nathan G Salmon, and
James M Keller. Roach infestation optimization. In Swarm
Intelligence Symposium, 2008. SIS 2008. IEEE, pages 17. IEEE,
2008.
[26] S He, QH Wu, and JR Saunders. Group search optimizer: an
optimization algorithm inspired by animal searching behavior.
Evolutionary Computation, IEEE Transactions on, 13(5):973
990, 2009.
[27] Ramin Hedayatzadeh, Foad Akhavan Salmassi, Manijeh Keshtgari, Reza Akbari, and Koorush Ziarati. Termite colony optimization: A novel approach for optimizing continuous problems. In
Electrical Engineering (ICEE), 2010 18th Iranian Conference
on, pages 553558. IEEE, 2010.
[28] Hugo Hernandez and Christian Blum. Distributed graph coloring:
an approach based on the calling behavior of japanese tree frogs.
Swarm Intelligence, 6(2):117150, 2012.
[29] Serban Iordache. Consultant-guided search: a new metaheuristic
for combinatorial optimization problems. In Proceedings of the
12th annual conference on Genetic and evolutionary computation, pages 225232. ACM, 2010.
[30] Sung Hoon Jung. Queen-bee evolution for genetic algorithms.
Electronics letters, 39(6):575576, 2003.
[31] Dervis Karaboga and Bahriye Basturk. A powerful and efficient algorithm for numerical function optimization: artificial
bee colony (abc) algorithm. Journal of global optimization,
39(3):459471, 2007.
[32] Ali Husseinzadeh Kashan. League championship algorithm: a
new algorithm for numerical function optimization. In Soft
Computing and Pattern Recognition, 2009. SOCPAR09. International Conference of, pages 4348. IEEE, 2009.
[33] A Kaveh and N Farhoudi. A new optimization method: Dolphin
echolocation. Advances in Engineering Software, 59:5370,
2013.
[34] A Kaveh and S Talatahari. A novel heuristic optimization
method: charged system search. Acta Mechanica, 213(3-4):267
289, 2010.
[35] James Kennedy and Russell Eberhart. Particle swarm optimization. In Neural Networks, 1995. Proceedings., IEEE International Conference on, volume 4, pages 19421948. IEEE, 1995.
[36] Scott Kirkpatrick, D. Gelatt Jr., and Mario P Vecchi. Optimization by simulated annealing. Science, 220(4598):671680, 1983.
[37] KN Krishnanand and D Ghose. Detection of multiple source
locations using a glowworm metaphor with applications to
collective robotics. In Swarm Intelligence Symposium, 2005. SIS
2005. Proceedings 2005 IEEE, pages 8491. IEEE, 2005.
[38] KN Krishnanand and D Ghose. Glowworm swarm optimisation:
a new method for optimising multi-modal functions. International Journal of Computational Intelligence Studies, 1(1):93
119, 2009.
[39] X.-L. Li, Z.-J. Shao, and J.-X. Qian. Optimizing method
based on autonomous animats: Fish-swarm algorithm. Xitong
Gongcheng Lilun yu Shijian/System Engineering Theory and
Practice, 22(11):32, 2002.
[40] P Lucic and D Teodorovic. Bee system: modeling combinatorial
optimization transportation engineering problems by swarm intelligence. In Preprints of the TRISTAN IV triennial symposium
on transportation analysis, pages 441445, 2001.
[41] Renato Dourado Maia, Leandro Nunes de Castro, and
Walmir Matos Caminhas. Bee colonies as model for multimodal
[42]
[43]
[44]
[45]
[46]
[47]
[48]
[49]
[50]
[51]
[52]
[53]
[54]
[55]
[56]
[57]
[58]
[59]
[60]
[61]
[62]
[63]
[64]
[65]
[66]
[67]
[68]
[69]
[70]
[71]
[72]
[73]
[74]
[75]
[76]
[77]
[78]
[79]
[80]
Janez Brest received his B.S., M.Sc, and Ph.D degrees in computer
science from the University of Maribor, Maribor, Slovenia, in 1995,
1998 and 2000, respectively. He is currently a full professor at the
Faculty of Electrical Engineering and Computer Science, University
of Maribor.