Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3508546.3508599acmotherconferencesArticle/Chapter ViewAbstractPublication PagesacaiConference Proceedingsconference-collections
research-article
Open access

RLEPSO:Reinforcement learning based Ensemble particle swarm optimizer✱

Published: 25 February 2022 Publication History

Abstract

Evolution is the driving force behind the evolution of biological intelligence. Learning is the driving force behind human civilization. The combination of evolution and learning can form an entire natural world. Now, reinforcement learning has shown significant effects in many places. However, Currently, researchers in the field of optimization algorithms mainly focus on evolution strategies. And there is very little research on learning. Inspired by these ideas, this paper proposes a new particle swarm optimization algorithm Reinforcement learning based Ensemble particle swarm optimizer (RLEPSO) that combines reinforcement learning. The algorithm uses reinforcement learning for pre-training in the design phase to automatically find a more effective combination of parameters for the algorithm to run better and Complete optimization tasks faster. Besides, this algorithm integrates two robust particle swarm variants. And it sets the weight parameters for different algorithms to better adapt to the solution requirements of a variety of different optimization problems, which significantly improves the robustness of the algorithm. RLEPSO makes a certain number of sub-swarms to increase the probability of finding the global optimum and increasing the diversity of particle swarms. This proposed RLEPSO is evaluated on an optimization test functions benchmark set (CEC2013) with 28 functions and compared with other eight particle swarm optimization variants, including three state-of-the-art optimization algorithms. The results show that RLEPSO has better performance and outperforms all compared algorithms.

References

[1]
Swagatam Das and Ponnuthurai N Suganthan. 2010. Problem definitions and evaluation criteria for CEC 2011 competition on testing evolutionary algorithms on real world optimization problems. Jadavpur University, Nanyang Technological University, Kolkata (2010), 341–359.
[2]
Marco Dorigo, Mauro Birattari, and Thomas Stutzle. 2006. Ant colony optimization. IEEE computational intelligence magazine 1, 4 (2006), 28–39.
[3]
Andries P. Engelbrecht. 2010. Heterogeneous particle swarm optimization. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6234 LNCS (2010), 191–202. https://doi.org/10.1007/978-3-642-15461-4_17
[4]
Vitaliy Feoktistov. 2006. Differential evolution. Springer.
[5]
Bo He, Lulu Ying, Shujing Zhang, Xiao Feng, Tianhong Yan, Rui Nian, and Yue Shen. 2015. Autonomous navigation based on unscented-FastSLAM using particle swarm optimization for autonomous underwater vehicles. Measurement 71(2015), 89–101.
[6]
Wenbin Hu, Huan Wang, Zhenyu Qiu, Cong Nie, and Liping Yan. 2018. A quantum particle swarm optimization driven urban traffic light scheduling model. Neural Computing and Applications 29, 3 (2018), 901–911.
[7]
Dervis Karaboga. 2010. Artificial bee colony algorithm. scholarpedia 5, 3 (2010), 6915.
[8]
TH Kim, I Maruta, and T Sugie. 2010. A simple and efficient constrained particle swarm optimization and its application to engineering design problems. Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science 224, 2 (2010), 389–400.
[9]
JJ Liang, BY Qu, PN Suganthan, and Q Chen. 2014. Problem definitions and evaluation criteria for the CEC 2015 competition on learning-based real-parameter single objective optimization. Technical Report201411A, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore 29(2014), 625–640.
[10]
JJ Liang, BY Qu, PN Suganthan, and Alfredo G Hernández-Díaz. 2013. Problem definitions and evaluation criteria for the CEC 2013 special session on real-parameter optimization. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China and Nanyang Technological University, Singapore, Technical Report 201212, 34(2013), 281–295.
[11]
JJ Liang, Thomas Philip Runarsson, Efren Mezura-Montes, Maurice Clerc, Ponnuthurai Nagaratnam Suganthan, CA Coello Coello, and Kalyanmoy Deb. 2006. Problem definitions and evaluation criteria for the CEC 2006 special session on constrained real-parameter optimization. Journal of Applied Mechanics 41, 8 (2006), 8–31.
[12]
Jing J. Liang, A. K. Qin, Ponnuthurai Nagaratnam Suganthan, and S. Baskar. 2006. Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Transactions on Evolutionary Computation 10, 3(2006), 281–295. https://doi.org/10.1109/TEVC.2005.857610
[13]
Jing J Liang, Bo Y Qu, and Ponnuthurai N Suganthan. 2013. Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore 635(2013), 490.
[14]
Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2016. Continuous control with deep reinforcement learning. 4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings(2016). arxiv:1509.02971
[15]
Jianshan Lu. 2017. System identification of force transducers for dynamic measurements using particle swarm optimization. Journal of Vibroengineering 19, 2 (2017), 864–877.
[16]
Nandar Lynn and Ponnuthurai Nagaratnam Suganthan. 2017. Ensemble particle swarm optimizer. Applied Soft Computing Journal 55 (2017), 533–548. https://doi.org/10.1016/j.asoc.2017.02.007
[17]
Rammohan Mallipeddi and Ponnuthurai Nagaratnam Suganthan. 2010. Problem definitions and evaluation criteria for the CEC 2010 competition on constrained real-parameter optimization. Nanyang Technological University, Singapore 24 (2010).
[18]
Seyedali Mirjalili. 2019. Genetic algorithm. In Evolutionary algorithms and neural networks. Springer, 43–55.
[19]
Maroua Nouiri, Abdelghani Bekrar, Abderezak Jemai, Smail Niar, and Ahmed Chiheb Ammari. 2018. An effective and distributed particle swarm optimization algorithm for flexible job-shop scheduling problem. Journal of Intelligent Manufacturing 29, 3 (2018), 603–615.
[20]
T. Peram, K. Veeramachaneni, and C. K. Mohan. 2003. Fitness-distance-ratio based particle swarm optimization. 2003 IEEE Swarm Intelligence Symposium, SIS 2003 - Proceedings2 (2003), 174–181. https://doi.org/10.1109/SIS.2003.1202264
[21]
Joram Piatigorsky and Graeme J Wistow. 1989. Enzyme/crystallins: gene sharing as an evolutionary strategy. Cell 57, 2 (1989), 197–199.
[22]
B. Y. Qu, Ponnuthurai Nagaratnam Suganthan, and Swagatam Das. 2013. A distance-based locally informed particle swarm model for multimodal optimization. IEEE Transactions on Evolutionary Computation 17, 3(2013), 387–402. https://doi.org/10.1109/TEVC.2012.2203138
[23]
Asanga Ratnaweera, Saman K. Halgamuge, and Harry C. Watson. 2004. Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Transactions on Evolutionary Computation 8, 3(2004), 240–255. https://doi.org/10.1109/TEVC.2004.826071
[24]
KV Shihabudheen, M Mahesh, and GN Pillai. 2018. Particle swarm optimization based extreme learning neuro-fuzzy system for regression and classification. Expert Systems with Applications 92 (2018), 474–484.
[25]
Ponnuthurai N Suganthan, Nikolaus Hansen, Jing J Liang, Kalyanmoy Deb, Ying-Ping Chen, Anne Auger, and Santosh Tiwari. 2005. Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. KanGAL report 2005005, 2005 (2005), 2005.
[26]
Xiaoping Yang, Xueying Chen, Riting Xia, and Zhihong Qian. 2018. Wireless sensor network congestion control based on standard particle swarm optimization and single neuron PID. Sensors 18, 4 (2018), 1265.
[27]
Xin Yao, Yong Liu, and Guangming Lin. 1999. Evolutionary programming made faster. IEEE Transactions on Evolutionary computation 3, 2(1999), 82–102.
[28]
Zhi Hui Zhan, Jun Zhang, Yun Li, and Yu Hui Shi. 2011. Orthogonal learning particle swarm optimization. IEEE Transactions on Evolutionary Computation 15, 6(2011), 832–847. https://doi.org/10.1109/TEVC.2010.2052054

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ACAI '21: Proceedings of the 2021 4th International Conference on Algorithms, Computing and Artificial Intelligence
December 2021
699 pages
ISBN:9781450385053
DOI:10.1145/3508546
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 February 2022

Check for updates

Author Tags

  1. Particle Swarm Optimization
  2. Policy Gradient.
  3. Reinforcement Learning

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

ACAI'21

Acceptance Rates

Overall Acceptance Rate 173 of 395 submissions, 44%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 720
    Total Downloads
  • Downloads (Last 12 months)380
  • Downloads (Last 6 weeks)62
Reflects downloads up to 09 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media