Abstract
In the area of Decision Science research, Multi-Agent Systems (MAS) has been hailed as a new paradigm for conceiving and designing software systems. The goal of this chapter is to underscore the need for and usefulness of MAS by giving the reader an insight into the agents’ characteristics, its interaction with its environments, various performance measures and different types of MAS. This chapter gives insights on Reinforcement Learning Agents the root of which originates from animal learning theory. In reinforcement learning, the agents comprehend the state of the environment at each step, and adopt the decision on the action to be taken, causing its environment to transit into a new state. The agents each receive a scalar reward that evaluates if the transition made is aligned with the goal. The novelty of this chapter is the use of a multi-agent programmable tool called NetLogo to explain the reinforcement learning technique with appropriate examples and the results obtained are thoroughly analyzed. Prominent algorithms like Policy Hill-Climbing, Q-learning, and its variants such as Nash Q, Minimax Q-Learning, and optimization techniques such as Distributed Constraint Optimization (DCOP) in multi-agent systems which help the agents in achieving equilibrium are discussed. The chapter also focuses on the typical domains that can benefit from MAS. It comprises of instances from examples of MAS implemented using the NetLogo models for enhancing the understanding of agents and their environment. The chapter concludes by giving the reader a sneak-peek into the latest research trends in MAS.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Xavier overview. http://www.cs.cmu.edu/~Xavier/overview.html
COG project overview http://www.ai.mit.edu/projects/humanoid-robotics-group/cog/overview.html
Sony Aibo|the history of robotic dog http://www.sony-aibo.com/
Zeghida D, Meslati D, Bounour N (2018) Bio-IR-M: a multi-paradigm modelling for bio-inspired multi-agent systems. Informatica 42. https://doi.org/10.31449/inf.v42i3.1516
Sneha V., Shrinidhi KR, Sunitha RS, Nair MK (2019) Collaborative filtering based recommender system using regression and grey wolf optimization algorithm for sparse data. In: 2019 IEEE international conference on communication and electronics systems (ICCES) (in press)
Nayak J, Naik B, Jena AK, Barik RK, Das H (2018) Nature inspired optimizations in cloud computing: applications and challenges. In: Cloud computing for optimization: foundations, applications, and challenges. Springer, Cham, pp 1–26
Das H, Jena AK, Nayak J, Naik B, Behera HS (2015) A novel PSO based back propagation learning-MLP (PSO-BP-MLP) for classification. In: Computational intelligence in data mining, vol 2. Springer, New Delhi, pp 461–471
Dey N, Das H, Naik B, Behera HS (eds) (2019) Big data analytics for intelligent healthcare management. Academic Press
Sahoo AK, Mallik S, Pradhan C, Mishra BSP, Barik RK, Das H (2019) Intelligence-based health recommendation system using big data analytics. In: Big data analytics for intelligent healthcare management. Academic Press, pp 227–246
Xie J, Liu C-C (2017) Multi-agent systems and their applications. J Int Counc Electr Eng 7(1):188–197. https://doi.org/10.1080/22348972.2017.1348890
Nagwani NK (2009) Performance measurement analysis for multi-agent systems. In: 2009 international conference on intelligent agent & multi-agent systems, pp 1–4
Milewski J, Multi agent reinforcement learning. https://www.cs.ubc.ca/~kevinlb/teaching/cs532l%20-%202013-14/Lectures/rl-pres.pdf
Downloading Netlogo (n.d.) https://ccl.northwestern.edu/netlogo/oldversions.shtml
Tisue S, Wilensky U (2004) NetLogo: design and implementation of a multi-agent modeling environment. https://ccl.northwestern.edu/papers/2013/netlogo-agent2004c.pdf
Junior IC (2013) Data mining with ant colony algorithms. Lect Notes Comput Sci 30–38. https://doi.org/10.1007/978-3-642-39482-9_4
Busoniu L, Babuska R, De Schutter B (2010) Multi-agent reinforcement learning: an overview. https://doi.org/10.1007/978-3-642-14435-6_7
Roop J (2006) Reinforcement learning in NetLogo. http://ccl.northwestern.edu/netlogo/models/community/ReinforcementLearningMaze
Nowe A, Vrancx P, De Hauwere Y-M (2012) Game theory and multi-agent reinforcement learning. https://doi.org/10.1007/978-3-642-27645-3_14
Poole D, Mackworth A, Artificial intelligence. https://artint.info/html/ArtInt_265.html
Lin L (2014) Q-Learning in MDPs (n.d.) http://modelingcommons.org/browse/one_model/3986#model_tabs_browse_nlw
Cerquides J, Farinelli A, Meseguer P, Ramchurn SD, A tutorial on optimisation for multi agent systems. https://academic.oup.com/comjnl/article-abstract/57/6/799/378684?redirectedFrom=fulltex
Hu J, Wellman MP (2003) Nash Q-learning for general-sum stochastic games
Wilensky U (1997) NetLogo wolf sheep predation model. Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL. http://ccl.northwestern.edu/netlogo/models/WolfSheepPredation
Picard G, Distributed constraint optimisation. https://www.emse.fr/~picard/cours/mas/lecture-DCOP-2017.pdf
Bae J (2019) Distributed graph coloring. Stanford.edu. https://stanford.edu/~rezab/classes/cme323/S16/projects_reports/bae.pdf. Accessed 1 May 2019
Tang D (2019) Coalition formation. Cpp.edu. https://www.cpp.edu/~ftang/courses/CS599-DI/notes/Coalition%20Formation.pdf. Accessed 1 May 2019
Sardinha JARP, Molinaro MS, Paranhos PM, Cuhna PM, Milidiu RL, Lucena CJP (2005) A multi-agent architecture for a dynamic supply chain management. Monografias em Ciencia da Computacao, No. 36/05
Zhao G, Sun R (2010) Application of multi-agent reinforcement learning to supply chain ordering management. In: 2010 sixth international conference on natural computation. https://doi.org/10.1109/icnc.2010.5582551
Rudenko D, Borisov A (2006) Agents in supply chain management: an overview. https://ortus.rtu.lv/science/lv/publications/5910/fulltext.pdf. Accessed 30 Apr 2019
Dorigo M, Caro GD, Gambardella LM (1999) Ant algorithms for discrete optimization. Artif Life 2:137–172
Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern-Part B 1:29–41
He J, Min R, Wang Y (2005) Implementation of ant colony algorithm based-on multi-agent system. In: Lu X, Zhao W (eds) 2005 international conference on networking and mobile computing (ICCNMC). Lecture Notes in Computer Science, vol 3619. Springer, Berlin, Heidelberg
Roach Christopher (2007) NetLogo ant system model. Computer Vision and Bio-inspired Computing Laboratory, Florida Institute of Technology, Melbourne, FL
Fioretto F, Pontelli E, Yeoh W, Distributed constraint optimisation problems and applications: a survey. https://www.researchgate.net/publication/301844403_Distributed_Constraint_Optimization_Problems_and_Applications_A_Survey
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Shrinidhi, K.R., V, S., Jain, V., Nair, M.K. (2020). Multi-agent-Based Systems in Machine Learning and Its Practical Case Studies. In: Rout, J., Rout, M., Das, H. (eds) Machine Learning for Intelligent Decision Science. Algorithms for Intelligent Systems. Springer, Singapore. https://doi.org/10.1007/978-981-15-3689-2_7
Download citation
DOI: https://doi.org/10.1007/978-981-15-3689-2_7
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-3688-5
Online ISBN: 978-981-15-3689-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)