Abstract
The history of research in finance and economics has been widely impacted by the field of Agent-based Computational Economics (ACE). While at the same time being popular among natural science researchers for its proximity to the successful methods of physics and chemistry for example, the field of ACE has also received critics by a part of the social science community for its lack of empiricism. Yet recent trends have shifted the weights of these general arguments and potentially given ACE a whole new range of realism. At the base of these trends are found two present-day major scientific breakthroughs: the steady shift of psychology towards a hard science due to the advances of neuropsychology, and the progress of reinforcement learning due to increasing computational power and big data. We outline here the main lines of a computational research study where each agent would trade by reinforcement learning.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bollerslev, T.: CREATES research paper 2008, p. 49 (2008)
Engle, R.F.: Econometrica 50(4), 987 (1982)
Brownlees, C.T., Engle, R.F., Kelly, B.T.: J. Risk 14(2), 3 (2011)
Sbordone, A.M., Tambalotti, A., Rao, K., Walsh, K.J.: Econ. Policy Rev. 16(2) (2010)
Evans, G.W., Honkapohja, S.: Learning and Expectations in Macroeconomics. Princeton University Press, Princeton (2001)
Eusepi, S., Preston, B.: Am. Econ. Rev. 101, 2844 (2011)
Massaro, D.: J. Econ. Dyn. Control 37, 680 (2013)
Farmer, J.D., Foley, D.: Nature 460(7256), 685 (2009)
Grauwe, P.D.: Public Choice 144(3–4), 413 (2010)
Tesfatsion, L., Judd, K.L.: Handbook of Computational Economics: Agent-Based Computational Economics, vol. II. Elsevier, Amsterdam (2006)
Samanidou, E., Zschischang, E., Stauffer, D., Lux, T.: Rep. Prog. Phys. 70(3), 409 (2007)
LeBaron, B.: Building the Santa Fe Artificial Stock Market (2002)
Bonabeau, E.: Harvard Bus. Rev. 80(3), 109 (2002)
Smith, E., Farmer, D.J., Gillemot, L., Krishnamurthy, S.: Quant. Finance 3, 481 (2003)
Huang, W., Lehalle, C.-A., Rosenbaum, M.: J. Am. Stat. Assoc. 110, 509 (2015)
Mota, R., Larralde, H.: arXiv:1601.00229 (2016)
Macal, C.M., North, M.J.: J. Simul. 4, 151 (2010)
Axelrod, R.M.: The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration. Princeton University Press, Princeton (1997)
Grimm, V., Berger, U., Bastiansen, F., Eliassen, S., Ginot, V., Giske, J., Goss-Custard, J., Grand, T., Heinz, S.K., Huse, G., et al.: Ecol. Model. 198(1), 115 (2006)
Bush, R.R., Mosteller, F.: Stochastic Models for Learning. Wiley, Oxford (1955)
Smith, J., Price, D.: Nature 246, 15 (1973)
Taylor, P.D., Jonker, L.B.: Math. Biosci. 40, 145 (1978)
Mookherjee, D., Sopher, B.: Games Econ. Behav. 7, 62 (1994)
Erev, I., Roth, A.E.: Am. Econ. Rev. 88, 848 (1998)
Erev, I., Roth, A.E.: PNAS 111, 10818 (2014)
Camerer, C.F., Ho, T.H.: PNAS 67, 827 (1999)
Fudenberg, D., Levine, D.: The Theory of Learning in Games. MIT Press, Cambridge (1998)
Colander, D., Howitt, P., Kirman, A., Leijonhufvud, A., Mehrling, P.: Am. Econ. Rev. 236–240 (2008)
Dosi, G., Fagiolo, G., Napoletano, M., Roventini, A.: J. Econ. Dyn. Control 37(8), 1598 (2013)
Gualdi, S., Tarzia, M., Zamponi, F., Bouchaud, J.-P.: J. Econ. Interact. Coord. 1–31 (2016)
Gualdi, S., Tarzia, M., Zamponi, F., Bouchaud, J.-P.: J. Econ. Dyn. Control 50, 29 (2015)
Westerhoff, F.H.: Jahrbucher Fur Nationalokonomie Und Statistik 228(2), 195 (2008)
Xu, H.-C., Zhang, W., Xiong, X., Zhou, W.-X.: Math. Prob. Eng. 2014, 563912 (2014)
Boero, R., Morini, M., Sonnessa, M., Terna, P.: Agent-Based Models of the Economy, From Theories to Applications. Palgrave Macmillan, New York (2015)
LeBaron, B.: Agent-based computational finance. In: The Handbook of Computational Economics, vol. 2. Elsevier, Amsterdam (2005)
Heylighen, F.: Complexity and Self-Organization. CRC Press, Boca Raton (2008)
Plerou, V., Gopikrishnan, P., Stanley, H.E.: Nature 421, 130 (2003)
Hamill, L., Gilbert, N.: Agent-Based Modelling in Economics. Wiley, Hoboken (2016)
Wilcox, D., Gebbie, T.: arXiv:1408.5585 (2014)
Hanson, T.A.: Midwest finance association 2012 annual meetings paper (2011)
Bartolozzi, M.: Eur. Phys. J. B 78, 265 (2010)
Wah, E., Wellman, M.P.: Proceedings of the Fourteenth ACM Conference on Electronic Commerce, pp. 855–872 (2013)
Paddrik, M.E., Hayes, R.L., Todd, A., Yang, S.Y., Scherer, W., Beling, P.: SSRN 1932152 (2011)
Aloud, M., Tsang, E., Olsen, R.: Business science reference, Hershey (2013)
Challet, D., Marsili, M., Zhang, Y.-C.: Minority Games: Interacting Agents in Financial Markets. Oxford University Press, Oxford (2005)
Martino, A.D., Marsili, M.: J. Phys. A 39, 465 (2006)
Kyle, A.S., O. A.: Economertrica forthcoming (2016)
Preis, T., Golke, S., Paul, W., Schneider, J.J.: Europhys. Lett. 75(3), 510 (2006)
Farmer, J.D., Patelli, P., Zovko, I.I.: Proc. Natl. Acad. Sci. U.S.A. 102(6), 2254 (2005)
Maslov, S.: Phys. A 278(3), 571 (2000)
Challet, D., Stinchcombe, R.: Quant. Finance 3(3), 155 (2003)
Schmitt, T.A., Schfer, R., Mnnix, M.C., Guhr, T.: Europhys. Lett. 100 (2012)
Lux, T., Marchesi, M.: J. Theor. Appl. Finance 3, 67 (2000)
Cont, R.: Volatility clustering in financial markets: empirical facts and agent-based models. Springer (2007)
Bertella, M.A., Pires, F.R., Feng, L., Stanley, H.E.: PLoS ONE 9(1), e83488 (2014)
Alfi, V., Cristelli, M., Pietronero, L., Zaccaria, A.: Eur. Phys. J. B 67(3), 385 (2009)
Kim, G., Markowitz, H.M.: J. Portfolio Manag. 16, 45 (1989)
Levy, M., Solomon, S.: Int. J. Mod. Phys. C 7, 595 (1996)
Levy, M., Levy, H., Solomon, S.: Econ. Lett. 45, 103 (1994)
Levy, M., Levy, H., Solomon, S.: J. Phys. I 5, 1087 (1995)
Levy, M., Solomon, S.: Int. J. Mod. Phys. C 7, 65 (1996)
Levy, M., Persky, N., Solomon, S.: Int. J. High Speed Comput. 8, 93 (1996)
Levy, M., Levy, H., Solomon, S.: Phys. A 242, 90 (1997)
Levy, M., Levy, H., Solomon, S.: Microscopic Simulation of Financial Markets. Academic Press, New York (2000)
Cont, R., Bouchaud, J.P.: Macroecon. Dyn. 4, 170 (2000)
Solomon, S., Weisbuch, G., de Arcangelis, L., Jan, N., Stauffer, D.: Phys. A 277(1), 239 (2000)
Lux, T., Marchesi, M.: Nature 397, 498 (1999)
Donangelo, R., Hansen, A., Sneppen, K., Souza, S.R.: Phys. A 283, 469 (2000)
Donangelo, R., Sneppen, K.: Phys. A 276, 572 (2000)
Bak, P., Norrelykke, S., Shubik, M.: Phys. Rev. E 60, 2528 (1999)
Bak, P., Norrelykke, S., Shubik, M.: Quant. Finance 1, 186 (2001)
Huang, Z.F., Solomon, S.: Eur. Phys. J. B 20, 601 (2000)
Lipski, J., Kutner, R.: arXiv:1310.0762 (2013)
Barde, S.: School of economics discussion papers 04. University of Kent (2015)
Potters, M., Bouchaud, J.-P.: Phys. A 299, 60 (2001)
Plerou, V., Gopikrishnan, P., Amaral, L.A., Meyer, M., Stanley, H.E.: Phys. Rev. E 60(6), 6519 (1999)
Cristelli, M.: Complexity in Financial Markets. Springer, Cham (2014)
Weron, R.: Int. J. Mod. Phys. C 12, 209 (2001)
Eisler, Z., Kertesz, J.: Eur. Phys. J. B 51, 145 (2006)
Mandelbrot, B.: J. Bus. 394–419 (1963)
Cont, R.: Quant. Finance 1, 223 (2001)
Bouchaud, J., Cont, R., Potters, M.: Scale invariance and beyond. In: Proceedings of CNRS Workshop on Scale Invariance. Springer, Les Houches (1997)
Ding, Z., Engle, R., Granger, C.: J. Empir. Finance 1, 83 (1993)
Lobato, I.N., Savin, N.E.: J. Bus. Econ. Stat. 16, 261 (1998)
Vandewalle, N., Ausloos, M.: Phys. A 246, 454 (1997)
Mandelbrot, B., Fisher, A., Calvet, L.: A multifractal model of asset returns. Cowles Foundation for Research and Economics (1997)
de Vries, C., Leuven, K.: Stylized facts of nominal exchange rate returns. Working Papers from Purdue University, Krannert School of Management Center for International Business Education and Research (CIBER) (1994)
Pagan, A.: J. Empir. Finance 3, 15 (1996)
Cont, R.: Volatility clustering in financial markets: empirical facts and agent-based models. In: Kirman, A., Teyssiere, G. (eds.) Long Memory in Economics. Springer (2005)
Fama, E.: J. Finance 25, 383 (1970)
Bera, A.K., Ivliev, S., Lillo, F.: Financial Econometrics and Empirical Market Microstructure. Springer, Cham (2015)
Wiesinger, J., Sornette, D., Satinover, J.: Comput. Econ. 41(4), 475 (2012)
Andersen, J.V., Sornette, D.: Europhys. Lett. 70(5), 697 (2005)
Zhang, Q.: Disentangling financial markets and social networks: models and empirical tests. Ph.D. thesis, ETH Zurich (2013)
Friedman, M.: Essays in Positive Economics. Chicago University Press, Chicago (1953)
Canova, F., Sala, L.: J. Monetary Econ. 56(4), 431 (2009)
Chiarella, C., Iori, G., Perello, J.: J. Econ. Dyn. Control 33, 525 (2009)
Leal, S.J., Napoletano, M., Roventini, A., Fagiolo, G.: J. Evol. Econ. 26, 49 (2016)
Fabretti, A.: J. Econ. Interact. Coord. 8, 277 (2013)
Axtell, R.: Center on social and economic dynamics working paper 17 (2000)
Gilli, M., Winker, P.: Comput. Stat. Data Anal. 42, 299 (2003)
Farmer, J.D., Joshi, S.: J. Econ. Behav. Organ. 49, 149 (2002)
Kirman, A.: Epidemics of opinion and speculative bubbles in financial markets. In: Money and Financial Markets. Macmillan, New York (1991)
Glimcher, P.W., Camerer, C.F., Fehr, E., Poldrack, R.A.: Neuroeconomics: Decision Making and the Brain. Academic Press, Cambridge (2009)
Camerer, C.: J. Econ. Lit. 51(4), 1155 (2013)
Martino, B.D., Doherty, J.P.O., Ray, D., Bossaerts, P., Camerer, C.: Neuron 79(6), 1222 (2013)
Camerer, C.: Ann. Rev. Econ. 5, 425 (2013)
Camerer, C.: Neuroscience, game theory, monkeys. TEDx talk (2013)
Kahneman, D., Tversky, A.: Econometrica 47(2), 263 (1979)
Frydman, C., Barberis, N., Camerer, C., Bossaerts, P., Rangel, A.: NBER working paper 18562 (2012)
Camerer, C.F.: Behavioral Game Theory: Experiments on Strategic Interaction. Princeton University Press, Princeton (2003)
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al.: Science 362, 1140 (2018)
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al.: Nature 550, 354 (2017)
Doll, B.B., Duncan, K.D., Simon, D.A., Shohamy, D.S., Daw, N.D.: Nat. Neurosci. 18, 767 (2015)
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)
Schmidhuber, J.: Neural Netw. 61, 85 (2015)
Turchenko, V., Beraldi, P., Simone, F.D., Grandinetti, L.: The 6th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (2011)
Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., et al.: Nature 529, 484 (2016)
Tuyls, K., Weiss, G.: AI Mag. Fall (2012)
Heinrich, J., Silver, D.: AAAI Workshop (2014)
Heinrich, J., Silver, D.: IJCAI (2015)
Reed, S., Akata, Z., Yan, X., Logeswaran, L., Lee, H., Schiele, B.: ICML (2016)
Lerer, A., Gross, S., Fergus, R.: ICML (2016)
Biondo, A.E.: J. Econ. Interact. Coord. 14(3) (2018)
Spooner, T., Fearnley, J., Savani, R., Koukorinis, A.: Proceedings of the 17th AAMAS (2018)
Ganesh, S., Vadori, N., Xu, M., Zheng, H., Reddy, P., Veloso, M.: arXiv:1911.05892 (2019)
Lefebvre, G., Lebreton, M., Meyniel, F., BourgeoisGironde, S., Palminteri, S.: Nat. Hum. Behav. 1, 1 (2017)
Duncan, K., Doll, B.B., Daw, N.D., Shohamy, D.: Neuron 98, 645 (2018)
Momennejad, I., Russek, E., Cheong, J., Botvinick, M., Daw, N.D., Gershman, S.J.: Nat. Hum. Behav. 1, 680–692 (2017)
Palminteri, S., Khamassi, M., Joffily, M., Coricelli, G.: Nat. Commun. 1–14 (2015)
Laibson, D.: Q. J. Econ. 112(2), 443 (1997)
The financial crisis inquiry report. Official government edition (2011)
Fouque, J.-P., Langsam, J.A.: Handbook on Systemic Risk. Cambridge University Press, Cambridge (2013)
Bikhchandani, S., Sharma, S.: Int. Monetary Fund. 47(3) (2001)
Bikhchandani, S., Hirshleifer, D., Welch, I.: J. Polit. Econ. 100(5), 992 (1992)
Fama, E.: J. Bus. 38, 34 (1965)
Sornette, D.: arXiv:1404.0243v1 (2014)
da Costa Pereira, C., Mauri, A., Tettamanzi, A.G.B.: IEEE Computer Society WIC ACM (2009)
Kyle, A.S.: Econometrica 53, 1315 (1985)
Sanford, G.J., Miller, M.H.: J. Finance 43, 617 (1988)
Grossman, S.J., Stiglitz, J.E.: Am. Econ. Rev. 70, 393 (1980)
Cason, T.N., Friedman, D.: Exp. Econ. 2, 77 (1999)
Evstigneev, I.V., Hens, T., Schenk-Hopp, K.R.: Evolutionary finance. In: Handbook of Financial Markets, Dynamics and Evolution. North-Holland, Elsevier (2009)
Saichev, A., Malevergne, Y., Sornette, D.: Theory of Zipf’s Law and Beyond. Lecture Notes in Economics and Mathematical Systems, vol. 632. Springer, Heidelberg (2010)
Malevergne, Y., Saichev, A., Sornette, D.: J. Econ. Dyn. Control 37(6), 1195 (2013)
Hasanhodzic, J., Lo, A.W., Viola, E.: Quant. Finance 11(7), 1043 (2011)
Malkiel, B.G.: A Random Walk Down Wall Street: The Time-Tested Strategy for Successful Investing, 10th revised edn. W. W. Norton and Company (2012)
Black, F.: J. Finance 41(3), 529 (1985)
Lussange, J., Bourgeois-Gironde, S., Palminteri, S., Gutkin, B.: arXiv:1909.07748 (2019)
Lussange, J., Belianin, A., Bourgeois-Gironde, S., Gutkin, B.: arXiv:1801.08222 (2018)
Acknowledgment
This work was supported by the RFFI grant nr. 16-51-150007 and CNRS PRC nr. 151199, and received support from FrontCog ANR-17-EURE-0017. A preliminary preprint of this work was uploaded to arXiv [150].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Lussange, J., Belianin, A., Bourgeois-Gironde, S., Gutkin, B. (2021). Learning and Cognition in Financial Markets: A Paradigm Shift for Agent-Based Models. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Systems and Applications. IntelliSys 2020. Advances in Intelligent Systems and Computing, vol 1252. Springer, Cham. https://doi.org/10.1007/978-3-030-55190-2_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-55190-2_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-55189-6
Online ISBN: 978-3-030-55190-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)