Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A Scientific Foundation of Simulation Games for the Analysis and Design of Complex Systems

Published: 01 June 2018 Publication History

Abstract

Background. The use of simulation games for complex systems analysis and design has been acknowledged about 50 years ago. However, articles do not combine all salient factors for successful simulation games, and often stem from a clear view of one particular field of science only. With combining multiple disciplines, connect analysis and design as well as research and practice, we provide deep insights in design and use of simulation games.
Aim. This article analyzes the design and evaluation process of a variety of game-based projects and activities, using existing scientific concepts and approaches, in order to establish games as a valid research tool. Our focus lies on the approach towards the use of games as design instrument; using them as an intervention in a larger, complex context, in order to design this context. With our contribution, we aim at providing insights and recommendations on the design and use of games as valid research tools, the limitations of this use, possible pitfalls, but also best practices.
Method. We carried out a literature review of related work to identify the most important scientific concepts related to our approach of game design. Further use of combined quantitative and qualitative case study analyses highlights the design process and results of our own game studies.
Results. The analyses yielded a consolidated conceptualization of simulation games as research instruments in complex systems analysis and design. The results also include methods for the evaluation of simulation games, additional evaluation methods, and limitations to use simulation games as research instruments.
Conclusions. We propose guidelines for using simulation games as research instruments that may be of value to practitioners and scientists alike.
Recommendation. We recommend practitioners and scientists to apply the guidelines presented here in their efforts to analyze and design complex systems.

References

[1]
Aarseth E. 1997. Cybertext: Perspectives on Ergodic Literature. Baltimore, MD: Johns Hopkins University Press.
[2]
Bedny G., Meister D. 1999. Theory of activity and situation awareness. International Journal of Cognitive Ergonomics, Volume 3 Issue 1, pp.63-–72.
[3]
Bekebrede G. 2010. Experience complexity: A gaming approach for understanding infrastructure systems. Enschede, The Netherlands: Gildeprint Drukkerijen.
[4]
Bovaird T. 2007. Beyond engagement and participation: User and community coproduction of public services. Public Administration Review, Volume 67 Issue 5, pp.846-–860.
[5]
Capra F. 1997. The web of life: A new scientific understanding of living systems. New York, NY: Anchor Books.
[6]
Chalmers A., Debattista K. 2009. Level of realism for serious games. Rebolledo-Mendez G., Liarokapis F., de Freitas S . Eds., In IEEE Proceedings of 2009 Conference in Games and Virtual Worlds for Serious Applications pp. pp.225-–232.
[7]
Checkland P. 1981. Systems thinking, systems practice. Chichester, UK: John Wiley & Sons.
[8]
Copier M . 2007. Beyond the magic circle: A network perspective on role-play in online games. Utrecht: Utrecht University.
[9]
Dalpiaz F., Giorgini P., Mylopoulos J. 2013. Adaptive socio-technical systems: A requirements-based approach. Requirements Engineering, Volume 18 Issue 1, pp.1-–24.
[10]
Datcu D., Cidota M., Lukosch H., Lukosch S. 2014. On the usability of augmented reality for information exchange in teams from the security domain. In Den Hengst M., Israel M., Zeng D . Eds. Intelligence and Security Informatics Conference JISIC 2014 IEEE Joint pp. pp.160-–167.The Hague, Netherlands: IEEE.
[11]
Datcu D., Lukosch S., Lukosch H., Cidota M. 2015. Using augmented reality for supporting information exchange in teams from the security domain. Security Informatics, Volume 4 Issue 1, pp.10.
[12]
Davis M. C., Challenger R., Jayewardene D. N., Clegg C. W. 2014. Advancing socio-technical systems thinking: A call for bravery. Applied Ergonomics, Volume 45 Issue 2, pp.171-–180.
[13]
De Bruijn H., Herder P. M . 2009. System and actor perspectives on sociotechnical systems. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, Volume 39 Issue 5, pp.981-–992.
[14]
Deterding S., Canossa A., Harteveld C., Cooper S., Nacke L. E., Whitson J. R. 2015. Gamifying research: Strategies, opportunities, challenges, ethics. In Begole B., Kim J., Inkpen K., Woo W . Eds. Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems pp. pp.2421-–2424. Seoul, Republic of Korea: ACM.
[15]
Dourish P., Bellotti V. 1992. Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM conference on computer supported cooperative work pp. pp.107-–114.
[16]
Duke R. D . 1974. Toward a general theory of gaming. Simulation & Games, Volume 5 Issue 2, pp.131-–146.
[17]
Duke R. D. 1975. The game design process. In Greenblat C. S., Duke R. D. Eds., Gaming simulation: Rationale design and applications pp. pp.99-–168. New York, NY: John Wiley & Sons.
[18]
Duke R. D. 1981. The game design process. In Greenblat C.S, Duke R. D . Eds. Principles and practices of gaming-simulation pp. pp.47-–53. Beverly Hills, CA: SAGE.
[19]
Duke R. D., Geurts J. 2004. Policy games for strategic management. Amsterdam, The Netherlands: Rozenberg Publishers.
[20]
Duke R. D., Greenblat C. S. 1975. Gaming-Simulation, rationale, design and applications: A text with parallel readings for social scientists, educators and community workers. New York, NY: Wiley.
[21]
Endsley M. R. 1995. Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, Volume 37 Issue 1, pp.32-–64.
[22]
Galloway A. R. 2004. Social realism in gaming. Game Studies, Volume 4 Issue 1: Article 1.
[23]
Geurts J., Vennix J. 1989. Verkenningen in beleidsanalyse {Explorations in Policy Analysis}. Zeist, The Netherlands: Kerkebosch.
[24]
Geurts J. L., Duke R. D., Vermeulen P. A. 2007. Policy gaming for strategy and change. Long Range Planning, Volume 40 Issue 6, pp.535-–558.
[25]
Giddens A. 1993. Modernity, history, democracy. Theory and Society, Volume 22 Issue 2, pp.289-–292.
[26]
Harteveld C. 2011. Triadic game design. London, England: Springer.
[27]
Harteveld C., Guimarães R., Mayer I. S., Bidarra R. 2010. Balancing play, meaning and reality: The design philosophy of LEVEE PATROLLER. Simulation & Gaming, Volume 41 Issue 3, pp.316-–340.
[28]
Hevner A., March S., Park J., Ram S. 2004. Design science in information systems research. MIS Quarterly, Volume 28 Issue 1, pp.75-–105.
[29]
Heylighen F. 2002. Complexity and information overload in society: Why increasing efficiency leads to decreasing control. The Information Society, pp.1-–44.
[30]
Holland J. H. 1995. Hidden order: How adaptation builds complexity. Reading, MA: Addison-Wesley.
[31]
IJsselsteijn W. A., de Kort Y. A. W., Poels K. 2013. The Game Experience Questionnaire. Eindhoven, The Netherlands: Technische Universiteit Eindhoven.
[32]
Klabbers J. H. G. 2003. Gaming and simulation: Principles of a science of design. Simulation & Gaming, Volume 34 Issue 4, pp.569-–591.
[33]
Klabbers J. H. G. 2006 . The magic circle: Principles of gaming & simulation. Rotterdam, The Nethernalds: Sense Publishers.
[34]
Klabbers J. H. G. 2009. Terminological Ambiguity: Game and Simulation. Simulation and Gaming, Volume 40 Issue 4, pp.446-–463.
[35]
Klabbers J. H. G. 2018. On the architecture of game science. Simulation & Gaming, Volume 49, pp.207-–245.
[36]
Klein G. 2008. Naturalistic decision making. Human Factors, Volume 50 Issue 3, pp.456-–460.
[37]
Kriz W. C. 2003. Creating effective learning environments and learning organizations through gaming simulation. Simulation & Gaming, Volume 34, pp.495-–511.
[38]
Kriz W. C. 2010. A systemic-constructivist approach to the facilitation and debriefing of simulations and games. Simulation & Gaming, Volume 41 Issue 5, pp.663-–680.
[39]
Kriz W. C., Hense J. 2006. Theory-oriented evaluation for the design of and research in gaming simulation. Simulation & Gaming, Volume 37 Issue 2, pp.268-–283.
[40]
Kurapati S. 2017. Situation awareness for socio technical systems: A simulation gaming study in intermodal transport operations Doctoral thesis. TRAIL Research School, Delft, The Netherlands.
[41]
Kurapati S., Lukosch H., Verbraeck A., Brazier F. M . 2015. Improving resilience in intermodal transport operations in seaports: a gaming approach. EURO Journal on Decision Processes, Volume 3 Issue 3-4, pp.375-–396.
[42]
Kurapati S., Lukosch H. K., Eckert S., Corsi T., Verbraeck A. 2017. Relating planner task performance for container terminal operations to multi-tasking skills and personality type. Transportation Research Part F: Traffic Psychology and Behaviour, Volume 51, pp.47-–64.
[43]
Luhmann N. 1995. Social systems. Stanford, CA: Stanford University Press.
[44]
Lukosch H., Groen D., Kurapati S., Klemke R., Verbraeck A. 2016. The role of awareness for complex planning task performance: A microgaming study. International Journal of Game-Based Learning, Volume 6 Issue 2, pp.15-–28.
[45]
Lukosch H., Kurapati S., Groen D., Verbraeck A. 2016Microgames for situated learning: A case study in interdependent planning. Simulation & Gaming, Volume 47 Issue 3, pp.1-–22.
[46]
Lukosch H., Van Bussel R., Meijer S. 2012. A game design framework for vocational education. International Journal of Social and Human Sciences, Volume 6, pp.453-–457.
[47]
Lukosch H. K., van Ruijven T., Verbraeck A. 2012. The participatory design of a simulation training game. In Laroque C., Pasupathy R., Himmelspach J . Eds. Proceedings of the winter simulation conference pp. pp.1-–11. Berlin, Germany: IEEE
[48]
Lukosch S., Lukosch H., Datcu D., Cidota M. 2015. Providing information on the spot: Using Augmented Reality for Situational Awareness in the Security Domain Computer Supported Cooperative Work CSCW. The Journal of Collaborative Computing and Work Practices, Volume 24, pp.613-–664.
[49]
Lukosch S., Schümmer T. 2004. Communicating design knowledge for shared object management. In de Vreede G.J., Guerrero L. A., Raventós G. M . Eds. Groupware: Design, Implementation, and Use, 10th International Workshop, CRIWG 2004 pp. pp.223-–237. Berlin, Germany: Springer-Verlag.
[50]
Lukosch S. G., Billinghurst M., Alem L., Kiyokawa K. 2015. Collaboration in Augmented Reality. Computer Supported Cooperative Work CSCW - The Journal of Collaborative Computing and Work Practices, Volume 24, pp.515-–525
[51]
Magerkurth C., Memisoglu M., Engelke T., Streitz N. 2004. Towards the next generation of tabletop gaming experiences. In Balakrishnan R., Heidrich W . Eds. Proceedings of Graphics Interface pp. pp.73-–80. Waterloo, Ontario: Canadian Human-Computer Communications Society.
[52]
Maturana H. R . 1980. Autopoiesis: reproduction, heredity and evolution. In: Autopoiesis, dissipative structures and spontaneous social orders, AAAS Selected Symposium 55 AAAS National Annual Meeting, Houston TX, <conf-date>3 -8 January 1979</conf-date> pp. pp.45-–79. Westview Press.
[53]
Maturana H. R., Varela F. J . 1980. Problems in the neurophysiology of cognition. In: pp. pp.41-–47. Springer, Dordrecht.
[54]
Mayer I. S. 2009. The gaming of policy and the politics of gaming: A review. Simulation & Gaming, Volume 40 Issue 6, pp.825-–862.
[55]
Meijer S. 2009. The organisation of transactions: Studying supply networks using gaming simulation Information technology doctoral thesis. Wageningen University, Wageningen, The Netherlands.
[56]
Nonaka I. 1995. The knowledge-creating company: How Japanese companies create the dynamics of innovation. Organization Science, Volume 5, pp.14-–37.
[57]
Peters V., Westelaken M., 2014. Simulation Games-A concise introduction to game design. Nijmegen, The Nethernalds: Samenspraak Advies.
[58]
Peters V., Vissers G., Heijne G. 1998. The validity of games. Simulation & Gaming, Volume 29 Issue 1, pp.20-–30.
[59]
Rezaee S. A., Oey M., Nevejan C., Brazier F. 2015. Participatory Demand-supply Systems. Procedia Computer Science, Volume 44, pp.105-–114.
[60]
Ridolfi G., Mooij E., Corpino S. 2012. Complex-systems design methodology for systems-engineering collaborative environment. In Cogan B . Ed. Systems engineering-practice and theory pp. pp.39-–70. London, UK: InTechOpen.
[61]
Roth E. M., Multer J., Raslear T. 2006. Shared situation awareness as a contributor to high reliability performance in railroad operations. Organization Studies, Volume 27 Issue 7, pp.967-–987.
[62]
Rouse W. B., Cannon-Bowers J. A., Salas E . 1992. The role of mental models in team performance in complex systems. IEEE transactions on systems, man, and cybernetics, Volume 22 Issue 6, pp.1296-–1308.
[63]
Sage A. P., Rouse W. B. 2009. Handbook of systems engineering and management. New York, NY: John Wiley & Sons.
[64]
Salmon P. M., Stanton N., A, Walker G. H., Jenkins D., Ladva D., Rafferty L., Young M. 2009. Measuring situation awareness in complex systems: Comparison of measures study. International Journal of Industrial Ergonomics, Volume 39 Issue 3, pp.490-–500.
[65]
Schell J. 2008. The art of game design: A deck of lenses. Schell Games</publisher-name>. New York: <publisher-name>Taylor and Francis.
[66]
Simon A. H. 1969. The sciences of the artificial. Cambridge, MA: MIT Press.
[67]
Stanton N. A., Stewart R., Harris D., Houghton R. J., Baber C., McMaster R., & Green D. 2006. Distributed situation awareness in dynamic systems: theoretical development and application of an ergonomics methodology. Ergonomics, Volume 49 Issue 12-13, pp.1288-–1311.
[68]
Svensson G. 2000. A conceptual framework for the analysis of vulnerability in supply chains. International Journal of Physical Distribution & Logistics Management, Volume 30 Issue 9, pp.731-–750.
[69]
Thrift N. 1999. The place of complexity. Theory, Culture & Society, Volume 16 Issue 3, pp.31-–69.
[70]
Tychsen A., Hitchens M., Brolund T., Kavakli M. 2005. The game master. In Pisan Y . Ed. Proceedings of the Second Australasian Conference on Interactive Entertainment</conf-name> pp. pp.215-–222. Sydney, Australia: <conf-name>Creativity & Cognition Studios Press.
[71]
van den Hoogen W. M., IJsselsteijn W. A., de Kort Y. A . 2008. Exploring behavioral expressions of player experience in digital games. In Nijholt A., Poppe R . Eds. Proceedings of the workshop on Facial and Bodily Expression for Control and Adaptation of Games ECAGVolume Vol. 2008, pp. pp.11-–19.
[72]
Van der Meer F. B., Geurts J. L . 1995. Simulatie voor Beleids- en Organisatieontwikkeling {<trans-title xml:lang="en">Simulation for the Development of Policy and Organization</trans-title>}. Bestuurskunde, Volume 4 Issue 4, pp.166-–177.
[73]
Van Merriënboer J. J., Kirschner P. A . 2012. Ten steps to complex learning: A systematic approach to four-component instructional design. Routledge Taylor and Francis.
[74]
Von Bertalanffy L . 1968. General system theory. New York, NY: Braziller.
[75]
Von Bertalanffy L . 1975. Perspectives on general system theory scientific-philosophical studies. New York, NY: Braziller.
[76]
Walby S. 2007. Complexity theory, systems theory, and multiple intersecting social inequalities. Philosophy of the Social Sciences, Volume 37 Issue 4, pp.449-–470.
[77]
Waldrop M. M. 1992. Complexity: the emerging science at the edge of order and chaos. London, England: Viking.
[78]
Weber M. 1978. Economy and society: An outline of interpretive sociology. Berkeley: University of California Press.
[79]
Weick K. E. 1979. The psychology of organization. London, England: Addison-Wesley.
[80]
Wilson K. A., Burke C. S., Priest H. A., Salas E. 2005. Promoting health care safety through training high reliability teams. Quality and Safety in Health Care, Volume 14 Issue 4, pp.303-–309.

Cited By

View all
  • (2024)The Funnel of Game Design – An Adaptive Game Design Approach for Complex SystemsSimulation and Gaming10.1177/1046878123122252455:2(323-341)Online publication date: 10-Apr-2024
  • (2023)Design of a Serious Game for Safety in Manufacturing Industry Using Hybrid Simulation Modelling: Towards Eliciting Risk PreferencesProceedings of the Winter Simulation Conference10.5555/3643142.3643250(1304-1315)Online publication date: 10-Dec-2023
  • (2021)Becoming the Unseen Helmsman - Game facilitator competencies for novice, experienced, and non-game facilitatorsSimulation and Gaming10.1177/1046878121102079252:3(255-272)Online publication date: 30-Dec-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Simulation and Gaming
Simulation and Gaming  Volume 49, Issue 3
6 2018
174 pages

Publisher

Sage Publications, Inc.

United States

Publication History

Published: 01 June 2018

Author Tags

  1. analytical science
  2. complex systems
  3. design science
  4. research methodology
  5. simulation games

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 08 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)The Funnel of Game Design – An Adaptive Game Design Approach for Complex SystemsSimulation and Gaming10.1177/1046878123122252455:2(323-341)Online publication date: 10-Apr-2024
  • (2023)Design of a Serious Game for Safety in Manufacturing Industry Using Hybrid Simulation Modelling: Towards Eliciting Risk PreferencesProceedings of the Winter Simulation Conference10.5555/3643142.3643250(1304-1315)Online publication date: 10-Dec-2023
  • (2021)Becoming the Unseen Helmsman - Game facilitator competencies for novice, experienced, and non-game facilitatorsSimulation and Gaming10.1177/1046878121102079252:3(255-272)Online publication date: 30-Dec-2021
  • (2021)Ethics and the Simulation FacilitatorSimulation and Gaming10.1177/1046878121101570752:3(312-332)Online publication date: 1-Jun-2021
  • (2021)Facilitated Tabletop Games in a Mediated EnvironmentGaming, Simulation and Innovations: Challenges and Opportunities10.1007/978-3-031-09959-5_3(28-41)Online publication date: 6-Sep-2021
  • (2021)Frame Game as Teaching Methodology in Higher Education: The Case of RElastiCityGaming, Simulation and Innovations: Challenges and Opportunities10.1007/978-3-031-09959-5_10(115-123)Online publication date: 6-Sep-2021
  • (2020)Serious Simulation Gaming as Learning Media for Plastic Waste Recycling Management System in IndonesiaProceedings of the 3rd Asia Pacific Conference on Research in Industrial and Systems Engineering10.1145/3400934.3400969(187-192)Online publication date: 16-Jun-2020
  • (2020)Design of Serious Simulation Games (SSG) as Learning Media for the Industry 4.0 Road Map in Indonesian ManufacturingProceedings of the 3rd Asia Pacific Conference on Research in Industrial and Systems Engineering10.1145/3400934.3400960(135-140)Online publication date: 16-Jun-2020
  • (2020)Digital Versus Analogue Simulation Games: Influence on Validity, Play(er) Experience and Learning OutcomesGames and Learning Alliance10.1007/978-3-030-63464-3_44(441-446)Online publication date: 9-Dec-2020
  • (2019)Psychometric Testing of a Value-Achievement-Cost Motivation Survey for 12th Grade Health Sciences Students for Use in Simulation-Based-GamesSimulation and Gaming10.1177/104687811987631750:6(789-811)Online publication date: 1-Dec-2019
  • Show More Cited By

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media