research-article

Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

Authors:

Christoph Salge,

Adrian Brightmoore,

Rodrigo De Moura Canaan,

Christian Guckelsberger,

Jupiter Hadley,

Jean-Baptiste Herve,

Quinn Kybartas,

Ruck Thawonmas,

Julian TogeliusAuthors Info & Claims

FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games

Article No.: 45, Pages 1 - 16

https://doi.org/10.1145/3555858.3555940

Published: 04 November 2022 Publication History

Abstract

The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics – all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.

References

[1]

Rodrigo Canaan, Stefan Menzel, Julian Togelius, and Andy Nealen. 2018. Towards game-based metrics for computational co-creativity. In 2018 IEEE conference on Computational Intelligence and Games (CIG). IEEE, 1–8.

Digital Library

[2]

Rodrigo Canaan, Christoph Salge, Julian Togelius, and Andy Nealen. 2019. Leveling the playing field: Fairness in AI versus human game benchmarks. In Proceedings of the 14th International Conference on the Foundations of Digital Games. 1–8.

Digital Library

[3]

LM Clappers. 2021. Simulation-Based Believable Procedurally Generated Video-Game Villages. Ph.D. Dissertation. Maastricht University.

[4]

Simon Colton. 2009. Seven catchy phrases for computational creativity research. In Dagstuhl Seminar Proceedings. Schloss Dagstuhl-Leibniz-Zentrum für Informatik.

[5]

Simon Colton, Geraint A Wiggins, 2012. Computational creativity: The final frontier?. In ECAI, Vol. 12. 21–26.

[6]

Kate Compton. [n.d.]. So you want to build a generator…. http://galaxykate0.tumblr.com/post/139774965871/so-you-want-to-build-a-generator. Accessed Feb 2016.

[7]

Albin Esko and Johan Fritiofsson. 2021. Multi-Agent Based Settlement Generation In Minecraft., 75 pages.

[8]

Marcus Fridh and Fredrik Sy. 2020. Settlement Generation in Minecraft., 55 pages.

[9]

Charles AE Goodhart. 1984. Problems of monetary management: the UK experience. In Monetary theory and practice. Springer, 91–121.

[10]

Djordje Grbic, Rasmus Berg Palm, Elias Najarro, Claire Glanois, and Sebastian Risi. 2020. EvoCraft: A New Challenge for Open-Endedness. arXiv preprint arXiv:2012.04751(2020).

[11]

Michael Cerny Green, Christoph Salge, and Julian Togelius. 2019. Organic Building Generation in Minecraft. In PCG Workshop at the Foundations of Digital Games Conference.

[12]

Jean-Baptiste Hervé and Christoph Salge. 2021. Comparing PCG metrics with Human Evaluation in Minecraft Settlement Generation. In The 16th International Conference on the Foundations of Digital Games (FDG) 2021. 1–15.

Digital Library

[13]

Jean-Baptiste Hervé and Christoph Salge. 2022. Automated Isovist Computation for Minecraft. https://doi.org/10.48550/ARXIV.2204.03752

[14]

Philip Hingston. 2009. A turing test for computer game bots. IEEE Transactions on Computational Intelligence and AI in Games 1, 3(2009), 169–186.

[15]

Ari Iramanesh and Max Kreminski. 2021. AgentCraft: An Agent-Based Minecraft Settlement Generator. (2021).

[16]

Hao Jia, Ruck Thawonmas, and Pujana Paliyawan. 2021. An Aerial Cinematographer AI for Settlements in Minecraft-Toward Their Crowd Assessment. In Proceedings of the 10th Global Conference on Consumer Electronics. 853–854.

[17]

Igor V Karpov, Jacob Schrum, and Risto Miikkulainen. 2013. Believable bot navigation via playback of human traces. In Believable Bots. Springer, 151–170.

[18]

Ahmed Khalifa, Michael Cerny Green, Diego Perez-Liebana, and Julian Togelius. 2017. General video game rule generation. In Computational Intelligence and Games (CIG), 2017 IEEE Conference on. IEEE, 170–177.

Digital Library

[19]

Ahmed Khalifa, Diego Perez-Liebana, Simon M Lucas, and Julian Togelius. 2016. General video game level generation. In Proceedings of the Genetic and Evolutionary Computation Conference 2016. ACM, 253–259.

Digital Library

[20]

Antonios Liapis, Gillian Smith, and Noor Shaker. 2016. Mixed-initiative content creation. In Procedural content generation in games. Springer, 195–214.

[21]

Antonios Liapis, Georgios N Yannakakis, and Julian Togelius. 2014. Computational Game Creativity. In ICCC. 46–53.

[22]

Stephanie Milani, Nicholay Topin, Brandon Houghton, William H Guss, Sharada P Mohanty, Oriol Vinyals, and Noboru Sean Kuno. 2020. The minerl competition on sample-efficient reinforcement learning using human priors: A retrospective. arXiv preprint arXiv:2003.05012(2020).

[23]

Markus Persson. 2011. Minecraft.

[24]

Christoph Salge, Michael Cerny Green, Rodrigo Canaan, Filip Skwarski, Rafael Fritsch, Adrian Brightmoore, Shaofang Ye, Changxing Cao, and Julian Togelius. 2020. The AI Settlement Generation Challenge in Minecraft. KI-Künstliche Intelligenz 34, 1 (2020), 19–31.

[25]

Christoph Salge, Michael Cerny Green, Rodgrigo Canaan, and Julian Togelius. 2018. Generative design in minecraft (GDMC) settlement generation competition. In Proceedings of the 13th International Conference on the Foundations of Digital Games. 1–10.

Digital Library

[26]

Christoph Salge, Christian Guckelsberger, Michael Cerny Green, Rodrigo Canaan, and Julian Togelius. 2019. Generative Design in Minecraft: Chronicle Challenge. In Proceedings of the 10th International Conference on Computational Creativity.

[27]

Noor Shaker, Julian Togelius, and Mark J Nelson. 2016. Procedural content generation in games. Springer.

[28]

Tanya X Short and Tarn Adams. 2017. Procedural Generation in Game Design. CRC Press.

[29]

Adam Marshall Smith. 2012. Mechanizing exploratory game design. Ph.D. Dissertation. UC Santa Cruz.

[30]

Kenneth O Stanley. 2019. Why open-endedness matters. Artificial life 25, 3 (2019), 232–235.

[31]

Matthew James Burgess Stephenson, Jochen Renz, Xiaoyu Ge, Lucas Nascimento Ferreira, Julian Togelius, and Peng Zhang. 2018. The 2017 AIBIRDS Level Generation Competition. IEEE Transactions on Games(2018).

[32]

Marilyn Strathern. 1997. ‘Improving ratings’: audit in the British University system. European review 5, 3 (1997), 305–321.

[33]

Julian Togelius. 2014. How to run a successful game-based AI competition. IEEE Transactions on Computational Intelligence and AI in Games 8, 1(2014), 95–100.

[34]

Levi van Aanholt and Rafael Bidarra. 2020. Declarative procedural generation of architecture with semantic architectural profiles. In 2020 IEEE Conference on Games (CoG). IEEE, 351–358.

[35]

Georgios N. Yannakakis and Héctor P. Martínez. 2015. Ratings are Overrated!Frontiers in ICT 2(2015), 13. https://doi.org/10.3389/fict.2015.00013

[36]

Cristopher Yates. 2021. The use of Poisson Disc Distribution and A* Pathfinding for Procedural Content Generation in Minecraft. Ph.D. Dissertation. Memorial University.

Cited By

Earle SKokkinos FNie YTogelius JRaileanu R(2024)DreamCraft: Text-Guided Generation of Functional 3D Environments in MinecraftProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3649943(1-15)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3649943
van der Staaij APreuss MSalge C(2024)Terrain-adaptive PCGML in Minecraft2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645652(1-8)Online publication date: 5-Aug-2024
https://doi.org/10.1109/CoG60054.2024.10645652
Baron NEger MEger MCardona-Rivera R(2023)Observer rules for box-split grammarsProceedings of the Nineteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment10.1609/aiide.v19i1.27515(195-202)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1609/aiide.v19i1.27515
Show More Cited By

Index Terms

Impressions of the GDMC AI Settlement Generation Challenge in Minecraft
1. Applied computing
  1. Arts and humanities
    1. Architecture (buildings)
      1. Computer-aided design
  2. Computers in other domains
    1. Personal computers and PC applications
      1. Computer games
2. General and reference
  1. Document types
    1. Surveys and overviews

Recommendations

Comparing PCG metrics with Human Evaluation in Minecraft Settlement Generation
FDG '21: Proceedings of the 16th International Conference on the Foundations of Digital Games

There are a range of metrics that can be applied to the artifacts produced by procedural content generation, and several of them come with qualitative claims. In this paper, we adapt a range of existing PCG metrics to generated Minecraft settlements, ...
Generative design in minecraft (GDMC): settlement generation competition
FDG '18: Proceedings of the 13th International Conference on the Foundations of Digital Games

This paper introduces the settlement generation competition for Minecraft, the first part of the Generative Design in Minecraft challenge. The settlement generation competition is about creating Artificial Intelligence (AI) agents that can produce ...
Artificial Intelligence in Art Generation: An Open Issue
Image Analysis and Processing - ICIAP 2023 Workshops
Abstract
This paper aims to give a contribution to one of the most discussed issues in recent times, in both scientific and art communities: the use of Artificial Intelligence (AI) based tools for creating artworks. As the issue is strongly ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games

September 2022

664 pages

ISBN:9781450397957

DOI:10.1145/3555858

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

FDG22

FDG22: 17th International Conference on the Foundations of Digital Games

September 5 - 8, 2022

Athens, Greece

Acceptance Rates

Overall Acceptance Rate 152 of 415 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
128
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)7

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Earle SKokkinos FNie YTogelius JRaileanu R(2024)DreamCraft: Text-Guided Generation of Functional 3D Environments in MinecraftProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3649943(1-15)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3649943
van der Staaij APreuss MSalge C(2024)Terrain-adaptive PCGML in Minecraft2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645652(1-8)Online publication date: 5-Aug-2024
https://doi.org/10.1109/CoG60054.2024.10645652
Baron NEger MEger MCardona-Rivera R(2023)Observer rules for box-split grammarsProceedings of the Nineteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment10.1609/aiide.v19i1.27515(195-202)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1609/aiide.v19i1.27515
Van Der Staaij APrins JPrins VPoelsma JSmit TMüller-Brockhausen MPreuss M(2023)Believable Minecraft Settlements by Means of Decentralised Iterative Planning2023 IEEE Conference on Games (CoG)10.1109/CoG57401.2023.10333146(1-8)Online publication date: 21-Aug-2023
https://doi.org/10.1109/CoG57401.2023.10333146

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten