research-article

Interactive Latent Variable Evolution for the Generation of Minecraft Structures

Authors:

Timothy Merino,

Julian TogeliusAuthors Info & Claims

FDG '23: Proceedings of the 18th International Conference on the Foundations of Digital Games

Article No.: 67, Pages 1 - 8

https://doi.org/10.1145/3582437.3587208

Published: 12 April 2023 Publication History

Abstract

The open-world sandbox game Minecraft is well-known for applying a wide array of procedural content generation techniques to create unique and expansive game environments. However, procedurally generated buildings are absent in the Minecraft world, thus players must build their own structures to flesh out their worlds. This build process can be extremely time-consuming and appeals to more creatively-inclined players. To aid players in this process, we introduce a tool combining interactive evolution with latent variable evolution to evolve procedurally generated Minecraft structures to a player’s aesthetic choices. We employ two separate neural network models to generate structures: a 3D generative model for generating the structure design and an encoding model for applying Minecraft textures to the structure’s voxels. We evaluate this tool with a user study incorporating an online interface that allows participants to select, evolve, and guide a population of these generated 3D structures towards a specific design goal.

References

[1]

Maren Awiszus, Frederik Schubert, and Bodo Rosenhahn. 2021. World-gan: a generative model for minecraft worlds. In 2021 IEEE Conference on Games (CoG). IEEE, 1–8.

Digital Library

[2]

Matthew Barthet, Antonios Liapis, and Georgios N Yannakakis. 2022. Open-ended evolution for Minecraft building generation. IEEE Transactions on Games (2022).

[3]

Richard Bartle. 1996. Hearts, clubs, diamonds, spades: Players who suit MUDs. Journal of MUD research 1, 1 (1996), 19.

[4]

Philip Bontrager, Wending Lin, Julian Togelius, and Sebastian Risi. 2018. Deep Interactive Evolution. In Computational Intelligence in Music, Sound, Art and Design - 7th International Conference, EvoMUSART 2018, Parma, Italy, April 4-6, 2018, Proceedings(Lecture Notes in Computer Science, Vol. 10783), Antonios Liapis, Juan Jesús Romero Cardalda, and Anikó Ekárt (Eds.). Springer, 267–282.

[5]

Luigi Cardamone, Daniele Loiacono, and Pier Luca Lanzi. 2011. Interactive evolution for the procedural generation of tracks in a high-end racing game. In Proceedings of the 13th annual conference on Genetic and evolutionary computation. 395–402.

Digital Library

[6]

M Charity and Julian Togelius. 2022. Aesthetic Bot: Interactively Evolving Game Maps on Twitter. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 18. 18–25.

Digital Library

[7]

Jonathan Gray, Kavya Srinet, Yacine Jernite, Haonan Yu, Zhuoyuan Chen, Demi Guo, Siddharth Goyal, C Lawrence Zitnick, and Arthur Szlam. 2019. Craftassist: A framework for dialogue-enabled interactive agents. arXiv preprint arXiv:1907.08584 (2019).

[8]

Djordje Grbic, Rasmus Berg Palm, Elias Najarro, Claire Glanois, and Sebastian Risi. 2021. EvoCraft: A New Challenge for Open-Endedness. Springer-Verlag, Berlin, Heidelberg.

[9]

Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville. 2017. Improved Training of Wasserstein GANs.

[10]

Zehua Jiang, Sam Earle, Michael Green, and Julian Togelius. 2022. Learning Controllable 3D Level Generators. In Proceedings of the 17th International Conference on the Foundations of Digital Games. 1–9.

Digital Library

[11]

Alec Radford, Luke Metz, and Soumith Chintala. 2015. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. https://doi.org/10.48550/ARXIV.1511.06434

[12]

Christoph Salge, Michael Cerny Green, Rodgrigo Canaan, and Julian Togelius. 2018. Generative design in minecraft (gdmc) settlement generation competition. In Proceedings of the 13th International Conference on the Foundations of Digital Games. 1–10.

Digital Library

[13]

Jacob Schrum, Jake Gutierrez, Vanessa Volz, Jialin Liu, Simon Lucas, and Sebastian Risi. 2020. Interactive evolution and exploration within latent level-design space of generative adversarial networks. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference. 148–156.

Digital Library

[14]

Shyam Sudhakaran, Djordje Grbic, Siyan Li, Adam Katona, Elias Najarro, Claire Glanois, and Sebastian Risi. 2021. Growing 3d artefacts and functional machines with neural cellular automata. arXiv preprint arXiv:2103.08737 (2021).

[15]

Hideyuki Takagi. 2001. Interactive evolutionary computation: Fusion of the capabilities of EC optimization and human evaluation. Proc. IEEE 89, 9 (2001), 1275–1296.

[16]

Sarjak Thakkar, Changxing Cao, Lifan Wang, Tae Jong Choi, and Julian Togelius. 2019. Autoencoder and Evolutionary Algorithm for Level Generation in Lode Runner. In 2019 IEEE Conference on Games (CoG). 1–4.

[17]

Vanessa Volz, Jacob Schrum, Jialin Liu, Simon M. Lucas, Adam Smith, and Sebastian Risi. 2018. Evolving Mario Levels in the Latent Space of a Deep Convolutional Generative Adversarial Network. Association for Computing Machinery, New York, NY, USA.

[18]

Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, and Joshua B. Tenenbaum. 2016. Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling. In Proceedings of the 30th International Conference on Neural Information Processing Systems. Curran Associates Inc., Red Hook, NY, USA, 82–90.

Digital Library

[19]

Du-Mim Yoon and Kyung-Joong Kim. 2013. Interactive Evolution of 3D Models based on Direct Manipulation for Video Games. Procedia Computer Science 24 (2013), 137–142.

Cited By

Earle SKokkinos FNie YTogelius JRaileanu R(2024)DreamCraft: Text-Guided Generation of Functional 3D Environments in MinecraftProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3649943(1-15)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3649943
Hu SHuang ZHu CLiu J(2024)3D Building Generation in Minecraft via Large Language Models2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645539(1-4)Online publication date: 5-Aug-2024
https://doi.org/10.1109/CoG60054.2024.10645539
Wang YPei Y(2024)A comprehensive survey on interactive evolutionary computation in the first two decades of the 21st centuryApplied Soft Computing10.1016/j.asoc.2024.111950164(111950)Online publication date: Oct-2024
https://doi.org/10.1016/j.asoc.2024.111950
Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

FDG '23: Proceedings of the 18th International Conference on the Foundations of Digital Games

April 2023

621 pages

ISBN:9781450398558

DOI:10.1145/3582437

Editors:
Phil Lopes
Lusófona University
,
Filipe Luz
Lusófona University
,
Antonios Liapis
University of Malta
,
Henrik Engström
University of Skövde

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

FDG 2023

FDG 2023: Foundations of Digital Games 2023

April 12 - 14, 2023

Lisbon, Portugal

Acceptance Rates

Overall Acceptance Rate 152 of 415 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
229
Total Downloads

Downloads (Last 12 months)113
Downloads (Last 6 weeks)9

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Earle SKokkinos FNie YTogelius JRaileanu R(2024)DreamCraft: Text-Guided Generation of Functional 3D Environments in MinecraftProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3649943(1-15)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3649943
Hu SHuang ZHu CLiu J(2024)3D Building Generation in Minecraft via Large Language Models2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645539(1-4)Online publication date: 5-Aug-2024
https://doi.org/10.1109/CoG60054.2024.10645539
Wang YPei Y(2024)A comprehensive survey on interactive evolutionary computation in the first two decades of the 21st centuryApplied Soft Computing10.1016/j.asoc.2024.111950164(111950)Online publication date: Oct-2024
https://doi.org/10.1016/j.asoc.2024.111950
Huang SHu CTogelius JLiu J(2023)Generating Redstone Style Cities in Minecraft2023 IEEE Conference on Games (CoG)10.1109/CoG57401.2023.10333184(1-4)Online publication date: 21-Aug-2023
https://doi.org/10.1109/CoG57401.2023.10333184

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents