Asia Pacific Academy of Science Pte. Ltd. (APACSCI) specializes in international journal publishing. APACSCI adopts the open access publishing model and provides an important communication bridge for academic groups whose interest fields include engineering, technology, medicine, computer, mathematics, agriculture and forestry, and environment.
Empirical insights into AI-assisted game development: A case study on the integration of generative AI tools in creative pipelines
Vol 5, Issue 2, 2024
VIEWS - 307 (Abstract)
Download PDF
Abstract
This study conducts an empirical exploration of generative Artificial Intelligence (AI) tools across the game development pipeline, from concept art creation to 3D model integration in a game engine. Employing AI generators like Leonardo AI, Scenario AI, Alpha 3D, and Luma AI, the research investigates their application in generating game assets. The process, documented in a diary-like format, ranges from producing concept art using fantasy game prompts to optimizing 3D models in Blender and applying them in Unreal Engine 5. The findings highlight the potential of AI to enhance the conceptualization phase and identify challenges in producing optimized, high-quality 3D models suitable for game development. This study reveals the current limitations and ethical considerations of AI in game design, suggesting that while generative AI tools hold significant promise for transforming game development, their full integration depends on overcoming these hurdles and gaining broader industry acceptance.
Keywords
References
1. Zweig B. Forgotten Genealogies: Brief Reflections on the History of Digital Art History. International Journal for Digital Art History. 2015; (1).
2. Mikalonytė ES, Kneer M. Can Artificial Intelligence Make Art? Folk Intuitions as to whether AI-driven Robots Can Be Viewed as Artists and Produce Art. ACM Transactions on Human-Robot Interaction. 2022; 11(4): 1–19. doi: 10.1145/3530875
3. Li S, Zhou Y. Pipeline 3D Modeling Based on High-Definition Rendering Intelligent Calculation. Mathematical Problems in Engineering. 2022; 2022: 1–11. doi: 10.1155/2022/4580363
4. Tchomdji LOK, Park SJ, Kim R. Developing Virtual Tour Content for the Inside and Outside of a Building using Drones and Matterport. International Journal of Contents. 2022; 18(3): 74–84.
5. Harrington MCR, Jones C, Peters C. Course on virtual nature as a digital twin: botanically correct 3D AR and VR optimized low-polygon and photogrammetry high-polygon plant models. ACM SIGGRAPH 2022 Courses. 2022; 1–69. doi: 10.1145/3532720.3535663
6. Brittain B. Artists take new shot at Stability, Midjourney in updated copyright lawsuit. Reuters. Available online: https://www.reuters.com/legal/litigation/artists-take-new-shot-stability-midjourney-updated-copyright-lawsuit-2023-11-30/updated-copyright-lawsuit-2023-11-30/ (accessed on 30 January 2024).
7. Schmidt R, Isenberg T, Jepp P, et al. Sketching, scaffolding, and inking: a visual history for interactive 3D modeling. In: Proceedings of the 5th international symposium on Non-photorealistic animation and rendering; 2007. doi: 10.1145/1274871.1274875
8. Madhavadas V, Srivastava D, Chadha U, et al. A review on metal additive manufacturing for intricately shaped aerospace components. CIRP Journal of Manufacturing Science and Technology. 2022; 39: 18–36. doi: 10.1016/j.cirpj.2022.07.005
9. Cheng R, Wu N, Chen S, et al. Reality Check of Metaverse: A First Look at Commercial Social Virtual Reality Platforms. In: Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW); 2022. doi: 10.1109/vrw55335.2022.00040
10. Korbel JJ, Siddiq UH, Zarnekow R. Towards Virtual 3D Asset Price Prediction Based on Machine Learning. Journal of Theoretical and Applied Electronic Commerce Research. 2022; 17(3): 924–948. doi: 10.3390/jtaer17030048
11. Zhang Y. Cross-Platform Methods in Computer Graphics That Boost Experimental Film Making. Available online: https://scholarworks.rit.edu/cgi/viewcontent.cgi?article=12190&context=theses (accessed on 10 September 2022).
12. Favreau J. The Mandalorian. Disney; 2019.
13. Anderson K. The mandalorian’s virtual sets are wild. Nerdist. Available online: https://nerdist.com/article/mandalorian-virtual-production-star-wars/ (accessed on 10 September 2022).
14. Dent S. See how ‘the mandalorian’ used Unreal Engine for its real-time digital sets. Engadget. Available online: https://www.engadget.com/2020-02-21-mandalorian-ilm-stagecraft-real-time-digital-sets.html (accessed on 10 September 2022).
15. Ronfard R. Film Directing for Computer Games and Animation. Computer Graphics Forum. 2021; 40(2): 713–730. doi: 10.1111/cgf.142663
16. Cohen JL. Film/Video-Based TherapyTM and Virtual Reality. In: Film/Video-Based Therapy and Trauma. Routledge; 2022. pp. 3–13. doi: 10.4324/9781315622507
17. Kuusela V. 3D modeling pipeline for games. Turku University of Applied Sciences; 2022.
18. Hevko I, Potapchuk O, Lutsyk I, et al. The Method of Teaching Graphic 3D Reconstruction of Architectural Objects for Future IT Specialists. In: Proceedings of the 1st Symposium on Advances in Educational Technology; 2020. doi: 10.5220/0010921800003364
19. Open AI. Dall·E 2. DALL·E 2. Available online: https://openai.com/dall-e-2/ (accessed on 25 September 2022).
20. Blance A. Using AI to generate 3D models, fast! Medium. Available online: https://towardsdatascience.com/using-ai-to-generate-3d-models-2634398c0799 (accessed on 25 September 2022).
21. Ha H, Song S. Semantic abstraction: Open-world 3d scene understanding from 2d vision-language models. In: Proceedings of the 6th Annual Conference on Robot Learning; 2022.
22. McKenzie T. Kaedim: A cool AI for turning 2D images into 3D models. Available online: https://80.lv/articles/kaedim-a-cool-ai-for-turning-2d-images-into-3d-models/ (accessed on 10 October 2022).
23. Salian I. Nerf research turns 2D photos into 3D scenes. NVIDIA Blog. Available online: https://blogs.nvidia.com/blog/2022/03/25/instant-nerf-research-3d-ai/ (accessed on 12 October 2022).
24. Fiske T. What does it take to AI-generate VR games? Immersive Wire. Available online: https://www.immersivewire.com/p/take-aigenerate-vr-games (accessed on 7 March 2024).
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Andrew Begemann, James Hutson
License URL: https://creativecommons.org/licenses/by/4.0/
This site is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).
Prof. Zhigeng Pan
Director, Institute for Metaverse, Nanjing University of Information Science & Technology, China
Prof. Jianrong Tan
Academician, Chinese Academy of Engineering, China
