Automation of AAA Game Development Using AI

Authors: Paul Toprac, Branden Heng, Harsheni Siddharthan, Allison Tseng, Sarah Abraham, Etienne Vouga

Abstract:

The goal of this project was to evaluate and document the capabilities and limitations of AI tools for empowering small teams to create high budget, high profile (AAA) 3D games typically developed by large studios. Two teams of novice game developers attempted to create two different games using AI and Unreal Engine 5.3. First, the teams evaluated 60 AI art, design, sound, and programming tools by considering their capability, ease of use, cost, and license restrictions. Then, the teams used a shortlist of 12 AI tools for game development. During this process, the following tools were found to be the most productive: ChatGPT 4.0 for both game and narrative concepting and documentation; Dall-E 3 and OpenArt for concept art; Beatoven for music drafting; ChatGPT 4.0 and Github Copilot for generating simple code and to complement human-made tutorials as an additional learning resource. While current generative AI may appear impressive at first glance, the assets they produce fall short of AAA industry standards. Generative AI tools are helpful when brainstorming ideas such as concept art and basic storylines, but they still cannot replace human input or creativity at this time. Regarding programming, AI can only effectively generate simple code and act as an additional learning resource. Thus, generative AI tools are at best tools to enhance developer productivity rather than as a system to replace developers.

Keywords: AAA Games, artificial intelligence, automation tools, game development.

References:

[1] J. Carter, “Near half of game devs say they’re working with generative AI tools,” Game Developer, 15 Feb. 2024, www.gamedeveloper.com/business/near-half-of-game-devs-say-they-re-working-with-generative-ai-tools
[2] Suck Up, Suck Up, (video game), accessed on January 2024, https://www.playsuckup.com
[3] V. Acovino and C. Intagliata, “‘Games made by soulless machines’: tech sparks debate over AI stories in video games,” NPR, 15 Mar. 2024, www.npr.org/2024/03/15/1238111971/video-games-ai-artificial-intelligence-nvidia
[4] Epic Games. Unreal Engine 5.3, (game engine), Feb. - Apr. 2024, Retrieved from https://www.unrealengine.com
[5] R. Dinsdale, “Experimental video game made purely with AI failed because tech was ‘unable to replace talent,’” IGN, Mar. 2024, www.ign.com/articles/video-game-made-purely-with-ai-failed-because-tech-was-unable-to-replace-talent
[6] OpenAI, ChatGPT, (large language model), Feb. - Apr. 2024, https://chat.openai.com/chat.
[7] OpenAI, DALL·E 3, (text-to-image generator), Feb. - Apr. 2024, https://labs.openai.com.
[8] OpenArt, OpenArt, (text-to-image generator), Feb. - Apr. 2024, https://openart.ai/
[9] Side Effects Software, Houdini, (procedural 3D animation software), Feb. - Apr. 2024, https://www.sidefx.com
[10] Tripo, TripoAI, (text/image-to-3D model AI), Feb. - Apr. 2024, https://www.tripo3d.ai/login
[11] Epic Games, Unreal Engine Marketplace, (3D asset acquisition site), Retrieved from https://www.unrealengine.com
[12] L. Corcoran, itch.io, (publishing platform and asset acquisition site), Feb. - Apr. 2024, https://itch.io/
[13] Anything World, Animate Anything, (3D model-to rig and animate AI), Feb. - Apr. 2024, https://app.anything.world/animation-rigging
[14] Adobe, Miximo, (automated character animation), Feb. - Apr. 2024, https://www.mixamo.com/#/
[15] M. Mori, K. MacDorman, and N. Kageki, “The uncanny valley
[from the field],” IEEE Robotics & Automation Magazine, vol. 19, no. 2, June 2012, pp. 98–100, https://doi.org/10.1109/mra.2012.2192811
[16] J. Betker, G. Goh, L. Jing, T. Brooks, J. Wang, L. Li et al, Improving image generation with better captions, Computer Science, 2023, 2(3), 8, https://cdn. openai. com/papers/dall-e-3
[17] AIVA, AIVA, (AI music generator), Feb. - Apr. 2024, https://www.AIVA.ai/
[18] Beatoven, Beatoven, (AI music generator), Feb. - Apr. 2024, https://www.beatoven.ai
[19] Soundraw, Soundraw, (AI music generator), Feb. - Apr. 2024, https://soundraw.io/
[20] Eleven Labs, Eleven Labs Sound Effects, (AI sound effect generator), Feb. - Apr. 2024, https://elevenlabs.io/sound-effects.
[21] GitHub. (2024). GitHub Copilot (Feb - Apr version) Large language model. https://copilot.github.com/
[22] Adobe, Firefly, (AI image generator), 2024, https://www.adobe.com/products/firefly.html
[23] Gencraft, Gencraft, (AI art Image and video generator), https://gencraft.com/
[24] Midjourney, Midjourney, (AI art generator), 2024, https://www.midjourney.com/home
[25] Godot Foundation, Godot, (game engine), 2024, https://godotengine.org/
[26] Unity Software Inc., Unity, (game engine), 2024, http://unity.com