AI Generated Content in Gaming - a Web3 Perspective
Generative artificial intelligence is a type of AI that focuses on producing new and creative outputs like text, images, sounds, and videos based on provided input and constraints. It relies on machine learning algorithms that have been trained on large and diverse datasets, which allow the AI to learn the patterns and structures within the data and generate new outputs that are similar to the original data. Generative AI can create visual output from text descriptions, sketches, filling in missing content, or a combination of these inputs.
Generative AI has a wide range of applications, including natural language processing, computer vision, audio generation, and video generation.
Why is This Happening
In 2022, the state-of-the-art in text and image generative AI has taken a major step forward. Recent developments include text to image generative models like Stable Diffusion, DALL-E 2 and Midjourney which are capable of creating realistic images and fascinating art pieces from natural language descriptions.
Each of these models work in a similar fashion, with minor nuances. The text input is encoded as numbers (via a concept called embeddings). These “embeddings” are converted to represent image features and again decoded to produce a final output image using an approach called diffusion. Diffusion models are created by taking input data (here: images) and gradually adding noise until the input is no longer recognizable. These models then sequentially reconstruct the input back to its original state, progressively adding more information to noisy input, and thereby learning to master the task of generating high quality output from lower quality (noisy) input data.
Another area with much progress in 2022 were conversational language models. Above all, OpenAI’s ChatGPT has garnered a lot of interest after its November 2022 release. ChatGPT was constructed using a technique called Reinforcement Learning from Human Feedback (RLHF) to fine tune a GPT-3.5 model (the state-of-the-art language deep learning model for producing human-like text).
A Hands-On Example
Let’s jump right in and test what can be done with cutting-edge tools available today: To illustrate how generative AI can be applied in gaming, we will use two recently released generative AI services: OpenAI’s ChatGPT that generates text from prompts and Midjourney’s text to image model which produces images from user input descriptions. We show how to combine these tools to create a story and the characters for a strategy game set in space. All other aspects of the game are left to the imagination of the ChatGPT and Midjourney.
Let’s start by asking ChatGPT to create context and lore for our game.
> Create a brief story for a strategy game set in space
[ChatGPT:]
In the year 2157, humanity has colonized numerous planets and moons throughout the galaxy. As the leader of a powerful space-faring empire, it is up to you to guide your people through the dangers and opportunities of this vast and wondrous universe. With advanced technologies at your disposal, you must build up your military and economic might to defend your borders from hostile alien races, while also exploring and exploiting the natural resources of the stars. As you expand your empire, you will encounter rival factions and alien species, each with their own strengths and weaknesses. You must use your strategic cunning and diplomatic skills to forge alliances and conquer your enemies, all while managing the complex inner workings of your own civilization. With danger lurking at every turn, can you emerge as the supreme ruler of the galaxy? The fate of your people is in your hands.
> What is the name of the game?
Galactic Conquest: The Empire's Rise
> What does the cover art of the game look like?
The cover art of the game shows a majestic and imposing space-faring vessel, with intricate details and sleek lines. The ship is surrounded by swirling galaxies and stars, giving the impression of vastness and power. In the foreground, the silhouette of a figure is visible, standing at the helm of the ship and gazing out into the vastness of space. The cover art is dark and moody, with deep blues and purples, giving it a sense of mystery and danger.
At this point, we can query Midjourney to create visuals out of ChatGPT’s output information. Let’s give it a try:
cover art of the game shows a majestic and imposing space-faring vessel, with intricate details and sleek lines. The ship is surrounded by swirling galaxies and stars, giving the impression of vastness and power. In the foreground, the silhouette of a figure is visible, standing at the helm of the ship and gazing out into the vastness of space. The cover art is dark and moody, with deep blues and purples, giving it a sense of mystery and danger --v 4[Midjourney:]
Note: Midjourney and other text-to-image models may generate meaningless "text" in their output images because they have learned to associate text with certain types of images, such as posters or cover art, but do not have the ability to produce coherent words or sentences.
Let’s dive deeper via ChatGPT drafting game objectives and protagonists.
> What is the objective of the game? How do you win the game?
To win the game, the player must successfully expand and strengthen their empire by conquering rival factions and alien species, managing their resources and technologies, and forging strategic alliances. Once the player has eliminated all opposition and established themselves as the dominant power in the galaxy, they will be declared the winner.
> Who are the 3 main characters and what are their names?
The leader of the space-faring empire is named Captain Solaria. The leader of a rival faction is named Emperor Zorgon. The leader of an alien species is named Queen Vexxax.
> Describe the looks of each main character in a sentence
Captain Solaria is a strong and determined human with short, blonde hair and piercing blue eyes. Emperor Zorgon is a hulking, intimidating alien with green skin and jagged, yellow teeth. Queen Vexxax is a sleek and agile insectoid with multiple pairs of glowing red eyes.
> How old are the 3 main characters?
As the game takes place in the distant future, it is difficult to determine the exact ages of the main characters. However, it can be assumed that they are all at least middle-aged, with the experience and wisdom that comes with age. Captain Solaria is likely in her late forties or early fifties, while Emperor Zorgon and Queen Vexxax may be even older, given the longer lifespans of their respective alien species.
We are, again, soliciting Midjourney’s help to create visuals for our 3 main characters.
video game character, a strong and determined human with short, blonde hair and piercing blue eyes, female, middle-aged, in space, year 2157 --v 4
video game character, emperor, hulking, intimidating alien with green skin and jagged, yellow teeth, in space, year 2157 --v 4
video game character, queen, a sleek and agile insectoid with multiple pairs of glowing red eyes, in space, year 2157 --v 4
In order to further develop our game's setting, we will delve deeper into the home planets of each of the protagonists.
> Can you describe the home planet of Emperor Zorgon? What is its name?
The home planet of Emperor Zorgon is called Zorgon Prime. It is a harsh and unforgiving world, with rugged, rocky terrain and toxic air that is inhospitable to most forms of life. Zorgon Prime is home to a fierce and warlike alien race, who have adapted to their hostile environment and built a formidable empire through their prowess in battle.
planet, a harsh and unforgiving world, with rugged, rocky terrain and toxic air that is inhospitable to most forms of life, home to a fierce and warlike alien race, who have adapted to their hostile environment and built a formidable empire through their prowess in battle --v 4
> Can you describe the home planet of Queen Vexxax? What is its name?
The home planet of Queen Vexxax is called Vexxaxia. It is a lush and verdant world, with towering forests and sprawling oceans teeming with life. Vexxaxia is home to a highly advanced insectoid species, who have developed sophisticated technologies and social structures over the millennia. Queen Vexxax rules over her people with a combination of intelligence and ruthlessness, always seeking to expand the reach of her empire.
planet, a lush and verdant world, with towering forests and sprawling oceans teeming with life, sophisticated technologies and social structures --v 4
> Captain Solaria lives on Earth. Describe Earth in 2157.
In 2157, Earth is a bustling hub of civilization, with advanced technologies and vast networks of cities and infrastructure. The planet has been heavily developed and urbanized, with towering skyscrapers and high-tech transportation systems. Despite the challenges of overpopulation and environmental degradation, Earth remains a thriving and vital center of humanity's space-faring civilization.
game illustration, year 2157, Earth is a bustling hub of civilization, with advanced technologies and vast networks of cities and infrastructure --v 4
The planet visuals created are vibrant and stunning. An area where generative AI clearly does extremely well.
Expanding upon artifacts and in game items via ChatGPT.
> What are the most powerful artifacts in the game? What are their names?
The most powerful artifacts in the game are known as the "Eternal Crystals". These rare and coveted objects are said to hold the secrets of the universe, imbuing those who possess them with incredible powers. The Eternal Crystals are sought after by all factions in the game, and their ownership can greatly influence the outcome of the conflict.
eternal crystals, rare and coveted objects said to hold the secrets of the universe, imbuing those who possess them with incredible powers --v 4
> What tools and weapons are at the disposal of Captain Solaria?
Captain Solaria has access to a wide range of advanced technologies and weapons, including space-faring vessels, laser rifles, and nuclear missiles. She also has the ability to research and develop new technologies, giving her access to even more powerful tools and weapons as the game progresses. In addition, Captain Solaria can use her diplomatic skills to forge alliances with other factions and gain access to their resources and technologies.
> Could you describe the space-faring vessels in more detail?
The space-faring vessels in the game are incredibly advanced, capable of traveling at incredible speeds and equipped with a variety of powerful weapons and technologies. These ships range from small, agile fighters to massive battleships, each with their own strengths and weaknesses. Some of the most powerful vessels in the game include the "Imperator" class battleship, which is armed with devastating plasma cannons and shielding technology, and the "Stealth Hunter" class corvette, which is equipped with advanced cloaking technology and precision weaponry.
"Imperator" class battleship, which is armed with devastating plasma cannons and shielding technology, space game, year 2157 --v 4
“Stealth Hunter" class corvette, which is equipped with advanced cloaking technology and precision weaponry, space game, year 2157 --v 4
Finally, how about getting a little bit of help from ChatGPT to create a business model for the game? Let's imagine our game offers in-game collectible items with ownership tracked as NFT and source ChatGPT for ideas.
> List collectible items in the game with ownership tracked via NFTs
Rare and powerful weapons, such as the "Eternal Blade" and the "Plasma Cannon".
Unique spaceships and spacecraft designs, such as the "Imperator" class battleship and the "Stealth Hunter" class corvette.
Special items and artifacts, such as the "Eternal Crystals" and the "Helm of the Galaxy".
Custom player avatars and character skins, allowing players to personalize their in-game appearance.
Exclusive rewards and bonuses, such as special abilities and perks, earned through in-game achievements and accomplishments.
And, to end on a light note and show that AI does not always get things right (individual opinions may differ):
> What popular song should play during the opening sequence of the game?
One popular song that could play during the opening sequence of the game is "The Final Countdown" by Europe. The epic and driving nature of the song would provide a fitting accompaniment to the grand scope and high stakes of the game, setting the tone for the adventure to come.
Overall, we are impressed by the results and the impact these new approaches will have to empower content creators.
The AI models available today are a powerful tool for game studios, providing new ways to quickly and easily create new content, adapt to the needs and preferences of their audience, and create more engaging and personalized gaming experiences for players.
Further Use Cases
As demonstrated above, generative AI can be used in games to aid with the creation of art and visual content. Generative AI algorithms can be trained on existing artwork, and then used to generate new variations of that artwork. This can help game studios to quickly and easily create new environments, characters, and other visual elements for their games, without the need for manual creation. This is especially valuable for games with user-generated content, as in Roblox, and for games that allow for user generated mod’s, but likewise compelling for use in user-generated NFTs such as for avatars, specialized items, emotes, and insignia for guilds.
Text generative AI algorithms can be applied in the context of gaming in various additional ways. For example, these algorithms can be used to generate dialogue, descriptions, and storylines, based on provided input and constraints. This enables game developers to create and customize game content quickly and easily, without the need for manual writing and editing. Generative AI for text also can assist in content moderation that is necessary for dialog and user generated items/NFTs to maintain a safe and high quality experience for all players especially for teens and children.
Yet another example is in the generation of music and sound effects. Generative AI algorithms can be trained on existing audio content, and then used to create new variations of that content. This can help game creators to quickly and easily create new music and sound effects for their games, without the need for manual creation.
As players interact with a game, AI algorithms can learn from their actions and preferences, and use that information to generate content that is tailored to their interests and needs. This can help to create a more engaging and personalized gaming experience for players, and it can also help game creators to better understand the needs and preferences of their audience.
Blockchain Enabled
Generative algorithms become even more powerful in the context of NFT-enabled blockchain gaming experiences.
NFTs can be used to verify the authenticity and ownership of AI generated content such as avatars, specialized items, emotes, and insignia for guilds. In many cases, AI generated content may be unique and one-of-a-kind, and there may be value in being able to prove that a particular piece of content was created by a specific AI algorithm. NFTs can be used to provide this proof of authenticity and ownership, by encoding information about the content and the AI algorithm that created it into the NFT. This can help to ensure that the value and ownership of AI generated content is properly represented and protected.
NFTs can be used to facilitate the buying and selling of AI generated content. In many cases, AI generated content may have value as a collectible or as a digital asset. NFTs can be used to represent this value, by creating a market where AI generated content can be bought and sold in a transparent and verifiable manner. This can help to create new opportunities for creators and users of AI generated content, and it can also help to ensure that the value of this content is properly recognized and rewarded.
NFTs can provide a framework for representing and managing the state of AI generated content. This can help to create new and engaging experiences for users of AI generated content, and it can also help to unlock new value and potential for this content.
This concludes our first exploration of (the) space.
If you are interested in further discussing the potential applications of generative AI to your use cases in Web3, we at ChainML are both excited about the space and always open for a chat.
Note: A large portion of this post was auto-generated using generative text models.