Roblox Shares Plans for Generative AI in the Metaverse
Metaverse platform Roblox has begun developing generative AI for its creative toolkit. The new Roblox Studio features will employ natural language prompts and coding AI assistance to speed up the creation and editing process for objects within the Roblox digital universe.
Generative AI Roblox
Roblox wants creators to use generative AI as a technical assistant in areas where they may not have as much knowledge. A programmer with limited modeling experience could use the AI to produce 3D models of the objects they want to deploy, while proficient modelers who aren’t as comfortable coding can have the AI write the behavior and functionality they want the object to have once it’s placed in the digital world. Even those lacking either type of training, but who have a metaverse project idea could soon participate through written prompts and rely on the text-to-object AI to both design the look and the function of an object. That said, Roblox cautioned that building that feature will take some extra effort and time. Roblox’s generative AI mixes in-house and unnamed licensed models, though the training is restricted to public-domain game content. Roblox’s text prompt and generative AI code completion projects will start coming out over the next several weeks.
“We are building a platform that will enable every user to be a creator – not just those comfortable with Roblox Studio and other 3D content creation tools,” Roblox CTO Daniel Sturman said. “This vision requires a set of tools significantly more accessible to a typical user than exists in any environment today – things like voice and text or touch-based gestures rather than intricate mouse and keyboard movements. Generative AI tooling can help make creation intuitive and natural for users and be directly embedded into experiences, allowing any of our 58.8 million daily users to create unique content that can be shared across the platform.”
Roblox’s plans fit neatly into more than one trend in generative AI development and use. The GitHub Copilot AI coding assistant was one of Microsoft’s earliest projects employing OpenAI’s large language models, and the recently upgraded pair programmer has become very popular. On the visual front, Roblox creators have already started using text-to-image AI tools like DALL-E and Midjourney, and OpenAI recently opened a new dimension of creation through its POINT-E text-to-object generative AI tool. Roblox has plans to encourage creators to embed all kinds of generative AI tools in its metaverse in addition to its home-grown features.
“We also see a huge opportunity for the AI community itself to become creators on the Roblox platform,” Sturman said. “By enabling 3rd party AI creation services to plug directly into Roblox (likely as a creation experience), we provide a mechanism for their unique creations to be directly offered to Roblox users. We envision the community as a force multiplier for generative AI, creating an ecosystem that our creators and users can leverage to create content and tools more effectively.”