Nvidia Upgrades and Expands Omniverse for Enterprise and Generative AI
Nvidia has added new features and widened access to its Omniverse, the company’s metaverse platform. The new Omniverse Cloud and Omniverse Connectors will enable more enterprise use of the platform and leverage generative AI and other tools for industrial and commercial projects.
Nvidia’s new Omniverse Cloud combines generative AI and simulation services for industrial development. Microsoft Azure is handling cloud services, augmenting the Omniverse software with access to Azure’s services as well. The Omniverse Cloud is designed for digitizing and testing enterprise projects such as automotive design and factory automation. The new service includes tools for creating virtual factories mirroring ones in the real world, the option to stream simulated experiences and training to AI-powered robots, and even a simulator for testing autonomous vehicles. Nvidia emphasized the automotive possibilities partly because Omniverse Cloud is already being used in some capacity by BMW, Geely Lotus, and Jaguar Land Rover.
“Nvidia Omniverse has given us an unprecedented ability to design, build and test complex manufacturing systems, which means we can plan and optimize a next-generation factory completely virtually before we build it in the physical world,” BMW AG board member for production Milan Nedeljković said. “This will save us time and resources, increase our sustainability efforts and improve operational efficiencies.”
The Omniverse Connectors announcement brings a slew of new tools to the platform, linking to common applications through the Universal Scene Description (USD) framework, such as the Siemens Xcelerator portfolio of tools and the upcoming Azure Digital Twin. Nvidia is also planning to release Omniverse Kit 105 soon, which will include its first real-time ray-traced subsurface scattering, meaning that objects will be able to better reflect light based on the material they are simulating, whether marble, metal, or mud. The platform is also adding synthetic data generation to train conversational AI.
The Microsoft Azure deal is only the first step of a larger collaboration with Nvidia’s Omniverse. Nvidia and Microsoft are working to embed the Omniverse into Microsoft 365 so that people on Teams conference calls could see the digital creations within the application, essentially hosting a meeting in the metaverse. The same goes for the generative AI Microsoft has been enthusiastically integrating into nearly all of its products. Nvidia is working on projects like a text-to-materials extension so users could describe materials in text format, and the AI would simulate the described material in 3D. The same goes for text-to-code generation and even using ChatGPT to produce data for that the Camera Studio Omniverse extension could use to design and build a camera.
“Every manufactured object, from massive physical facilities to handheld consumer goods, will someday have a digital twin, created to build, operate and optimize the object,” Nvidia CEO Jensen Huang said. “Nvidia Omniverse Cloud is the digital-to-physical operating system for industrial digitalization, arriving just in time for the trillions of dollars of new EV, battery and chip factories that are being built.”