NVIDIA Research will use SIGGRAPH in Vancouver through Thursday, Aug. 14 to highlight graphics and simulation work tied to physical and spatial AI. The company says the effort combines neural graphics, synthetic data generation, physics-based simulation, reinforcement learning and AI reasoning for robotics, self-driving cars and smart spaces.
At the conference, NVIDIA is unveiling new software libraries for physical AI, including NVIDIA Omniverse NuRec 3D Gaussian splatting libraries for large-scale world reconstruction, updates to the NVIDIA Metropolis platform for vision AI, and NVIDIA Cosmos and NVIDIA Nemotron reasoning models. Cosmos Reason is described as a new reasoning vision language model for physical AI that enables robots and vision AI agents to reason like humans using prior knowledge, physics understanding and common sense.
“AI is advancing our simulation capabilities, and our simulation capabilities are advancing AI systems,” said Sanja Fidler, vice president of AI research at NVIDIA. “There’s an authentic and powerful coupling between the two fields, and it’s a combination that few have.”
“Physical AI needs a virtual environment that feels real, a parallel universe where the robots can safely learn through trial and error,” said Ming-Yu Liu, vice president of research at NVIDIA. “To build this virtual world, we need real-time rendering, computer vision, physical motion simulation, 2D and 3D generative AI, as well as AI reasoning. These are the things that NVIDIA Research has spent nearly two decades to be good at.”
The company said many of the tools are based on work from its global research team, which is presenting over a dozen papers at SIGGRAPH on neural rendering, real-time path tracing, synthetic data generation and reinforcement learning. NVIDIA said these capabilities will feed the next generation of physical AI tools.
NVIDIA also said its research in ray tracing and real-time computer graphics, dating back to the research organization’s inception in 2006, helps create the realism needed for physical AI simulations. Aaron Lefohn, vice president of graphics research and head of the Real-Time Graphics Research group at NVIDIA, said AI is also helping reconstruct 3D worlds from images and videos.
“Our core rendering research fuels the creation of true-to-reality virtual words used to train advanced physical AI systems, while AI is in turn helping us create those 3D worlds from images,” said Aaron Lefohn, vice president of graphics research and head of the Real-Time Graphics Research group at NVIDIA. “We’re now at a point where we can take pictures and videos — an accessible form of media that anyone can capture — and rapidly reconstruct them into virtual 3D environments.”
Source: blogs.nvidia.com.
Companies can share verified announcements through Newz9’s international press release submission page.
