Nvidia Unveils Cosmos 3, an Open AI World Model for Robots and Autonomous Vehicles

Nvidia released Cosmos 3, an open-source AI world model trained on 20 trillion tokens of multimodal data designed to help robots and autonomous vehicles understand and predict real-world environments. The model is unique in generating action data—such as robot movements and trajectories—rather than just visual predictions, enabling machines to simulate and learn physical tasks. Nvidia is positioning this as foundational infrastructure for the emerging physical AI sector, competing with startups like World Labs and AMI Labs.
Nvidia unveiled Cosmos 3, an open AI world model designed to help robots, autonomous vehicles, and other physical systems better understand and predict real-world environments. The model was trained on 20 trillion tokens of multimodal data, including nearly a billion images, 400 million real and synthetic videos, ambient audio, text, and crucially, action data from humans and robots. Unlike standard video generators, Cosmos 3 is engineered to model how machines move and act in physical spaces, generating specific outputs like robot joint angles, gripper positions, and trajectories. Nvidia is releasing two versions immediately—a high-accuracy "super" model for robots and autonomous vehicles, and a fast "nano" model—with an "edge" model for local deployment coming soon. The company is establishing a coalition of partners including Agile Robots, Black Forest Labs, and Runway, positioning Cosmos as an open platform that hardware makers can customize for their needs.
What different sources said
- AxiosCenter
Nvidia's new world model helps robots navigate the world
- arXiv cs.AICenter
Cosmos 3: Omnimodal World Models for Physical AI
Related
Study Shows Statins Reduce Coenzyme Q in Brain Cells, Impairing Mitochondrial Function
A laboratory study found that statin drugs decrease coenzyme Q levels in astrocytes (brain support cells) by 30-40%, reducing their mitochondrial energy production and increasing oxidative stress. Astrocytes are critical for maintaining brain health and protecting neurons from damage. The findings suggest CoQ10 supplementation may help counteract these effects, though human clinical evidence remains limited.
Study reveals zebrafish larvae exhibit slowly fluctuating directional swim biases driven by internal dynamics
Researchers found that 5-day-old zebrafish larvae display changing directional swim preferences over many hours even in stable environments, contrary to classical models assuming constant individual biases. Computational analysis suggests these fluctuations arise from a non-stationary Markovian process with two independent internal input streams modulating swim direction repetition. The findings suggest animals possess intrinsic mechanisms for generating behavioral variability independent of external stimuli, with implications for understanding how internal states shape adaptive behavior.
Two Small Molecules Show Promise as Broad-Spectrum Coronavirus Inhibitors in Laboratory Study
Researchers found that sennoside A and ceftazidime, two small molecules, can inhibit RNA binding in the nucleocapsid proteins of SARS-CoV-2, SARS-CoV, and MERS-CoV in laboratory experiments. The nucleocapsid protein is highly conserved across coronaviruses and essential for viral replication, making it a potential drug target. The findings suggest these compounds could form the basis for pan-coronavirus antiviral therapies, though further development and clinical testing would be needed.