โ† Back to News
Published on 6/1/2026

NVIDIA Unveils Open-Source Physical AI Agent Toolkit & Cosmos 3; GitHub Copilot Shifts to Usage-Based Billing

NVIDIA Unveils Open-Source Physical AI Agent Toolkit & Cosmos 3; GitHub Copilot Shifts to Usage-Based Billing
NVIDIA Agent Toolkit
Open Source
NVIDIA Cosmos 3
Open World Foundation Model
GitHub Copilot Billing
Usage-Based (AI Credits)
Claude Opus 4.8
Available in Copilot

Daily Highlights

NVIDIA Unveils Open-Source Physical AI Agent Toolkit

NVIDIA today announced a significant collection of open-source physical AI agent tools and skills at GTC Taipei. Delivered via the NVIDIA Agent Toolkit, these resources are designed to help developers automate complex workflows across robotics, autonomous vehicles (AV), vision AI, and industrial digital twins. The toolkit integrates seamlessly with NVIDIA's existing platforms, including Omniverse, Cosmos, Isaac, Metropolis, Alpamayo, and Jetson, enabling agents to orchestrate tasks from data generation to deployment.

Introducing NVIDIA Cosmos 3: An Open World Foundation Model

Further expanding its AI ecosystem, NVIDIA launched Cosmos 3, an open world foundation model for physical AI. Described as the world's first fully open omnimodel, Cosmos 3 boasts native vision reasoning and multimodal generation capabilities across text, image, video, ambient sound, and action. This breakthrough architecture aims to drastically reduce physical AI training and evaluation cycles, transforming development from months to mere days.

Agent-Ready NVIDIA Physical AI Stack Enhancements

NVIDIA is optimizing its entire physical AI stack to be agent-ready, turning its extensive libraries, models, and frameworks into agent-callable tools. This includes the introduction of Nemotron 3 Ultra, a new 550 billion-parameter mixture-of-experts model tailored for long-running autonomous agents, promising faster inference and lower operational costs. Additionally, the OpenShell Secure Runtime provides a secure container environment for deploying these advanced agents with custom security and privacy controls.

Niche Project of the Day

Navigating Copilot's New Billing & Open-Source Alternatives

Effective today, June 1, 2026, GitHub Copilot has transitioned to a usage-based billing model, replacing fixed-cost Premium Request Units with AI Credits. This change impacts all Copilot plans, with token usage now metered for features like Copilot Chat, CLI, and cloud agents. For developers seeking cost-effective or open-source alternatives, tools like Cursor (a VS Code fork with built-in AI), Cody by Sourcegraph (a free VS Code extension), and Continue.dev (an open-source tool connecting to various LLMs) are gaining traction.

Key Takeaways

  • NVIDIA released a comprehensive open-source toolkit for physical AI agents, streamlining robotics and industrial AI development.
  • The new open world foundation model, NVIDIA Cosmos 3, offers multimodal generation and faster physical AI training.
  • GitHub Copilot's shift to usage-based AI Credits on June 1, 2026, encourages exploration of open-source coding assistants.