Nvidia offers open AI models for companies to run in-house

Nvidia has released a new set of open AI models aimed at enterprise customers who want to run AI on their own infrastructure, according to TechCrunch. The company is also making it possible to deploy private AI agents directly on PCs, rather than relying on cloud services.

Why it matters

Businesses have been asking for more control over their data and how their AI systems operate. Nvidia’s move addresses growing concerns about data privacy, security, and the ongoing costs of cloud computing. By providing open models, Nvidia is giving organizations the option to keep sensitive information inside their own networks.

TechCrunch reports that many enterprises are looking for ways to avoid vendor lock-in and unpredictable cloud expenses. Running AI models in-house can help with these issues, but it also means companies take on more responsibility for managing and securing their systems. For organizations with strict compliance requirements or proprietary data, this approach offers a clear alternative to outsourcing everything to cloud providers.

What Nvidia is putting on the table

According to TechCrunch, Nvidia’s new open models are designed for flexibility. Companies can deploy them in their own data centers, customize them for their needs, or run them locally on PCs. Nvidia is focusing on what it calls “private AI agents”, applications that automate tasks or act on behalf of users, all without sending data off-site.

This is a shift from the typical setup, where most AI workloads run on large, centralized cloud systems. Nvidia’s models are aimed at organizations that want to experiment with or scale up AI without handing over their data to external providers. This could be especially important for regulated industries or businesses that want to keep intellectual property under their own roof.

TechCrunch also points out that Nvidia is now developing and releasing its own models for customers to use directly, not just selling hardware. This puts Nvidia in a different position from companies that only offer cloud-based AI, and it could appeal to businesses investing in their own AI infrastructure.

What this means if you run a business

If your company handles sensitive data or wants to avoid relying on cloud vendors, Nvidia’s open models give you a new option. You can now run current AI models on your own hardware, which may help control ongoing costs and keep performance more predictable. But you will need staff who can manage, update, and secure these systems. The benefit is more control, but the responsibility shifts to your team.

This change could also affect how you plan your tech budget. Instead of paying recurring cloud fees, you might invest more in local infrastructure and skilled employees. For companies in regulated sectors or facing new AI compliance demands (see our reporting on global AI regulation), keeping AI in-house could be a safer choice.

For smaller businesses, the value of on-device AI will depend on how easy Nvidia makes it to set up and maintain these models. If Nvidia’s open approach leads to more tools and support, it could help companies that have avoided AI because of privacy or cost concerns.