The company launches NIM microservices and AI blueprints to enhance intelligent agents and creative workflows on personal computers.
At CES 2025, NVIDIA unveiled its latest innovation in artificial intelligence (AI) for PCs: foundation models optimized to run locally on GeForce RTX™ 50 Series GPUs, providing exceptional performance for content creation, productivity, and development. These models will be available as NVIDIA NIM™ microservices, powered by the new Blackwell architecture, which includes support for FP4 computing, doubling the AI inference performance.
A Quantum Leap in AI Computing
Jensen Huang, founder and CEO of NVIDIA, emphasized: “AI is advancing at the speed of light. With NIM microservices and AI blueprints, we are providing developers and enthusiasts with the tools necessary to explore the magical potential of artificial intelligence on their PCs.”
The GeForce RTX 50 Series GPUs, capable of achieving up to 3.352 trillion AI operations per second (TOPS) and featuring up to 32 GB of VRAM, enable advanced generative models to run directly on PCs. This eliminates reliance on data centers, democratizing access to AI technology for individual users.
AI Tools for Everyone
NIM microservices are compatible with AI development platforms such as LangChain, AnythingLLM, ComfyUI, and CrewAI, making it easy to integrate advanced models into applications. Additionally, NVIDIA launched the R2X project, an AI-powered digital avatar capable of assisting with tasks such as document summarization, video calls, and more.
With NIM, developers can:
- Create podcasts from PDFs: Generate scripts and audio recordings with customized voices.
- Control 3D image generation: Use scenes created in Blender to guide the generation of high-quality images with AI.
AI Blueprints: Preconfigured Workflows
The AI Blueprints, based on NIM microservices, provide ready-to-use workflows, such as converting documents into podcasts or generating images guided by 3D compositions. For instance, the PDF-to-Podcast Blueprint uses NVIDIA Riva to transform text into audio, while the 3D Blueprint utilizes the FLUX service to generate images.
Availability and Compatibility
- NIM microservices and AI Blueprints will be available in February 2025 for GeForce RTX 50 Series GPUs, 4090, 4080, and NVIDIA RTX 6000 and 5000 professional GPUs.
- Compatible PCs, known as RTX AI PCs, will be available from manufacturers such as Acer, ASUS, Dell, GIGABYTE, HP, Lenovo, MSI, and Razer, as well as local builders like Corsair, Falcon Northwest, and Origin PC.
With these innovations, NVIDIA is redefining how AI is utilized on PCs, enabling both developers and enthusiasts to leverage the most advanced technologies in their daily workflows.
via: Nvidia news