The world of streaming is evolving at a rapid pace, and so are the tools creators need to keep up. At Logitech G PLAY 2025, Streamlabs — in collaboration with NVIDIA and InWorld — introduced their Intelligent Streaming Agent, an AI-powered assistant equipped with RTX technology designed to support streamers live as co-host, producer, and technical support.
From multitasking streamer to smart assistant
Until now, creators had to be players, commentators, directors, and moderators all at once, while also troubleshooting technical issues. The new Streaming Agent aims to change that model, acting as a real-time collaborator capable of:
- Co-hosting the stream with an animated 3D avatar powered by NVIDIA ACE Audio2Face and optimized with DLSS. This avatar can respond to chat or keep the conversation going when the audience is quiet.
- Producing the broadcast by switching scenes, activating sounds or clips, and executing pre-set cues. All with configurable triggers that the streamer can customize.
- Providing technical support by answering questions about Streamlabs itself and helping resolve errors without interrupting the stream.
“With the integration of ACE Audio2Face into Streamlabs, creators can bring realistic avatars and real-time intelligence to their broadcasts, creating more engaging experiences directly from their PCs with NVIDIA GeForce RTX AI,” explained Jason Paul, Vice President of Technology at NVIDIA’s GeForce platform.
Professional streaming made accessible to all
Just a few years ago, setting up a streaming station required two computers, DSLR cameras, and XLR microphones. NVIDIA has worked to democratize this activity through several innovations:
- Efficient encoding: NVIDIA’s encoder allows high-quality streaming with just one PC equipped with a RTX GPU.
- Enhanced audio and video: Thanks to NVIDIA Broadcast, even affordable microphones and webcams can deliver professional-level sound and image.
- Optimized distribution: Features like Twitch’s Enhanced Broadcast and OBS make it easier for even small channels to stream in multiple qualities without relying on platform infrastructure.
The new Streamlabs assistant leverages these advancements and adds a layer of AI agentic capabilities, making it possible for even novice streamers to produce dynamic broadcasts with reactive overlays, custom avatars, and automated production support.
Real-time recognition and accelerated vision models
One of its standout features is the use of real-time vision models, accelerated by NVIDIA RTX, which can detect game events such as eliminations, wins, or critical health drops. This information enables automatic effects or scene changes, providing fluidity and dynamism without manual intervention.
All processing occurs locally on the RTX GPU, ensuring low latency and avoiding reliance on the cloud — a crucial aspect for live broadcasts.
A creative ecosystem beyond streaming
The presentation fits into a broader context: NVIDIA promotes an ecosystem of generative AI and creative tools for RTX-powered PCs. Recent innovations include:
- ComfyUI v3.57: Up to 40% performance improvements for generative models thanks to RTX, with support for new models such as Wan 2.2 (video), Qwen-Image (text and image), FLUX.1 Krea [dev], and Hunyuan3D 2.1 (3D asset generation).
- TensorRT and NIM microservices: Optimized models like Stable Diffusion 3.5 or FLUX.1 Kontext run up to 3 times faster and use 50% less VRAM on RTX.
- Updated RTX Remix: A new particle system with path tracing that allows modders to bring to life classic games with realistic, interactive visual effects.
Combined with the Streaming Agent, these tools establish RTX GPUs as the center of digital creation, supporting everything from live streaming to 3D content production and advanced image/video editing.
Conclusion
The Streamlabs Intelligent Streaming Agent, powered by NVIDIA RTX, marks a step toward smart automation in streaming. It doesn’t replace the creator but acts as a digital co-pilot that frees up time and attention for what truly matters: playing and engaging with the audience.
With features like interactive 3D avatars, real-time production, embedded technical support, and game event detection, this tool ushers in a new era where AI is not just an add-on but a active participant in the streaming experience.
Frequently Asked Questions
What is the Streamlabs Intelligent Streaming Agent?
It’s an AI-based assistant that helps streamers by acting as a co-host, producer, and technical support in real time, integrated into Streamlabs Desktop and accelerated by NVIDIA RTX GPUs.
How do 3D avatars work during streams?
Thanks to the NVIDIA ACE Audio2Face SDK and performance scaling with DLSS, avatars can animate in real time and respond to the audience without requiring streamer interruption.
Does the assistant require cloud connectivity?
No. Vision models and core functions run locally on the RTX GPU, ensuring low latency and a seamless experience.
What other NVIDIA tools complement the assistant?
It leverages the RTX encoder for streaming, NVIDIA Broadcast for improved audio/video, and new integrations with ComfyUI, TensorRT, NIM, and RTX Remix, expanding the creative ecosystem around RTX PCs.
via: nvidia blogs