Skip to main content

A closer look at Dynamo, Nvidia's 'operating system' for AI inference

3 months 2 weeks ago
GPU goliath claims tech can boost throughput by 2x for Hopper, up to 30x for Blackwell

GTC  Nvidia's Blackwell Ultra and upcoming Vera and Rubin CPUs and GPUs dominated the conversation at the corp's GPU Technology Conference this week. But arguably one of the most important announcements of the annual developer event wasn't a chip at all but rather a software framework called Dynamo, designed to tackle the challenges of AI inference at scale.…

Tobias Mann
Checked
1 hour 45 minutes ago
The Register
Biting the hand that feeds IT — Enterprise Technology News and Analysis
Subscribe to The Register feed