“We expect to continue improving the performance of Blackwell through its operational life as we have done with Hopper and Ampro.”

In context

“es AI inference throughput by 30x for the new reasoning models sweeping the industry. Developer engagements increased with adoption ranging from LLM providers such as Perplexity to financial service institutions such as Capital One, who reduced agentic chatbot latency by 5x with Dynamo. In the latest MLPerf inference results, we submitted our first results using GB200 NBL72, delivering up to 30x higher inference throughput compared to our 8 GPU H200 submission on the challenging Llama 3.1 benchmark. This feat was achieved through a combination of tripling the performance per GPU as well as 9x more GPUs, all connected on a single NVLink domain. And while Blackwell is still early in its life cycle, software optimizations have already improved its performance by 1.5x in the last month alone. We expect to continue improving the performance of Blackwell through its operational life as we have done with Hopper and Ampro. For example, we increased the inference performance of Hopper by four times over two years. This is the benefit of NVIDIA Corporation's programmable CUDA architecture and rich ecosystem. The pace and scale of AI factory deployments are accelerating, with nearly 100 NVIDIA Corporation-powered AI factories in flight this quarter, a twofold increase year over year, with the average number of GPUs powering each factory also doubling in the same period. More AI factory projects are starting across industries and geographies. NVIDIA Corporation's full-stack architecture is underpinning AI factory deployments as industry leaders like AT&T, BYD, Capital One, Foxconn, MediaTek, and Telenor are strategically vital sovereign clouds like those recently announced in Saudi Arabia, Taiwan, and the UAE.”