ZeroHour

Search: “nvhbm”

2 stories

NVIDIA NVLink Fusion Expands With NVHBM Custom High-Bandwidth Memory

NVIDIA expands NVLink Fusion with NVHBM custom high-bandwidth memory for hyperscalers building trillion-parameter and agentic AI infrastructure.

NVIDIA announced that NVLink Fusion will expand to support NVHBM, a custom high-bandwidth memory option. The offering targets hyperscalers and AI innovators building next-generation systems where agentic AI and trillion-parameter workloads are mainstream. NVIDIA frames the announcement around co-designing compute, memory, storage, networking, and software as a unified system.

NVIDIA Blog · 20d agoAI industry

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA Blog · 14h agoAI industry