ZeroHour

Search: “tensorrt”

3 stories in the last 7d

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

NVIDIA's Vera Rubin NVL72 debuts in MLPerf Inference v6.1 with up to 3.7x higher throughput than GB300 NVL72 and 99% scaling efficiency at 288 GPUs.

In its first MLPerf Inference preview submission, NVIDIA's Vera Rubin NVL72 achieved up to 3.7x higher throughput than GB300 NVL72 on Qwen3-VL and 2.5x on DeepSeek-R1. A 288-GPU GB300 NVL72 submission across four racks reached 99% scaling efficiency on the DeepSeek-R1 offline benchmark. Software optimizations delivered up to 1.6x gains over v6.0, leveraging TensorRT-LLM, vLLM, Dynamo, disaggregated serving, and NVFP4 precision.

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA Blog · 1d agoAI industry

Skild AI Taps NVIDIA Physical AI to Teach Robots New Tasks From a Single Video

Skild AI launched its S1 robot foundation model, built on NVIDIA infrastructure, that learns long-horizon industrial tasks from a single video.

Skild AI's S1 model uses in-context learning from one video demonstration to execute unfamiliar multistep tasks lasting up to 10 minutes without weight updates or task-specific post-training. In tests on new tasks it achieved about 66% per-step success versus 9% for a comparable AI system, and one video demonstration was estimated to match roughly 380 hands-on training examples. The company reached a $100 million annual revenue run rate with more than 60 deployment partnerships, and with NVIDIA and Foxconn deploys the Skild Brain on dual-arm manipulators assembling NVIDIA Blackwell systems. Training and validation rely on NVIDIA Isaac Lab, Isaac Sim, Omniverse, Cosmos and the Newton physics engine.

NVIDIA Blog · 6d agoModel release