ZeroHour
Vendor

Groq

0 mentions in 7 days · 2 in 30 days · 2 total · first seen · last

Timeline

[AINews] Hot Chips: OpenAI’s Jalapeño, Cerebras CS-5, Groq 3 LPX, Apple M6

OpenAI unveiled Jalapeno custom inference chip claiming 1.5-1.9x better perf-per-watt than NVIDIA GB200/GB300, deploying in-house by year-end.

At the 37th Hot Chips conference, OpenAI published first benchmark details for its custom Jalapeno inference chip, claiming 1.5-1.9x more work per watt, 1.7-3.6x lower end-to-end latency, and 2.1-4.1x higher interactive-workload performance versus NVIDIA GB200/GB300, with the 700W-rated part staying at or below 550W in tests. Deployment into OpenAI's own infrastructure begins by year-end, with Gen 2 deep in development and Gen 3 underway. OpenAI also said GPT-Astra and Codex helped write low-level kernels, reportedly 1.5-1.8x faster than human-expert code for selected attention and MoE blocks. Cerebras CS-5, Groq 3 LPX and Apple M6 were also featured at the conference.

Latent Space · 20d agoAI industry

With Groq 3 LPX in Full Production, NVIDIA Extends Vera Rubin Inference for Agents

NVIDIA puts Groq 3 LPX into full production and extends Vera Rubin NVL72 rack-scale systems for fast token generation in agentic AI inference.

NVIDIA announced that Groq 3 LPX is in full production as part of an extension of the Vera Rubin NVL72 rack-scale platform aimed at agentic AI inference. The announcement frames the next era of inference as full-stack AI factory co-design across chips, networking, and systems rather than a single component breakthrough. The focus is improving token generation speed for agent workloads.

NVIDIA Blog · 22d agoAI industry