[AINews] Hot Chips: OpenAI’s Jalapeño, Cerebras CS-5, Groq 3 LPX, Apple M6
OpenAI unveiled Jalapeno custom inference chip claiming 1.5-1.9x better perf-per-watt than NVIDIA GB200/GB300, deploying in-house by year-end.
At the 37th Hot Chips conference, OpenAI published first benchmark details for its custom Jalapeno inference chip, claiming 1.5-1.9x more work per watt, 1.7-3.6x lower end-to-end latency, and 2.1-4.1x higher interactive-workload performance versus NVIDIA GB200/GB300, with the 700W-rated part staying at or below 550W in tests. Deployment into OpenAI's own infrastructure begins by year-end, with Gen 2 deep in development and Gen 3 underway. OpenAI also said GPT-Astra and Codex helped write low-level kernels, reportedly 1.5-1.8x faster than human-expert code for selected attention and MoE blocks. Cerebras CS-5, Groq 3 LPX and Apple M6 were also featured at the conference.
Sure, Meta’s AI Muse works, but it sure creeps me out
Hands-on review finds Meta's Muse AI agent completes shopping and email tasks but surfaces personal Instagram API data beyond user-visible ad-topic settings.
Meta launched Muse, its first agentic AI productivity assistant, which performs tasks like shopping, email management, trip planning, media generation, and creating webpages or documents via a cloud-based virtual computer. The Verge's hands-on found it successfully deleted thousands of promotional emails and completed an Amazon purchase, but it also revealed detailed personal interests inferred from Instagram and Facebook account API data that is not visible in the apps' ad-topic settings. Meta says Muse only exchanges data needed for third-party integrations and does not share information with advertisers; the reviewer frames privacy unease as the main adoption hurdle.
Google Releases Gemini 3.8 Live and 3.8 Live Extended Thinking for Production Grade Voice Agents
Google launches Gemini 3.8 Live and Extended Thinking speech-to-speech models for production voice agents, topping speech-to-speech benchmarks.
Google released Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking, native speech-to-speech models for real-time voice agents, available hosted via the Gemini Live API and AI Studio. Extended Thinking ranks #1 on Artificial Analysis' Speech-to-Speech Quality Index with 82.6, scores 68.6% on τ-Voice, 35.1% on Sierra's τ-Voice-banking, and 97.7% on Big Bench Audio. The models support asynchronous function calling, near-real-time visual context, alphanumeric precision, and 97 languages, priced at $0.005/min audio input and $0.018/min audio output. All generated audio carries Google DeepMind's imperceptible SynthID watermark.