ZeroHour

Search: “efficiency”

158 stories

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

NVIDIA's Vera Rubin NVL72 debuts in MLPerf Inference v6.1 with up to 3.7x higher throughput than GB300 NVL72 and 99% scaling efficiency at 288 GPUs.

In its first MLPerf Inference preview submission, NVIDIA's Vera Rubin NVL72 achieved up to 3.7x higher throughput than GB300 NVL72 on Qwen3-VL and 2.5x on DeepSeek-R1. A 288-GPU GB300 NVL72 submission across four racks reached 99% scaling efficiency on the DeepSeek-R1 offline benchmark. Software optimizations delivered up to 1.6x gains over v6.0, leveraging TensorRT-LLM, vLLM, Dynamo, disaggregated serving, and NVFP4 precision.

NVIDIA Blog · 13h agoAI industry 2 sources

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA Blog · 1d agoAI industry

Arm Mali G2-Ultra NX GPU: desktop-class mobile gameplay with AI-native graphics

Arm unveiled Mali G2-Ultra NX, its first AI-native mobile GPU with in-shader neural acceleration, third-gen ray tracing, and up to 24% higher benchmark performance.

Arm announced the Mali G2-Ultra NX, the first AI-native Mali GPU, integrating neural accelerators directly into shader cores alongside a new execution engine and third-generation hardware ray tracing. It introduces Neural Super Sampling (NSS), Neural Frame Rate Upscaling (NFRU), and Neural Super Sampling and Denoising (NSSD); the Neural Dawn demo with Sumo Digital showed up to 4x performance efficiency and 70% lower external memory traffic versus native rendering. Arm claims up to 24% higher benchmark performance, 13% lower DRAM traffic on ray tracing benchmarks, and up to 120 FPS with NFRU. Over 14 billion Mali GPUs have shipped to date.

Jalapeño’s first results show industry-leading speed and efficiency in AI inference

OpenAI's Jalapeño custom inference chip shows faster, more power-efficient inference with higher throughput and lower latency.

OpenAI announced first results for Jalapeño, its custom AI inference chip. The company claims industry-leading speed and efficiency, delivering higher throughput and lower latency for modern models compared with existing options. The chip targets more power-efficient serving of large models at scale.

OpenAI News · 22d agoAI industry

Architecting memory and storage in the AI era

Analysis argues AI inference shifts data-center bottlenecks to memory and storage, urging balanced compute, memory, storage, and network architecture over raw compute.

MIT Technology Review, citing Tirias Research principal analyst Jim McGregor, argues that AI inference and agentic workloads make data movement the key constraint, elevating memory and storage from background hardware to strategic assets. The piece says RAG and real-time inference require continuous data retrieval and caching that legacy infrastructure cannot support. It frames infrastructure planning as a business decision balancing performance, efficiency, cost, and scalability in healthcare, finance, and customer-facing AI.

MIT Technology Review · AI · 12d agoAI industry

Building the materials foundation for AI

Syensqo's CTO says AI pushes semiconductors and data centers to physical limits, driving advanced materials demand and AI-accelerated materials discovery.

MIT Technology Review's Business Lab podcast, produced in partnership with Syensqo, features CTO Mike Finelli discussing how AI workloads push semiconductors and data centers to physical limits in performance, thermal management, and reliability. Syensqo develops high-voltage data center materials, semiconductor sealing materials, and immersion cooling fluids, while using AI agents to digitally synthesize millions of molecular combinations and predict performance before lab testing. Finelli describes a reinforcing cycle where AI improves materials that in turn enable better AI infrastructure.

MIT Technology Review · AI · 15h agoAI industry

Opaque recurrence, and other AI terms that you should probably know

TechCrunch updates its plain-English glossary defining common AI terms from AGI and agents to chain-of-thought reasoning.

TechCrunch maintains a regularly updated glossary of AI terminology, defining terms such as AGI, AI agents, API endpoints, chain of thought, coding agents, compute, deep learning, and diffusion. It highlights 'opaque recurrence', the reasoning technique in OpenAI's new Astra model that has drawn attention from AI safety researchers. The piece is an educational living document rather than new research or a product announcement.

TechCrunch · AI · 9d agoAI industry1

Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents

NVIDIA claims Vera Rubin NVL72 delivers up to 30x more work per watt, citing OpenRouter data that agentic workloads use 15x more tokens than chat.

NVIDIA positions the Vera Rubin NVL72 as a new efficiency standard for AI agents, claiming up to 30x more work per watt. The company cites OpenRouter data showing agentic AI workloads consume 15x more tokens than a simple chat request, using a financial-research agent example that spawns sub-agents and multiple tool calls. The piece is largely a product efficiency narrative rather than independent benchmarking.

NVIDIA Blog · 23d agoAI industry

Model ML completes finance work more efficiently with GPT-5.6 Sol

OpenAI customer Model ML uses GPT-5.6 Sol to turn finance research into editable, traceable decks and workbooks.

OpenAI published a customer story describing how Model ML uses GPT-5.6 Sol for finance work. The model carries tasks from research and analysis through to editable, traceable PowerPoint decks and Excel workbooks. This is a product adoption case rather than a new model release.

OpenAI News · Aug 10, 2026AI industry

From Megawatts to Tokens: How NVIDIA Maximizes AI Factory Production

NVIDIA detailed DSX power-management results: Lambda gained 24% token throughput at fixed power, and an AI factory auto-shed 1MW via Emerald AI's grid program.

NVIDIA says Lambda's first validation of DSX MaxLPS on HGX B200 servers ran 19 nodes within a 16-node power budget, lifting cluster token throughput 24% (roughly 4M to 5M tokens/second) and improving performance per watt by 23%. NVIDIA projects DSX MaxLPS can enable up to 40% more GPU capacity for Vera Rubin NVL72 factories within the same megawatt budget. Emerald AI's Conductor platform, running at NVIDIA's Eos factory with Silicon Valley Power, responded to over 200 utility demand signals, automatically dropping power from 4MW to 3MW without interrupting priority workloads. The first dedicated DSX Flex commercial deployment is planned at a 96-megawatt Manassas, Virginia facility.

NVIDIA Blog · 1d agoAI industry

Sparks Fly: NVIDIA Accelerates Local AI at IFA 2026

NVIDIA announces local AI push at IFA 2026 with faster llama.cpp/vLLM inference, PAIR routing tool, and October RTX Spark PCs.

At IFA 2026, NVIDIA announced simplified local AI support for agents in Hermes Agent, OpenClaw, and Perplexity Portable Computer, plus new llama.cpp and vLLM optimizations delivering up to 1.9x faster local inference. NVIDIA also unveiled PAIR, a Personal AI Router for distributing inference across a local network's PCs, and compact RTX Spark Windows PCs from Lenovo and Acer arriving in October. The post recaps recent local-capable model releases including Nemotron 3.5 Lightning (30B), Qwen3.8-Flash-Next and Qwen3.8-27B, DeepSeek v4 Flash (284B MoE, 13B active), Meta Muse Glimmer (30B), Z.ai GLM-5.3-Flash, LTX 2.5, and MiniMax-H3 with the FastH3 distilled variant.

NVIDIA Blog · 13d agoAI industry

Closed-Loop Cooling Explained: The Plumbing Behind Meta’s AI

Meta engineer Tom Shaw explains the closed-loop liquid cooling systems that power Meta's AI data centers more efficiently.

Meta published an explainer describing its use of closed-loop liquid cooling to support AI workloads. The post, authored by Tom Shaw, frames the plumbing and thermal design as key to running AI infrastructure efficiently. The content is primarily corporate/infrastructure marketing rather than a security or product announcement.

Meta Newsroom · 20d agoAI industry

[AINews] 10% worse, 100x cheaper, 10000x faster: Why Simulation is taking over

Latent Space argues AI training pipeline stages—rewards, data, teachers, curricula, environments—are flipping from human-made to model-made simulation.

Latent Space's AINews essay traces how each component of AI training has turned synthetic since 2022: reward models (InstructGPT, RLAIF), synthetic pretraining data (Microsoft Phi, NVIDIA Nemotron-4 340B), model teachers (Alpaca, DeepSeek-R1 distillation), and self-generated curricula (Self-Rewarding Language Models, SPIN). In 2026 it highlights Karpathy's autoresearch loop—700 experiments yielding 20 kept improvements, cutting GPT-2 training time from 2.02 to 1.80 hours—and Z.ai's GLM-5.3 fully synthetic RL environment, judging, and verification stack. It frames these shifts as 'simulation': 10% worse but 100x cheaper and 10,000x faster than human equivalents.

Latent Space · 25d agoAI industry

The builder’s guide to GPT‑5.6

OpenAI publishes a builder's guide showing startups how to use GPT-5.6 and updated Responses API features to build cost-efficient AI agents.

OpenAI released a guide aimed at developers and startups building on GPT-5.6. It covers smarter model selection and new Responses API capabilities intended to make AI agents faster and more cost-efficient to run. The piece is promotional developer guidance rather than a research or security announcement.

OpenAI News · Aug 13, 2026AI industry

What must happen for AI’s trillion-dollar gamble to pay off

Hyperscalers need 2.7x productivity gains by 2030 to justify nearly $1.1 trillion in AI data center spending, or risk bankruptcy and capital misallocation.

Wharton finance professor Jessica Wachter estimates hyperscaler AI expenditure will reach nearly $1.1 trillion through 2027 and that a 2.7x productivity increase is needed to break even by 2030. AI revenues of roughly $150-200 billion this year fall far short of about $750 billion in annual spending, with total investment from Alphabet, Microsoft, Amazon, Meta, and Oracle potentially exceeding $5 trillion over four years. Alphabet reported its first free cash flow deficit (about $5.9 billion) since its 2004 IPO due to AI infrastructure costs. Researchers warn that failed demand could make the buildout the largest capital misallocation in history, with depreciating GPU chips risking stranded assets.

MIT Technology Review · AI · 1d agoAI industry

Cognition helps Devin test its own work with GPT‑6 Astra

Cognition integrates GPT-6 Astra into Devin, its CLI, and desktop products to automate testing and provide evidence for code review.

OpenAI published a customer case study on Cognition, maker of the autonomous software engineer Devin, which serves customers from large banks to startups. Cognition uses GPT-6 Astra across its cloud agent, CLI, and desktop products; in one example, Devin uses Astra to test the iPhone game Otter Run and returns a simulator recording plus a report of passed checks and untested areas. Co-founder Walden Yan says Astra's ability to test and prove work functions as expected could reduce manual code review. The team also uses Astra to fix customer-reported bugs from screenshots and return verification screenshots faster.

OpenAI Newsupdated · 4d agofirst · 5d agoAI industry 11 sources1

AWS is using Qualcomm for AI inference while Qualcomm uses AWS Bedrock to design the chips

Qualcomm will design custom AI inference chips for AWS while using Bedrock for chip design, its third major data center win since June.

Qualcomm is designing custom AI inference chips for AWS across multiple product generations and co-developing optical interconnects with up to 1.6 Tbps bandwidth. In return, Qualcomm uses Amazon Bedrock to accelerate its chip design process. The deal is Qualcomm's third major data center win since June, after Meta adopted the Dragonfly C1000 server processor and Microsoft began deploying Qualcomm's HBC memory architecture in Azure; Qualcomm targets $15 billion in data center revenue by 2029.

The Decoder · 7d agoAI industry1

[AINews] Fal’s H3 Max Live breaks the infinite videogen barrier

Fal post-trained MiniMax H3 into a 'Max' variant with 35x-faster inference, enabling faster-than-realtime AI video generation and infinite streams.

Fal post-trained MiniMax's H3 model into a 'Max' variant and optimized it for its in-house inference engine, achieving roughly 35x the speed of the official endpoint. The optimization enables faster-than-realtime video generation, demonstrated by an infinite interactive AI-generated stream productized by levels.io. The roundup also notes Meta Muse Code's general availability with an SDK, open DeepSeek-V4-Flash-Vision-Exp weights, GLM-5.3-Flash's strong agentic cost/performance rankings, and Tencent's 770B-parameter Hy4 Preview MoE with 49B active parameters.

Latent Space · 15d agoAI industry

[AINews] Andrew Ng gets into AI Engineering

Andrew Ng relaunches DeepLearning.AI around AI Engineering, defining four core skills from an analysis of 10,000+ job postings and expert interviews.

Andrew Ng, cofounder of Google Brain and Coursera, relaunched DeepLearning.AI with a focus on AI Engineering, basing the curriculum direction on an analysis of over 10,000 job postings plus interviews and surveys. He identifies four key skills: building and deploying AI applications, software engineering fundamentals, effective use of coding agents, and shaping the build with product sense. The Latent Space AI News issue also recaps agent ecosystem developments, including NVIDIA's 'Skill Lift' evaluation proposal showing skill scan scores correlate only weakly (Spearman rho = 0.14) with judged quality, and Konwinski's open-source persistent-agent 'microharness' Headlong, which achieved an unattended self-debugging repair in 48 minutes.

Latent Space · 23d agoAI industry1