ZeroHour

Search: “efficiency”

12 stories in the last 3d

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

NVIDIA's Vera Rubin NVL72 debuts in MLPerf Inference v6.1 with up to 3.7x higher throughput than GB300 NVL72 and 99% scaling efficiency at 288 GPUs.

In its first MLPerf Inference preview submission, NVIDIA's Vera Rubin NVL72 achieved up to 3.7x higher throughput than GB300 NVL72 on Qwen3-VL and 2.5x on DeepSeek-R1. A 288-GPU GB300 NVL72 submission across four racks reached 99% scaling efficiency on the DeepSeek-R1 offline benchmark. Software optimizations delivered up to 1.6x gains over v6.0, leveraging TensorRT-LLM, vLLM, Dynamo, disaggregated serving, and NVFP4 precision.

NVIDIA Blog · 21h agoAI industry 2 sources

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA Blog · 1d agoAI industry

Building the materials foundation for AI

Syensqo's CTO says AI pushes semiconductors and data centers to physical limits, driving advanced materials demand and AI-accelerated materials discovery.

MIT Technology Review's Business Lab podcast, produced in partnership with Syensqo, features CTO Mike Finelli discussing how AI workloads push semiconductors and data centers to physical limits in performance, thermal management, and reliability. Syensqo develops high-voltage data center materials, semiconductor sealing materials, and immersion cooling fluids, while using AI agents to digitally synthesize millions of molecular combinations and predict performance before lab testing. Finelli describes a reinforcing cycle where AI improves materials that in turn enable better AI infrastructure.

MIT Technology Review · AI · 1d agoAI industry1

From Megawatts to Tokens: How NVIDIA Maximizes AI Factory Production

NVIDIA detailed DSX power-management results: Lambda gained 24% token throughput at fixed power, and an AI factory auto-shed 1MW via Emerald AI's grid program.

NVIDIA says Lambda's first validation of DSX MaxLPS on HGX B200 servers ran 19 nodes within a 16-node power budget, lifting cluster token throughput 24% (roughly 4M to 5M tokens/second) and improving performance per watt by 23%. NVIDIA projects DSX MaxLPS can enable up to 40% more GPU capacity for Vera Rubin NVL72 factories within the same megawatt budget. Emerald AI's Conductor platform, running at NVIDIA's Eos factory with Silicon Valley Power, responded to over 200 utility demand signals, automatically dropping power from 4MW to 3MW without interrupting priority workloads. The first dedicated DSX Flex commercial deployment is planned at a 96-megawatt Manassas, Virginia facility.

NVIDIA Blog · 1d agoAI industry

What must happen for AI’s trillion-dollar gamble to pay off

Hyperscalers need 2.7x productivity gains by 2030 to justify nearly $1.1 trillion in AI data center spending, or risk bankruptcy and capital misallocation.

Wharton finance professor Jessica Wachter estimates hyperscaler AI expenditure will reach nearly $1.1 trillion through 2027 and that a 2.7x productivity increase is needed to break even by 2030. AI revenues of roughly $150-200 billion this year fall far short of about $750 billion in annual spending, with total investment from Alphabet, Microsoft, Amazon, Meta, and Oracle potentially exceeding $5 trillion over four years. Alphabet reported its first free cash flow deficit (about $5.9 billion) since its 2004 IPO due to AI infrastructure costs. Researchers warn that failed demand could make the buildout the largest capital misallocation in history, with depreciating GPU chips risking stranded assets.

MIT Technology Review · AI · 2d agoAI industry

[AINews] Reality Checks on AI News (Yegge shuts down Gas Town, Databricks’ +60% Astra cost)

Latent Space AI news roundup: Steve Yegge shuts down Gas Town, Databricks reports 60% higher coding spend on GPT-6 Astra, OpenAI launches misalignment disclosure framework.

Latent Space's AI News digest for September 15-16, 2026 leads with Steve Yegge shutting down his Gas Town orchestrator despite spending thousands monthly on coding-agent subscriptions. Databricks rolled out GPT-6 Astra to roughly 3,500 engineers, reporting superior long-horizon performance over Opus 5 and Sol 5.6 but a ~60% increase in coding spend. OpenAI published a formal framework for disclosing model misalignment incidents with six case reports, while Microsoft and Google Research released safety papers on 'capability laundering' and the Fuse motive-inference benchmark. Xiaomi shared live RL training telemetry for MiMo-V2.6, estimated at $493k/day for the 1T-class Pro run.

Latent Space · 5h agoAI industry

Al Gore says the real AI risk isn’t data centers — it’s what industry leaders are warning about

Al Gore argues AI data center emissions are modest and takes AI leaders' existential risk warnings, citing model misbehavior, at face value.

In a TechCrunch interview with Generation Investment Management's Lila Preston, Al Gore said AI data center emissions are a fraction of those from uncovered landfills and smaller than air conditioning demand, which the IEA expects to triple by 2050. He endorses warnings from Dario Amodei, Sam Altman, and Elon Musk, pointing to reported model behaviors like escaping confinement, secretly collaborating, and covering tracks, and to Anthropic stopping Claude being used to help develop biological weapons. Gore cited a Nicholas Stern study projecting AI-driven efficiency gains could cut global emissions 6-9% per year from next decade, while Preston highlighted investments in grid and decarbonization companies such as Volue and Gridware.

TechCrunch · AI · 13h agoAI industry

macOS 27 Golden Gate – Review

Ars Technica reviews macOS 27 Golden Gate, highlighting an unavoidable Apple Intelligence upgrade, new AFM 3 Core models, and dropped Intel Mac support.

macOS 27 Golden Gate delivers the first significant Apple Intelligence upgrade two years after launch, and the toggle to disable the AI features or delete downloaded models is gone. Apple Intelligence runs on a new AFM 3 Core model built in collaboration with Google, while the more capable AFM 3 Core Advanced requires an M3 chip and at least 12GB of RAM. The release drops all Intel Mac support, requiring Apple Silicon, with Sequoia security updates expected to end in fall 2027 and Tahoe's in 2028.

Apple might make servers again to cash in on the AI rush

Apple reportedly plans AI servers pairing M8 Ultra chips with Nvidia NVLink Fusion, targeting a 2029 debut.

According to The Information, Apple is considering re-entering the server market it left in 2011 with the Xserve retirement, betting on its ARM-based M processors amid surging AI compute demand. The servers may run two or four M8 Ultra chips and could incorporate Nvidia's NVLink Fusion interconnect, and Apple recently turned to Nvidia chips for its revamped Siri servers. A product would likely debut around 2029, and plans could still change; Mac Mini and Mac Studio popularity with AI developers has already caused shortages.

The Verge · AIupdated · 14h agofirst · 19h agoAI industry 3 sources

Emerald AI, Google and NVIDIA Launch Alliance to Advance Flexible AI Data Centers

Emerald AI, Google, and NVIDIA launched the AI Energy Management Alliance to promote power-flexible, grid-responsive AI data centers.

Emerald AI, Google, and NVIDIA announced the AI Energy Management Alliance (AEMA), a coalition advancing data centers that dynamically adjust electricity use in response to grid conditions. The technology-neutral, performance-based alliance will standardize flexibility requirements, define ride-through and curtailment obligations, and create faster interconnection pathways for facilities making verifiable flexibility commitments. It plans to convene AI platforms, data center operators, utilities, power producers, and grid operators to support US AI infrastructure growth.

NVIDIA Blog · 23h agoAI industry

University of Manchester Uses NVIDIA Earth-2 to Forecast Air Pollution Across the UK

University of Manchester retrained NVIDIA Earth-2 CorrDiff and StormCast on Isambard-AI to forecast UK air pollution at 2-3 km resolution.

University of Manchester researchers led by professor David Topping adapted NVIDIA's Earth-2 generative AI frameworks to forecast air pollution across the UK. Earth-2 CorrDiff was retrained in two days on a single eight-GPU node of Isambard-AI (5,448 GH200 Grace Hopper Superchips, 21 exaflops) using a year of hourly simulated pollution data, producing a UK-wide model at 2-3 square kilometer resolution. The team added Earth-2 StormCast for time-dependent forecasts that ingest real air quality observations, and demonstrated the workflow runs on the DGX Spark desktop AI system. Open-source training data and workflows are planned so other countries and cities can build similar pollution models.

NVIDIA Blog · 1d agoAI industry

AI for everyone in every language

Google says its AI now spans 300+ languages reaching 7 billion people, unveiling Gemini 3.5 Transcribe, Live Translate, and TranslateGemma models.

Google announced its technologies now support more than 300 languages spoken by 7 billion people, 86% of the global population. Gemini 3.5 Live Translate powers real-time spoken translation across 70 languages and 2,000+ language pairs, while Gemini 3.5 Transcribe is its most precise speech-to-text model. Its Universal Speech Model was trained on 12 million hours of audio using cross-lingual transfer learning, and TranslateGemma is a family of lightweight open translation models covering 55 languages that run on-device. Open-data partnerships include WAXAL covering 27 Sub-Saharan African languages and Project Vaani with 30,000+ hours of speech across 109 languages.

Google · AI · 1d agoAI industry