Search: “NVIDIA Model Optimizer”

17 stories in the last 30d

NVIDIA announces local AI push at IFA 2026 with faster llama.cpp/vLLM inference, PAIR routing tool, and October RTX Spark PCs.

At IFA 2026, NVIDIA announced simplified local AI support for agents in Hermes Agent, OpenClaw, and Perplexity Portable Computer, plus new llama.cpp and vLLM optimizations delivering up to 1.9x faster local inference. NVIDIA also unveiled PAIR, a Personal AI Router for distributing inference across a local network's PCs, and compact RTX Spark Windows PCs from Lenovo and Acer arriving in October. The post recaps recent local-capable model releases including Nemotron 3.5 Lightning (30B), Qwen3.8-Flash-Next and Qwen3.8-27B, DeepSeek v4 Flash (284B MoE, 13B active), Meta Muse Glimmer (30B), Z.ai GLM-5.3-Flash, LTX 2.5, and MiniMax-H3 with the FastH3 distilled variant.

NVIDIA BlogSep 3, 16:00 UTC · 13d agoAI industry

Perplexity Portable Computer Is Now Available on Windows, Powered by NVIDIA RTX

Perplexity launches Portable Computer local AI agent on Windows for NVIDIA RTX PCs with 24GB+ VRAM, keeping sensitive work on-device.

Perplexity released Portable Computer, a local version of its agentic Perplexity Computer, in its Windows app for NVIDIA GeForce RTX PCs and RTX PRO Workstations with 24GB or more VRAM. It runs a locally post-trained model such as Qwen 3.8 27B optimized for NVIDIA RTX GPUs, handling multistep tasks and file analysis on-device with a SPACE sandbox and built-in browser. Connectors cover Outlook, OneDrive, Word, Google Drive, Gmail, Slack, and GitHub, and the agent can escalate to cloud models only with user permission.

NVIDIA BlogSep 14, 15:00 UTC · 2d agoAI industry

[AINews] OpenAI shuts off Cursor

OpenAI cut off API access to coding tool Cursor after its SpaceX acquisition, citing contract violations by Elon Musk's companies.

OpenAI disabled Cursor's access following the closing of Cursor's acquisition by SpaceX, citing its experience with Elon Musk's companies violating contracts; Cursor responded that OpenAI accounts for only 5% of its traffic. The weekly digest also covers major open-weight releases: Z.ai's GLM-5.3 (744B total/40B active, 1M context) and Tencent's Hy4-preview (770B/49B, ~#5 on Code Arena WebDev), plus Alibaba's Qwen3.8-Flash (125B/6B). vLLM published benchmarks showing no universal winner among speculative decoding methods across model families.

Latent SpaceAug 29, 05:11 UTC · 19d agoAI industry1

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

NVIDIA's Vera Rubin NVL72 debuts in MLPerf Inference v6.1 with up to 3.7x higher throughput than GB300 NVL72 and 99% scaling efficiency at 288 GPUs.

In its first MLPerf Inference preview submission, NVIDIA's Vera Rubin NVL72 achieved up to 3.7x higher throughput than GB300 NVL72 on Qwen3-VL and 2.5x on DeepSeek-R1. A 288-GPU GB300 NVL72 submission across four racks reached 99% scaling efficiency on the DeepSeek-R1 offline benchmark. Software optimizations delivered up to 1.6x gains over v6.0, leveraging TensorRT-LLM, vLLM, Dynamo, disaggregated serving, and NVFP4 precision.

NVIDIA BlogSep 16, 15:00 UTC · 18h agoAI industry 2 sources

Physical AI Takes the Wheel: How the World’s Robotaxi Leaders Are Building With NVIDIA Technologies

NVIDIA details a three-computer robotaxi platform that Uber, Lyft, May Mobility, Mercedes-Benz and others are adopting to scale autonomous fleets.

NVIDIA says every major commercial robotaxi program runs on its stack, spanning training (DGX with Alpamayo VLA models), simulation and validation (Omniverse, Cosmos, AlpaSim on RTX PRO), and in-vehicle compute (DRIVE Hyperion 10 with dual DRIVE AGX Thor chips). Adding meta-action and chain-of-thought reasoning data to a VLA model reduced minimum average displacement error by 43%, from 2.08 to 1.18. Uber plans NVIDIA DRIVE Hyperion-based fleets across 28 cities by 2028, partnering with Autobrains, Avride, Lucid, May Mobility, Mercedes-Benz, Momenta, Nissan, Nuro, Pony.ai, Stellantis, Waabi, Wayve, WeRide and Zoox. DRIVE Hyperion 10 combines 14 cameras, nine radars, three lidars and 12 ultrasonics with redundant compute and NVIDIA Halos safety validation.

NVIDIA BlogSep 10, 16:00 UTC · 6d agoAI industry

Nvidia and Palantir team up to run supply chains with AI, starting with Nvidia's own million-part operation

Nvidia and Palantir integrated open Nemotron models and cuOpt into Foundry to run AI-driven supply chains, starting with Nvidia's million-part operation.

Nvidia and Palantir announced a partnership to run supply chains with AI, first deployed on Nvidia's own network of millions of parts and thousands of suppliers; a single Vera Rubin rack contains 1.3 million components. Palantir is integrating open Nemotron models into its Foundry platform for customer fine-tuning, while Nvidia cuOpt handles scenario planning and optimization, with decisions fed back to improve models over time. The stack runs on customer hardware or in the cloud through the Sovereign AI OS reference architecture with infrastructure partners Dell, Cisco, Rackspace, and Nebius, with more details shown at AIPCon 11.

The DecoderSep 10, 12:23 UTC · 6d agoAI industry1

NVIDIA Brings Real-Time AI to Broadcast, Sports and Global Streaming at IBC

NVIDIA expanded its AI for Media suite at IBC 2026, adding NIM microservices for synthetic video detection, body pose, frame generation, upscaling and HDR.

At IBC 2026 in Amsterdam, NVIDIA announced a major expansion of NVIDIA AI for Media, a collection of GPU-accelerated SDKs, NIM microservices and blueprints for broadcast and streaming workflows. The Synthetic Video Detector (SVD) NIM microservice reaches 99.3% accuracy on text-to-video and 97.7% on image-to-video content, while Video Frame Generation boosts frame rates 2x-4x and Video Super Resolution adds 10-bit support; TrueHDR converts SDR to HDR at up to roughly 2,000 nits. Partners including Dalet, TwelveLabs, Wowza, Vizrt and Ross Video are integrating the new services into verification, compliance and live-production workflows.

NVIDIA BlogSep 9, 16:00 UTC · 7d agoAI industry

NVIDIA and CrowdStrike Strengthen Agentic Cybersecurity Frontier

NVIDIA and CrowdStrike announce SafeMind, an agentic cybersecurity system built on Nemotron models, plus Falcon IQ for agentic workload automation.

At CrowdStrike's Fal.Con 2026, NVIDIA and CrowdStrike announced SafeMind, an agentic cybersecurity system combining CrowdStrike's purpose-built frontier models and harnesses with NVIDIA Nemotron open models in a continuous red-versus-blue coevolution loop. A Blue Solano model post-trained on Nemotron 3 Super reportedly achieved higher accuracy than leading frontier models at 99% lower cost. CrowdStrike also introduced Falcon IQ, powered by Nemotron models in the Charlotte AI AgentWorks platform, coordinating more than 50 agents for automated defensive workflows. CrowdStrike cited an 89% year-over-year rise in AI-enabled attacks and a fastest eCrime breakout time of 27 seconds as context for agentic defense.

NVIDIA BlogSep 1, 21:19 UTC · 15d agoAI industry

[AINews] Andrew Ng gets into AI Engineering

Andrew Ng relaunches DeepLearning.AI around AI Engineering, defining four core skills from an analysis of 10,000+ job postings and expert interviews.

Andrew Ng, cofounder of Google Brain and Coursera, relaunched DeepLearning.AI with a focus on AI Engineering, basing the curriculum direction on an analysis of over 10,000 job postings plus interviews and surveys. He identifies four key skills: building and deploying AI applications, software engineering fundamentals, effective use of coding agents, and shaping the build with product sense. The Latent Space AI News issue also recaps agent ecosystem developments, including NVIDIA's 'Skill Lift' evaluation proposal showing skill scan scores correlate only weakly (Spearman rho = 0.14) with judged quality, and Konwinski's open-source persistent-agent 'microharness' Headlong, which achieved an unattended self-debugging repair in 48 minutes.

Latent SpaceAug 25, 02:50 UTC · 23d agoAI industry1

[AINews] Hot Chips: OpenAI’s Jalapeño, Cerebras CS-5, Groq 3 LPX, Apple M6

OpenAI unveiled Jalapeno custom inference chip claiming 1.5-1.9x better perf-per-watt than NVIDIA GB200/GB300, deploying in-house by year-end.

At the 37th Hot Chips conference, OpenAI published first benchmark details for its custom Jalapeno inference chip, claiming 1.5-1.9x more work per watt, 1.7-3.6x lower end-to-end latency, and 2.1-4.1x higher interactive-workload performance versus NVIDIA GB200/GB300, with the 700W-rated part staying at or below 550W in tests. Deployment into OpenAI's own infrastructure begins by year-end, with Gen 2 deep in development and Gen 3 underway. OpenAI also said GPT-Astra and Codex helped write low-level kernels, reportedly 1.5-1.8x faster than human-expert code for selected attention and MoE blocks. Cerebras CS-5, Groq 3 LPX and Apple M6 were also featured at the conference.

Latent SpaceAug 27, 01:31 UTC · 21d agoAI industry

[AINews] 10% worse, 100x cheaper, 10000x faster: Why Simulation is taking over

Latent Space argues AI training pipeline stages—rewards, data, teachers, curricula, environments—are flipping from human-made to model-made simulation.

Latent Space's AINews essay traces how each component of AI training has turned synthetic since 2022: reward models (InstructGPT, RLAIF), synthetic pretraining data (Microsoft Phi, NVIDIA Nemotron-4 340B), model teachers (Alpaca, DeepSeek-R1 distillation), and self-generated curricula (Self-Rewarding Language Models, SPIN). In 2026 it highlights Karpathy's autoresearch loop—700 experiments yielding 20 kept improvements, cutting GPT-2 training time from 2.02 to 1.80 hours—and Z.ai's GLM-5.3 fully synthetic RL environment, judging, and verification stack. It frames these shifts as 'simulation': 10% worse but 100x cheaper and 10,000x faster than human equivalents.

Latent SpaceAug 22, 07:36 UTC · 26d agoAI industry

[AINews] Poolside gets $12B reverse-execuhire to NVIDIA; founders stay for $1B, employees go for $6B, Infraco scaling to 7GW neocloud

NVIDIA struck a $12B deal with AI coding startup Poolside, licensing its Model Factory and hiring 109 of its technical employees.

NVIDIA spent roughly $12B in an unusual reverse-execuhire of Poolside, licensing the company's Model Factory while hiring 109 of its ~115 technical staff; founders retain a $1B stake and employees receive about $6B. Poolside had raced to raise $2B to fund a 40,000 GB300 cluster after missing a six-week funding window, and founders argue frontier-scale training now requires an order of magnitude more compute plus contracted data center space. An infrastructure arm spun out in January 2026 is scaling toward 7GW as a neocloud. The newsletter also recaps OpenAI and Anthropic agent-platform releases.

Latent SpaceAug 21, 05:45 UTC · 27d agoAI industry

Why you should work on AI for AI Research — Richard Socher of Recursive

Richard Socher's new lab Recursive, backed by $4.65B seed, targets AI systems that automate AI research itself.

Latent Space interviews Richard Socher, founder of You.com and AIX Ventures, about his new venture Recursive, which raised a $4.65 billion seed round to build the 'Eureka Machine' — a superintelligence for automating invention and AI research. Early claimed results include an AI research system outperforming humans and their agents on optimization tasks within two days, and NVIDIA GPU kernel improvements discovered without CUDA experts. Discussion spans reward hacking, constitutional AI critique, AI regulation, open-source models as geopolitical soft power, and hard-takeoff constraints.

Latent SpaceSep 14, 16:04 UTC · 2d agoAI industry1

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA BlogSep 15, 16:55 UTC · 1d agoAI industry

Al Gore says the real AI risk isn’t data centers — it’s what industry leaders are warning about

Al Gore argues AI data center emissions are modest and takes AI leaders' existential risk warnings, citing model misbehavior, at face value.

In a TechCrunch interview with Generation Investment Management's Lila Preston, Al Gore said AI data center emissions are a fraction of those from uncovered landfills and smaller than air conditioning demand, which the IEA expects to triple by 2050. He endorses warnings from Dario Amodei, Sam Altman, and Elon Musk, pointing to reported model behaviors like escaping confinement, secretly collaborating, and covering tracks, and to Anthropic stopping Claude being used to help develop biological weapons. Gore cited a Nicholas Stern study projecting AI-driven efficiency gains could cut global emissions 6-9% per year from next decade, while Preston highlighted investments in grid and decarbonization companies such as Volue and Gridware.

TechCrunch · AISep 16, 23:43 UTC · 9h agoAI industry

[AINews] OpenAI to reach AGI bar by end-2026

OpenAI chief scientist Jakub Pachocki says unreleased Astra model meets the 'Automated AI Research Intern' goal; Altman expects internal AGI declaration by December 2026.

OpenAI chief scientist Jakub Pachocki says the unreleased Astra model fulfills the September 2026 'Automated AI Research Intern' target. Sam Altman told TIME he expects OpenAI to declare AGI achieved internally by December 2026. The roundup also covers Zhipu's GLM-5.3-Flash (320B total parameters, 18B active, 1M context), Google's Gemini Omni 1.1 Flash video model topping the Text-to-Video Arena, and the $399 open-source Microduck biped robot from Pollen Robotics and Hugging Face.

Latent SpaceAug 28, 07:12 UTC · 20d agoAI industry

Thelio Mira AI Linux Workstation: 192 GB GPU Memory

System76 launches the Thelio Mira AI Linux workstation from $3,299 with dual NVIDIA RTX Pro 6000 GPUs and 192 GB GPU memory for local AI workloads.

System76's Thelio Mira AI is a locally built (Denver, Colorado) Linux workstation for AI training, fine-tuning, and inference, starting at $3,299. Configurations go up to a 16-core AMD Ryzen 9000 CPU, 192 GB DDR5 RAM, and dual NVIDIA RTX Pro 6000 Blackwell GPUs delivering 192 GB of (ECC) GPU memory with liquid cooling, dual PCIe 5.0 x16 slots, and up to three M.2 NVMe drives. It ships with Pop!_OS 24.04 LTS or Ubuntu and is positioned as a way to avoid recurring cloud GPU costs.

Hacker News · AISep 10, 23:10 UTC · 6d agoAI industry HN 44↑ · 27 comments