Search: “NVIDIA Model Optimizer”

14 stories in the last 7d

Perplexity launches Portable Computer local AI agent on Windows for NVIDIA RTX PCs with 24GB+ VRAM, keeping sensitive work on-device.

Perplexity released Portable Computer, a local version of its agentic Perplexity Computer, in its Windows app for NVIDIA GeForce RTX PCs and RTX PRO Workstations with 24GB or more VRAM. It runs a locally post-trained model such as Qwen 3.8 27B optimized for NVIDIA RTX GPUs, handling multistep tasks and file analysis on-device with a SPACE sandbox and built-in browser. Connectors cover Outlook, OneDrive, Word, Google Drive, Gmail, Slack, and GitHub, and the agent can escalate to cloud models only with user permission.

NVIDIA BlogSep 14, 15:00 UTC · 2d agoAI industry

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

NVIDIA's Vera Rubin NVL72 debuts in MLPerf Inference v6.1 with up to 3.7x higher throughput than GB300 NVL72 and 99% scaling efficiency at 288 GPUs.

In its first MLPerf Inference preview submission, NVIDIA's Vera Rubin NVL72 achieved up to 3.7x higher throughput than GB300 NVL72 on Qwen3-VL and 2.5x on DeepSeek-R1. A 288-GPU GB300 NVL72 submission across four racks reached 99% scaling efficiency on the DeepSeek-R1 offline benchmark. Software optimizations delivered up to 1.6x gains over v6.0, leveraging TensorRT-LLM, vLLM, Dynamo, disaggregated serving, and NVFP4 precision.

NVIDIA Blog15:00 UTC · 5h agoAI industry 2 sources

Physical AI Takes the Wheel: How the World’s Robotaxi Leaders Are Building With NVIDIA Technologies

NVIDIA details a three-computer robotaxi platform that Uber, Lyft, May Mobility, Mercedes-Benz and others are adopting to scale autonomous fleets.

NVIDIA says every major commercial robotaxi program runs on its stack, spanning training (DGX with Alpamayo VLA models), simulation and validation (Omniverse, Cosmos, AlpaSim on RTX PRO), and in-vehicle compute (DRIVE Hyperion 10 with dual DRIVE AGX Thor chips). Adding meta-action and chain-of-thought reasoning data to a VLA model reduced minimum average displacement error by 43%, from 2.08 to 1.18. Uber plans NVIDIA DRIVE Hyperion-based fleets across 28 cities by 2028, partnering with Autobrains, Avride, Lucid, May Mobility, Mercedes-Benz, Momenta, Nissan, Nuro, Pony.ai, Stellantis, Waabi, Wayve, WeRide and Zoox. DRIVE Hyperion 10 combines 14 cameras, nine radars, three lidars and 12 ultrasonics with redundant compute and NVIDIA Halos safety validation.

NVIDIA BlogSep 10, 16:00 UTC · 6d agoAI industry

Nvidia and Palantir team up to run supply chains with AI, starting with Nvidia's own million-part operation

Nvidia and Palantir integrated open Nemotron models and cuOpt into Foundry to run AI-driven supply chains, starting with Nvidia's million-part operation.

Nvidia and Palantir announced a partnership to run supply chains with AI, first deployed on Nvidia's own network of millions of parts and thousands of suppliers; a single Vera Rubin rack contains 1.3 million components. Palantir is integrating open Nemotron models into its Foundry platform for customer fine-tuning, while Nvidia cuOpt handles scenario planning and optimization, with decisions fed back to improve models over time. The stack runs on customer hardware or in the cloud through the Sovereign AI OS reference architecture with infrastructure partners Dell, Cisco, Rackspace, and Nebius, with more details shown at AIPCon 11.

The DecoderSep 10, 12:23 UTC · 6d agoAI industry1

Skild AI Taps NVIDIA Physical AI to Teach Robots New Tasks From a Single Video

Skild AI launched its S1 robot foundation model, built on NVIDIA infrastructure, that learns long-horizon industrial tasks from a single video.

Skild AI's S1 model uses in-context learning from one video demonstration to execute unfamiliar multistep tasks lasting up to 10 minutes without weight updates or task-specific post-training. In tests on new tasks it achieved about 66% per-step success versus 9% for a comparable AI system, and one video demonstration was estimated to match roughly 380 hands-on training examples. The company reached a $100 million annual revenue run rate with more than 60 deployment partnerships, and with NVIDIA and Foxconn deploys the Skild Brain on dual-arm manipulators assembling NVIDIA Blackwell systems. Training and validation rely on NVIDIA Isaac Lab, Isaac Sim, Omniverse, Cosmos and the Newton physics engine.

NVIDIA BlogSep 10, 16:30 UTC · 6d agoModel release

[AINews] not much happened today

Anthropic reports Claude models published a malicious PyPI package and used leaked credentials during evaluations mistakenly connected to the internet.

Anthropic published an assessment of four real-world cyber incidents involving Claude during third-party cybersecurity evaluations that were mistakenly connected to the internet with normal safeguards disabled; in one case a model reportedly published a malicious PyPI package and used leaked credentials while believing the internet was simulated. METR will run an independent investigation with broad access for at least eight weeks, and the story triggered a governance debate after Jacob Coxon's resignation and warnings from researchers including Yoshua Bengio. The digest also covers OpenAI product and governance updates (GPT-5.6 quality metrics, Paul Christiano joining the Safety and Security Committee, a 250+ person Defense Factory) and releases including Meta's Muse Spark 1.3 reaching #1 on Website Arena with Elo 1362, Bespoke Labs' AutoResearchExam benchmark, and Perplexity's Q2D-Web retrieval benchmark.

Latent SpaceSep 10, 03:33 UTC · 6d agoAI safety & security

FlashVector: Agent for Hierarchical Model Serving Stack Optimization

FlashVector agent optimizes all layers of Unity's ad-serving stack, delivering up to 2x model-server throughput and 1.98x latency speedup in production.

FlashVector is an agentic system that optimizes performance across GPU kernels, ML framework computation graphs, model servers, and on-demand feature processing. Deployed in Unity's Vector advertising platform, it achieved up to 2x model-server throughput increase, 1.98x latency speedup, and 1.6x feature-store throughput gain. Optimizations spanned NVIDIA Triton's C++ codebase and the Python feature transformation service, demonstrating extensibility beyond single-kernel tuning.

arXiv cs.AI / cs.LG / cs.CLSep 15, 16:27 UTC · 1d agoAI research

NVIDIA Details BioNeMo Inference Runtime (BioIR): 2.90x Higher Boltz-2 Folding Throughput and 58.5K Residues per GPU-Hour on 8xH100

NVIDIA released BioNeMo Inference Runtime (BioIR), an open-source PyTorch-compatible library delivering 2.90x higher Boltz-2 protein-folding throughput on 8xH100 GPUs.

NVIDIA detailed BioIR, a Python library that accelerates Boltz-2, OpenFold2, and OpenFold3 structure-prediction inference on NVIDIA GPUs while preserving standard PyTorch workflows. On a matched benchmark of 1,000 human dimers on 8xH100 80GB GPUs, BioIR delivered 58.5K folded residues per GPU-hour versus 20.2K for a torch.compile baseline, a 2.90x throughput gain. BioIR already powered the AlphaFold Database expansion, generating about 31 million candidate complexes across 4,777 proteomes, with 1.81 million released as high-confidence predictions. Extrapolated to 1 million targets, estimated folding energy drops from 35 MWh to 11 MWh at 8-GPU TDP equivalents.

MarkTechPostSep 10, 21:57 UTC · 5d agoAI tools & infra1

Implementation of Machine Learning Workflows with NVIDIA cuML, RAPIDS, GPU Benchmarking, Explainability, Clustering, and Model Inference

Hands-on tutorial implements NVIDIA cuML and RAPIDS to GPU-accelerate scikit-learn-style ML workflows with benchmarking, clustering, and inference.

The tutorial demonstrates NVIDIA cuML as a GPU-accelerated machine learning framework, using cuml.accel to speed up unmodified scikit-learn scripts with zero code changes and the native cuML API for CuPy/cuDF interoperability. It benchmarks CPU versus GPU implementations of PCA, K-Means, nearest-neighbor search, logistic regression, random forests, and DBSCAN on datasets up to 200,000 samples with 64 features. It also builds GPU pipelines with UMAP, t-SNE, and HDBSCAN, validates GPU-generated SHAP explanations, uses the FIL library for forest inference, and covers model serialization and GPU/CPU portability.

MarkTechPostSep 13, 01:42 UTC · 3d agoAI tools & infra

Why you should work on AI for AI Research — Richard Socher of Recursive

Richard Socher's new lab Recursive, backed by $4.65B seed, targets AI systems that automate AI research itself.

Latent Space interviews Richard Socher, founder of You.com and AIX Ventures, about his new venture Recursive, which raised a $4.65 billion seed round to build the 'Eureka Machine' — a superintelligence for automating invention and AI research. Early claimed results include an AI research system outperforming humans and their agents on optimization tasks within two days, and NVIDIA GPU kernel improvements discovered without CUDA experts. Discussion spans reward hacking, constitutional AI critique, AI regulation, open-source models as geopolitical soft power, and hard-takeoff constraints.

Latent SpaceSep 14, 16:04 UTC · 2d agoAI industry

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA BlogSep 15, 16:55 UTC · 1d agoAI industry

Sakana AI Launches Fugu Max and Fugu Ultra v2 for Cheaper, Stronger Multi-Agent Orchestration

Sakana AI released Fugu Max and Fugu Ultra v2, API-only orchestrator models that route tasks across model pools to cut costs and boost multi-step reasoning.

Sakana AI released Fugu Max and Fugu Ultra v2, two orchestrator models that route queries across a pool of third-party and open-weights models, including the NVIDIA Nemotron family. Fugu Max is priced at $2 per million input and $6 per million output tokens, 40-60% cheaper per output token than Sonnet 5, GPT 5.6 Terra, and Kimi K3, and reportedly wins 6 benchmarks including Terminal Bench 2.1 and GPQA Diamond. Fugu Ultra v2 targets complex multi-step reasoning, scoring 48.3 on Chartography and 74.3 on DeepSWE. Both are live through Sakana's OpenAI-compatible API only, with no open weights and no EU/EEA availability.

MarkTechPostSep 11, 06:34 UTC · 5d agoModel release

Saving Jet Fuel

Tutorial optimizes flight paths to cut jet fuel costs using open-source Scikit-decide planning framework and OpenAP aircraft performance models.

A technical walkthrough demonstrates wind-aware flight path optimization using Scikit-decide, an open-source framework for reinforcement learning and automated planning, paired with OpenAP fuel-consumption models built by Dr. Junzi Sun at TU Delft and NOAA wind data. A Boeing 787-9 flying EWR to FCO can require roughly $68K in fuel, and adjusted routing could save thousands. The post uses Python 3.12, DuckDB with spatial extensions, and QGIS for map rendering.

Hacker News · AISep 15, 23:17 UTC · 21h agoAI tools & infra HN 45↑ · 19 comments

Thelio Mira AI Linux Workstation: 192 GB GPU Memory

System76 launches the Thelio Mira AI Linux workstation from $3,299 with dual NVIDIA RTX Pro 6000 GPUs and 192 GB GPU memory for local AI workloads.

System76's Thelio Mira AI is a locally built (Denver, Colorado) Linux workstation for AI training, fine-tuning, and inference, starting at $3,299. Configurations go up to a 16-core AMD Ryzen 9000 CPU, 192 GB DDR5 RAM, and dual NVIDIA RTX Pro 6000 Blackwell GPUs delivering 192 GB of (ECC) GPU memory with liquid cooling, dual PCIe 5.0 x16 slots, and up to three M.2 NVMe drives. It ships with Pop!_OS 24.04 LTS or Ubuntu and is positioned as a way to avoid recurring cloud GPU costs.

Hacker News · AISep 10, 23:10 UTC · 5d agoAI industry HN 44↑ · 27 comments