Search: “NVIDIA TensorRT”

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

NVIDIA's Vera Rubin NVL72 debuts in MLPerf Inference v6.1 with up to 3.7x higher throughput than GB300 NVL72 and 99% scaling efficiency at 288 GPUs.

In its first MLPerf Inference preview submission, NVIDIA's Vera Rubin NVL72 achieved up to 3.7x higher throughput than GB300 NVL72 on Qwen3-VL and 2.5x on DeepSeek-R1. A 288-GPU GB300 NVL72 submission across four racks reached 99% scaling efficiency on the DeepSeek-R1 offline benchmark. Software optimizations delivered up to 1.6x gains over v6.0, leveraging TensorRT-LLM, vLLM, Dynamo, disaggregated serving, and NVFP4 precision.

NVIDIA Blog·15:00 UTC · 6h agoAI industry 2 sources

ZDI-26-592: NVIDIA TensorRT ONNX File Parsing Improper Validation of Array Index Remote Code Execution Vulnerability

NVIDIA TensorRT improper array index validation in ONNX parsing (CVE-2026-24238, CVSS 7.8) enables remote code execution.

ZDI-26-592 addresses improper validation of array index in NVIDIA TensorRT's ONNX file parsing, tracked as CVE-2026-24238 with CVSS 7.8. Exploitation permits remote code execution on affected installations and requires user interaction. The advisory was published by the Zero Day Initiative on August 24, 2026.

ZDI Published Advisories·Aug 24, 05:00 UTC · 23d agoAdvisoryCVE-2026-24238

ZDI-26-591: NVIDIA TensorRT ONNX File Parsing Heap-based Buffer Overflow Remote Code Execution Vulnerability

ZDI disclosed a heap-based buffer overflow RCE (CVE-2026-24272, CVSS 7.8) in NVIDIA TensorRT ONNX parsing, requiring user interaction to exploit.

The Zero Day Initiative published advisory ZDI-26-591 covering a heap-based buffer overflow in NVIDIA TensorRT's ONNX file parsing. Successful exploitation allows remote code execution when a user opens a malicious ONNX file or visits a crafted page. ZDI rated the vulnerability CVSS 7.8 and assigned CVE-2026-24272.

ZDI Published Advisories·Aug 24, 05:00 UTC · 23d agoAdvisoryCVE-2026-24272

ZDI-26-593: NVIDIA TensorRT ONNX File Parsing Heap-based Buffer Overflow Remote Code Execution Vulnerability

ZDI disclosed a second TensorRT heap-based buffer overflow RCE (CVE-2026-24268, CVSS 7.8) in ONNX file parsing, requiring user interaction.

The Zero Day Initiative published advisory ZDI-26-593 covering another heap-based buffer overflow in NVIDIA TensorRT's ONNX file parsing. A remote attacker can execute arbitrary code if the target opens a malicious file or visits a crafted page. ZDI rated the vulnerability CVSS 7.8 and assigned CVE-2026-24268.

ZDI Published Advisories·Aug 24, 05:00 UTC · 23d agoAdvisoryCVE-2026-24268

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

At AI Infra Summit, NVIDIA showcased Vera Rubin and DSX gains up to 1.4x tokens per megawatt, plus Annapurna, d-Matrix, and Pinterest partnerships.

Ian Buck's AI Infra Summit keynote before 8,000+ attendees emphasized validated agentic tokens per megawatt as the emerging AI infrastructure metric. Announcements include Amazon's Annapurna Labs collaborating on NVHBM custom high-bandwidth memory, d-Matrix integrating NVLink Fusion with Raptor XPUs, and Pinterest using Blackwell plus Dynamo inference software for conversational visual discovery. Lambda reported 23% better performance per watt with DSX MaxLPS on Blackwell servers, running 19 nodes on a 16-node power budget. NVIDIA says DSX MaxLPS combined with Groq 3 LPX on Vera Rubin NVL72 targets up to 35X token throughput per megawatt versus GB200 NVL72 for 2-trillion-plus-parameter models.

NVIDIA Blog·Sep 15, 16:55 UTC · 1d agoAI industry

Sparks Fly: NVIDIA Accelerates Local AI at IFA 2026

NVIDIA announces local AI push at IFA 2026 with faster llama.cpp/vLLM inference, PAIR routing tool, and October RTX Spark PCs.

At IFA 2026, NVIDIA announced simplified local AI support for agents in Hermes Agent, OpenClaw, and Perplexity Portable Computer, plus new llama.cpp and vLLM optimizations delivering up to 1.9x faster local inference. NVIDIA also unveiled PAIR, a Personal AI Router for distributing inference across a local network's PCs, and compact RTX Spark Windows PCs from Lenovo and Acer arriving in October. The post recaps recent local-capable model releases including Nemotron 3.5 Lightning (30B), Qwen3.8-Flash-Next and Qwen3.8-27B, DeepSeek v4 Flash (284B MoE, 13B active), Meta Muse Glimmer (30B), Z.ai GLM-5.3-Flash, LTX 2.5, and MiniMax-H3 with the FastH3 distilled variant.

NVIDIA Blog·Sep 3, 16:00 UTC · 13d agoAI industry

Skild AI Taps NVIDIA Physical AI to Teach Robots New Tasks From a Single Video

Skild AI launched its S1 robot foundation model, built on NVIDIA infrastructure, that learns long-horizon industrial tasks from a single video.

Skild AI's S1 model uses in-context learning from one video demonstration to execute unfamiliar multistep tasks lasting up to 10 minutes without weight updates or task-specific post-training. In tests on new tasks it achieved about 66% per-step success versus 9% for a comparable AI system, and one video demonstration was estimated to match roughly 380 hands-on training examples. The company reached a $100 million annual revenue run rate with more than 60 deployment partnerships, and with NVIDIA and Foxconn deploys the Skild Brain on dual-arm manipulators assembling NVIDIA Blackwell systems. Training and validation rely on NVIDIA Isaac Lab, Isaac Sim, Omniverse, Cosmos and the Newton physics engine.

NVIDIA Blog·Sep 10, 16:30 UTC · 6d agoModel release

NVIDIA Brings Real-Time AI to Broadcast, Sports and Global Streaming at IBC

NVIDIA expanded its AI for Media suite at IBC 2026, adding NIM microservices for synthetic video detection, body pose, frame generation, upscaling and HDR.

At IBC 2026 in Amsterdam, NVIDIA announced a major expansion of NVIDIA AI for Media, a collection of GPU-accelerated SDKs, NIM microservices and blueprints for broadcast and streaming workflows. The Synthetic Video Detector (SVD) NIM microservice reaches 99.3% accuracy on text-to-video and 97.7% on image-to-video content, while Video Frame Generation boosts frame rates 2x-4x and Video Super Resolution adds 10-bit support; TrueHDR converts SDR to HDR at up to roughly 2,000 nits. Partners including Dalet, TwelveLabs, Wowza, Vizrt and Ross Video are integrating the new services into verification, compliance and live-production workflows.

NVIDIA Blog·Sep 9, 16:00 UTC · 7d agoAI industry

NVIDIA Announces CUDA Rust with cuda-oxide (SIMT) and cutile-rs (Tile) for Compile-Time-Safe GPU Kernels

NVIDIA launches CUDA Rust via open-source cuda-oxide (SIMT) and cutile-rs (Tile), bringing compile-time-safe Rust GPU kernels.

NVIDIA announced CUDA Rust, making Rust a first-class language for GPU kernels through two NVlabs open-source projects: cuda-oxide for the SIMT model and cutile-rs for the Tile model. Both use Rust's ownership and borrow checker to catch buffer aliasing bugs at compile time. cutile-rs is published on crates.io, runs on stable Rust 1.89+ with CUDA 13.3, and is already used in Hugging Face's Grout inference engine and mistral.rs; cuda-oxide is early alpha requiring nightly Rust, CUDA 12.x, and compute capability 8.0+. cuda-oxide compiles Rust MIR through the community Pliron IR framework and LLVM to PTX, while cutile-rs JIT-compiles kernels via CUDA Tile IR.

MarkTechPost·Sep 8, 19:51 UTC · 8d agoAI tools & infra2

NVIDIA NVLink Fusion Expands With NVHBM Custom High-Bandwidth Memory

NVIDIA expands NVLink Fusion with NVHBM custom high-bandwidth memory for hyperscalers building trillion-parameter and agentic AI infrastructure.

NVIDIA announced that NVLink Fusion will expand to support NVHBM, a custom high-bandwidth memory option. The offering targets hyperscalers and AI innovators building next-generation systems where agentic AI and trillion-parameter workloads are mainstream. NVIDIA frames the announcement around co-designing compute, memory, storage, networking, and software as a unified system.

NVIDIA Blog·Aug 26, 21:05 UTC · 21d agoAI industry

NVIDIA security advisory (AV26-849)

Canada's Cyber Centre relayed NVIDIA security advisories covering vulnerabilities in NemoClaw, OpenShell, Unified Fabric Manager, and DGX Spark.

The Canadian Centre for Cyber Security issued bulletin AV26-849 flagging NVIDIA vulnerabilities across NemoClaw and OpenShell (multiple versions), NVIDIA Unified Fabric Manager (multiple versions and models), and DGX Spark (versions prior to 1.110.13). The advisory links to NVIDIA security bulletins and urges users and administrators to apply updates as they become available. No exploitation details or CVE identifiers are enumerated in the advisory text.

Canadian Centre for Cyber Security·Aug 26, 14:17 UTC · 21d agoAdvisory

Implementation of Machine Learning Workflows with NVIDIA cuML, RAPIDS, GPU Benchmarking, Explainability, Clustering, and Model Inference

Hands-on tutorial implements NVIDIA cuML and RAPIDS to GPU-accelerate scikit-learn-style ML workflows with benchmarking, clustering, and inference.

The tutorial demonstrates NVIDIA cuML as a GPU-accelerated machine learning framework, using cuml.accel to speed up unmodified scikit-learn scripts with zero code changes and the native cuML API for CuPy/cuDF interoperability. It benchmarks CPU versus GPU implementations of PCA, K-Means, nearest-neighbor search, logistic regression, random forests, and DBSCAN on datasets up to 200,000 samples with 64 features. It also builds GPU pipelines with UMAP, t-SNE, and HDBSCAN, validates GPU-generated SHAP explanations, uses the FIL library for forest inference, and covers model serialization and GPU/CPU portability.

MarkTechPost·Sep 13, 01:42 UTC · 3d agoAI tools & infra

Inside NVIDIA’s cuDNN Graph API: Fusion, Autotuning, and Plan Reuse with cuDNN Frontend

MarkTechPost tutorial walks through NVIDIA's cuDNN Frontend graph API, covering kernel fusion, autotuning, plan reuse, and CUDA graph capture on Colab GPUs.

The tutorial explains how to express GPU computations as operation graphs via the cuDNN Frontend graph API, running the five-step build pipeline of validate, build operation graph, create execution plans, check support, and build plans. It progresses from a single fused convolution with bias and ReLU to autotuning across engine configs, FP8-style epilogues, attention, plan serialization, dynamic shapes, and CUDA graph capture. Each kernel is benchmarked against a PyTorch reference on a single Colab GPU to verify correctness and measure cost. The piece also covers practical setup issues like making libcudnn.so visible to the frontend's dynamic loader.

MarkTechPost·Sep 15, 21:37 UTC · 1d agoAI tools & infra2

How NVIDIA scales expertise with ChatGPT Work

NVIDIA deploys OpenAI's ChatGPT Work internally to cut manual tasks and scale successful workflows across global teams.

OpenAI published a customer story describing how NVIDIA teams use ChatGPT Work in day-to-day operations. The company reportedly uses the product to reduce manual tasks, connect fast-moving signals, and replicate successful workflows globally. The piece functions as enterprise adoption marketing rather than a product or model release.

OpenAI News·Aug 18, 00:00 UTC · 29d agoAI industry

Arm Mali G2-Ultra NX GPU: desktop-class mobile gameplay with AI-native graphics

Arm unveiled Mali G2-Ultra NX, its first AI-native mobile GPU with in-shader neural acceleration, third-gen ray tracing, and up to 24% higher benchmark performance.

Arm announced the Mali G2-Ultra NX, the first AI-native Mali GPU, integrating neural accelerators directly into shader cores alongside a new execution engine and third-generation hardware ray tracing. It introduces Neural Super Sampling (NSS), Neural Frame Rate Upscaling (NFRU), and Neural Super Sampling and Denoising (NSSD); the Neural Dawn demo with Sumo Digital showed up to 4x performance efficiency and 70% lower external memory traffic versus native rendering. Arm claims up to 24% higher benchmark performance, 13% lower DRAM traffic on ray tracing benchmarks, and up to 120 FPS with NFRU. Over 14 billion Mali GPUs have shipped to date.

Hacker News · AI·Sep 8, 04:06 UTC · 8d agoAI industryHN 71↑ · 53 comments1

Miles v0.1: Production-Level Post-Training

Radix Ark open-sources Miles v0.1, a full-stack RL post-training framework demonstrated with asynchronous agentic RL on GLM-5.2 744B-A40B across 64 GB300 GPUs.

Miles v0.1 is a full-stack, open-source system for frontier-scale reinforcement-learning post-training, built on slime with rollout engines on SGLang and trainers supporting NVIDIA Megatron-LM and PyTorch FSDP backends plus three weight-synchronization transports. It supports full-parameter RL, LoRA RL, on-policy distillation, supervised fine-tuning, true-on-policy rollout-training alignment, and extends to diffusion models. The end-to-end case study ran fully asynchronous agentic RL on GLM-5.2 744B-A40B for terminal-use coding tasks on 64 NVIDIA GB300 GPUs with a median step time of 263 seconds over the first 30 measured steps. The code is open-sourced on GitHub.

Hugging Face daily papers·Sep 7, 20:00 UTC · 9d agoAI tools & infra

From Megawatts to Tokens: How NVIDIA Maximizes AI Factory Production

NVIDIA detailed DSX power-management results: Lambda gained 24% token throughput at fixed power, and an AI factory auto-shed 1MW via Emerald AI's grid program.

NVIDIA says Lambda's first validation of DSX MaxLPS on HGX B200 servers ran 19 nodes within a 16-node power budget, lifting cluster token throughput 24% (roughly 4M to 5M tokens/second) and improving performance per watt by 23%. NVIDIA projects DSX MaxLPS can enable up to 40% more GPU capacity for Vera Rubin NVL72 factories within the same megawatt budget. Emerald AI's Conductor platform, running at NVIDIA's Eos factory with Silicon Valley Power, responded to over 200 utility demand signals, automatically dropping power from 4MW to 3MW without interrupting priority workloads. The first dedicated DSX Flex commercial deployment is planned at a 96-megawatt Manassas, Virginia facility.

NVIDIA Blog·Sep 15, 16:55 UTC · 1d agoAI industry

Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents

NVIDIA claims Vera Rubin NVL72 delivers up to 30x more work per watt, citing OpenRouter data that agentic workloads use 15x more tokens than chat.

NVIDIA positions the Vera Rubin NVL72 as a new efficiency standard for AI agents, claiming up to 30x more work per watt. The company cites OpenRouter data showing agentic AI workloads consume 15x more tokens than a simple chat request, using a financial-research agent example that spawns sub-agents and multiple tool calls. The piece is largely a product efficiency narrative rather than independent benchmarking.

NVIDIA Blog·Aug 24, 15:00 UTC · 23d agoAI industry

NVIDIA Open-Sources OSMO: One YAML Orchestrates Physical AI Training, Simulation, and Robot Testing

NVIDIA open-sourced OSMO, a Kubernetes-native YAML orchestrator running physical-AI training, simulation, and robot testing across mixed GPU tiers.

OSMO (Apache-2.0, latest release 6.3.1) lets teams describe training, simulation, and hardware-in-the-loop pipelines in a single YAML and routes tasks across datacenter GPUs (GB200), workstation RTX hardware, and edge devices like Jetson AGX Thor. It ships Helm charts and containers on NGC, uses the KAI Scheduler with NVLink topology-aware placement, and includes RBAC, OAuth2, and TLS termination. NVIDIA says it is battle-tested on GR00T, Isaac Lab, Isaac Sim, and Isaac ROS, and integrates with Claude Code, OpenAI Codex, and Cursor agents.

MarkTechPost·Sep 14, 08:04 UTC · 2d agoAI tools & infra

Nvidia and Palantir team up to run supply chains with AI, starting with Nvidia's own million-part operation

Nvidia and Palantir integrated open Nemotron models and cuOpt into Foundry to run AI-driven supply chains, starting with Nvidia's million-part operation.

Nvidia and Palantir announced a partnership to run supply chains with AI, first deployed on Nvidia's own network of millions of parts and thousands of suppliers; a single Vera Rubin rack contains 1.3 million components. Palantir is integrating open Nemotron models into its Foundry platform for customer fine-tuning, while Nvidia cuOpt handles scenario planning and optimization, with decisions fed back to improve models over time. The stack runs on customer hardware or in the cloud through the Sovereign AI OS reference architecture with infrastructure partners Dell, Cisco, Rackspace, and Nebius, with more details shown at AIPCon 11.

The Decoder·Sep 10, 12:23 UTC · 6d agoAI industry1

University of Manchester Uses NVIDIA Earth-2 to Forecast Air Pollution Across the UK

University of Manchester retrained NVIDIA Earth-2 CorrDiff and StormCast on Isambard-AI to forecast UK air pollution at 2-3 km resolution.

University of Manchester researchers led by professor David Topping adapted NVIDIA's Earth-2 generative AI frameworks to forecast air pollution across the UK. Earth-2 CorrDiff was retrained in two days on a single eight-GPU node of Isambard-AI (5,448 GH200 Grace Hopper Superchips, 21 exaflops) using a year of hourly simulated pollution data, producing a UK-wide model at 2-3 square kilometer resolution. The team added Earth-2 StormCast for time-dependent forecasts that ingest real air quality observations, and demonstrated the workflow runs on the DGX Spark desktop AI system. Open-source training data and workflows are planned so other countries and cities can build similar pollution models.

NVIDIA Blog·05:00 UTC · 16h agoAI industry

SkillSpector: NVIDIA's open-source security scanner for AI agent skills

Help Net Security·Aug 3, 00:00 UTC · Aug 3, 2026Malware

Robots are waiting for a ChatGPT moment: Nvidia’s Les Karpas explains why at TechCrunch Disrupt 2026

NVIDIA Inception's Les Karpas will discuss at TechCrunch Disrupt 2026 why robotics lacks a ChatGPT moment, citing missing internet-scale physical AI datasets.

NVIDIA Inception's Global Head of Physical AI, Les Karpas, will speak on the Real World AI Stage at TechCrunch Disrupt 2026, held October 13-15 at San Francisco's Moscone West. His core argument is that general-purpose robots lack an internet-wide dataset for physical AI, unlike language models from OpenAI and Anthropic. Founders from Shield AI, Colossal Biosciences, FieldAI, and Foxglove will join related sessions.

TechCrunch · AI·15:00 UTC · 6h agoAI industry

How XPUs Meet a World-Class AI Factory

NVIDIA argues AI factories with custom XPUs and NVLink Fusion connectivity must optimize tokens-per-second, tokens-per-watt, cost and uptime.

NVIDIA published a blog explaining that AI factories running continuously are economically defined by delivered output: tokens per second, tokens per watt, cost per token, utilization and uptime. It argues hyperscalers and AI-native companies building custom XPUs need infrastructure designed as a complete factory rather than collections of individual accelerators. The piece promotes NVIDIA's NVLink Fusion and full-stack XPU connectivity as the foundation for such world-class AI factory builds.

NVIDIA Blog·Aug 24, 15:00 UTC · 23d agoAI industry

Chaotic Eclipse Released GreenSection, A PoC For NVIDIA Memory Corruption Zero-Day

Researcher Chaotic Eclipse released GreenSection, a PoC exploiting an unpatched out-of-bounds write in NVIDIA Windows user-mode shared memory.

Security researcher Chaotic Eclipse disclosed an out-of-bounds write in NVIDIA's Windows user-mode components, which share a global memory section (\BaseNamedObjects\{52813408-3561-4705-820a-2b3b78be92ba}) with full read/write access to all users. The PoC crashes applications running Vulkan or OpenGL; the researcher says the bug could cross user boundaries or compromise dwm.exe but did not fully assess the impact. No CVE has been assigned and no patch is mentioned. The researcher recently released zero-day PoCs against Kaspersky, Avast, and CrowdStrike Falcon.

Security Affairs·Sep 7, 13:42 UTC · 9d agoExploit / PoC 2 sources

Online Draft Co-Training for Speculative Decoding in Large-Scale, Long-Context RL Post-Training

NVIDIA researchers detail an end-to-end system for online draft co-training that speeds speculative decoding in large-scale long-context RL post-training.

The paper tackles scaling online draft co-training for speculative decoding in RL post-training, where rollout generation dominates cost. It extends packed, load-balanced zigzag ring attention to merge rank-local branch attention with causal main-sequence attention for context parallelism, and introduces TapChannel to transport target features across pipeline-parallel stages without changing the schedule. Experiments show co-trained drafts tracking the policy baseline with substantial rollout and end-to-end speedups up to 122B parameters and strong scaling at 256K tokens.

Hugging Face daily papers·Sep 6, 20:00 UTC · 10d agoAI research

NVIDIA AI Factory Compute Is Becoming an Investable Asset Class

NVIDIA partners with Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR to mobilize over $500 billion of third-party capital for AI infrastructure financing.

NVIDIA announced partnerships with major financial firms including Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR. The independent financing platforms are designed to mobilize more than $500 billion of third-party capital to support AI infrastructure buildout. NVIDIA frames the move as positioning AI factory compute as an investable asset class.

NVIDIA Blog·Aug 12, 00:38 UTC · Aug 12, 2026AI industry

Physical AI Takes the Wheel: How the World’s Robotaxi Leaders Are Building With NVIDIA Technologies

NVIDIA details a three-computer robotaxi platform that Uber, Lyft, May Mobility, Mercedes-Benz and others are adopting to scale autonomous fleets.

NVIDIA says every major commercial robotaxi program runs on its stack, spanning training (DGX with Alpamayo VLA models), simulation and validation (Omniverse, Cosmos, AlpaSim on RTX PRO), and in-vehicle compute (DRIVE Hyperion 10 with dual DRIVE AGX Thor chips). Adding meta-action and chain-of-thought reasoning data to a VLA model reduced minimum average displacement error by 43%, from 2.08 to 1.18. Uber plans NVIDIA DRIVE Hyperion-based fleets across 28 cities by 2028, partnering with Autobrains, Avride, Lucid, May Mobility, Mercedes-Benz, Momenta, Nissan, Nuro, Pony.ai, Stellantis, Waabi, Wayve, WeRide and Zoox. DRIVE Hyperion 10 combines 14 cameras, nine radars, three lidars and 12 ultrasonics with redundant compute and NVIDIA Halos safety validation.

NVIDIA Blog·Sep 10, 16:00 UTC · 6d agoAI industry

Leading Publishers Bring Blockbuster PC Games and Technology to NVIDIA RTX Spark

NVIDIA announces EA, Embark, and Ubisoft titles plus anti-cheat and visual upgrades for RTX Spark ahead of launch at Gamescom.

NVIDIA is promoting RTX Spark at Gamescom in Cologne, Germany, with Electronic Arts, Embark, and Ubisoft bringing blockbuster PC titles to the platform ahead of its launch. The announcement covers new game support, anti-cheat technologies, and increased visual quality. The piece is a product-marketing update rather than security research or AI safety news.

NVIDIA Blog·Aug 25, 15:30 UTC · 22d agoAI industry