Search: “Nemotron 3 Ultra”

6 stories

Open post-training pipeline turns Nemotron 3 Ultra checkpoints into an IMO 2026 gold-medal system, scoring 30/42 without formal provers or external tools.

Starting from Nemotron 3 Ultra, researchers trained two specialist checkpoints using supervised fine-tuning and reinforcement learning for natural-language olympiad proof generation. Three checkpoints power an iterative generate-verify-refine search plus a separate high-compute selection stage, operating entirely in natural language with no formal prover, external tools, or internet access. The system scored 30 of 42 points at IMO 2026, reaching the gold-medal threshold. The release includes the post-trained checkpoints, training data, training and inference code, submitted solutions, and Nemotron-IMO-Bench with 200 novel olympiad-level problems.

Hugging Face daily papersSep 8, 20:00 UTC · 8d agoModel release

IFM/K2-Horizon-MoVA-36B-A4B — new model trending #15 on Hugging Face

IFM released K2-Horizon-MoVA-36B-A4B, an open-weights 36B-parameter MoE model with 4B active parameters and native 512K context.

IFM released the final checkpoint of K2-Horizon-MoVA-36B-A4B, a sparse Mixture-of-Experts model using Mixture-of-Values (MoVA) attention with 36B total and 4B active parameters. The model supports native 524,288-token context and reportedly outscores open-weight dense and MoE models up to 15x its size on agentic and reasoning benchmarks, while competing against closed frontier models. Intermediate checkpoints, training data, the training recipe, and training code are slated for public release.

Hugging Face trending modelsSep 1, 23:01 UTC · 15d agoModel release

NVIDIA and CrowdStrike Strengthen Agentic Cybersecurity Frontier

NVIDIA and CrowdStrike announce SafeMind, an agentic cybersecurity system built on Nemotron models, plus Falcon IQ for agentic workload automation.

At CrowdStrike's Fal.Con 2026, NVIDIA and CrowdStrike announced SafeMind, an agentic cybersecurity system combining CrowdStrike's purpose-built frontier models and harnesses with NVIDIA Nemotron open models in a continuous red-versus-blue coevolution loop. A Blue Solano model post-trained on Nemotron 3 Super reportedly achieved higher accuracy than leading frontier models at 99% lower cost. CrowdStrike also introduced Falcon IQ, powered by Nemotron models in the Charlotte AI AgentWorks platform, coordinating more than 50 agents for automated defensive workflows. CrowdStrike cited an 89% year-over-year rise in AI-enabled attacks and a fastest eCrime breakout time of 27 seconds as context for agentic defense.

NVIDIA BlogSep 1, 21:19 UTC · 15d agoAI industry

Rethinking Heterogeneous System Disaggregation for Subquadratic Attention

SQD disaggregates LLM inference by quadratic versus subquadratic attention layers, improving energy efficiency up to 56% on heterogeneous systems versus GPU-only baselines.

SQD (SubQuadratic Disaggregation) splits decode not by operator type but by quadratic versus subquadratic attention, matching their distinct arithmetic intensity and memory footprints. For sparse attention LLMs it separates top-k selection (requiring full KV indexing) from top-k attention plus FFN; for linear and sliding-window models it separates dense attention layers from subquadratic layers plus FFN. On an adjusted 8xB200 heterogeneous proxy, tokens-per-joule improves 53% on GLM 5.2, 31% on Nemotron 3 Ultra, and 56% on Gemma 4 31B. A Rubin plus LPX analytical model shows 1.2x-1.5x tighter achievable latencies and up to 3.6x higher throughput versus attention-FFN disaggregation.

arXiv cs.AI / cs.LG / cs.CLSep 11, 17:55 UTC · 5d agoAI research

Nvidia and Palantir team up to run supply chains with AI, starting with Nvidia's own million-part operation

Nvidia and Palantir integrated open Nemotron models and cuOpt into Foundry to run AI-driven supply chains, starting with Nvidia's million-part operation.

Nvidia and Palantir announced a partnership to run supply chains with AI, first deployed on Nvidia's own network of millions of parts and thousands of suppliers; a single Vera Rubin rack contains 1.3 million components. Palantir is integrating open Nemotron models into its Foundry platform for customer fine-tuning, while Nvidia cuOpt handles scenario planning and optimization, with decisions fed back to improve models over time. The stack runs on customer hardware or in the cloud through the Sovereign AI OS reference architecture with infrastructure partners Dell, Cisco, Rackspace, and Nebius, with more details shown at AIPCon 11.

The DecoderSep 10, 12:23 UTC · 6d agoAI industry1

[AINews] Hot Chips: OpenAI’s Jalapeño, Cerebras CS-5, Groq 3 LPX, Apple M6

OpenAI unveiled Jalapeno custom inference chip claiming 1.5-1.9x better perf-per-watt than NVIDIA GB200/GB300, deploying in-house by year-end.

At the 37th Hot Chips conference, OpenAI published first benchmark details for its custom Jalapeno inference chip, claiming 1.5-1.9x more work per watt, 1.7-3.6x lower end-to-end latency, and 2.1-4.1x higher interactive-workload performance versus NVIDIA GB200/GB300, with the 700W-rated part staying at or below 550W in tests. Deployment into OpenAI's own infrastructure begins by year-end, with Gen 2 deep in development and Gen 3 underway. OpenAI also said GPT-Astra and Codex helped write low-level kernels, reportedly 1.5-1.8x faster than human-expert code for selected attention and MoE blocks. Cerebras CS-5, Groq 3 LPX and Apple M6 were also featured at the conference.

Latent SpaceAug 27, 01:31 UTC · 20d agoAI industry