ZeroHour

Search: “Kimi K3”

6 stories

[AINews] 10% worse, 100x cheaper, 10000x faster: Why Simulation is taking over

Latent Space argues AI training pipeline stages—rewards, data, teachers, curricula, environments—are flipping from human-made to model-made simulation.

Latent Space's AINews essay traces how each component of AI training has turned synthetic since 2022: reward models (InstructGPT, RLAIF), synthetic pretraining data (Microsoft Phi, NVIDIA Nemotron-4 340B), model teachers (Alpaca, DeepSeek-R1 distillation), and self-generated curricula (Self-Rewarding Language Models, SPIN). In 2026 it highlights Karpathy's autoresearch loop—700 experiments yielding 20 kept improvements, cutting GPT-2 training time from 2.02 to 1.80 hours—and Z.ai's GLM-5.3 fully synthetic RL environment, judging, and verification stack. It frames these shifts as 'simulation': 10% worse but 100x cheaper and 10,000x faster than human equivalents.

Latent Space · 26d agoAI industry

Exclusive: Paying for frontier AI models buys 4-month head start at 5x the cost

Mozilla report finds the capability gap between best open-weights (largely Chinese) and closed frontier AI models narrowed to 4.4 months at ~5x lower cost.

Mozilla's State of Open Source AI report (September 15) says the gap between closed frontier models and best open-weights models has closed to 4.4 months. Moonshot AI's Kimi K3 scores three points behind Anthropic's Fable 5 on the Artificial Analysis Intelligence Index at 30% of the cost, and Z.ai's GLM 5.2 scored within a point of Claude Opus 4.7 on Terminal-Bench 2.1. Eight of the top 10 OpenRouter models by August 2026 token volume provide open weights, though a Linux Foundation paper found open models earned only 4% of revenue. The report recommends open models as the default for routine workloads, reserving closed models for 8-12 hour expert tasks.

Ars Technica · AI · 2d agoAI industry1

Open-Source AI & Open Models Reading List

Interconnects publishes a curated open-model reading list covering release strategy, US-China competition, adoption data, and a narrowed 4-6 month open-closed frontier gap.

The list, updated September 11, 2026, compiles essays on open-model strategy, licensing gradients, safety of open weights, adoption data, and Chinese open-source history. It notes leading open models have come from Chinese labs since roughly 2024, citing Kimi K3 and GLM-5.2/5.3, and that the open-closed gap has narrowed to roughly 4-6 months. It also documents Western adoption of Chinese models, including Perplexity's use of DeepSeek R1 and Thomson Reuters moving to Qwen, which has drawn lawmaker probes at DoorDash, Airbnb, Anysphere/Cursor, and Apple.

Interconnectsupdated · 19h agofirst · 6d agoAI industry 20 sources1

[AINews] Hot Chips: OpenAI’s Jalapeño, Cerebras CS-5, Groq 3 LPX, Apple M6

OpenAI unveiled Jalapeno custom inference chip claiming 1.5-1.9x better perf-per-watt than NVIDIA GB200/GB300, deploying in-house by year-end.

At the 37th Hot Chips conference, OpenAI published first benchmark details for its custom Jalapeno inference chip, claiming 1.5-1.9x more work per watt, 1.7-3.6x lower end-to-end latency, and 2.1-4.1x higher interactive-workload performance versus NVIDIA GB200/GB300, with the 700W-rated part staying at or below 550W in tests. Deployment into OpenAI's own infrastructure begins by year-end, with Gen 2 deep in development and Gen 3 underway. OpenAI also said GPT-Astra and Codex helped write low-level kernels, reportedly 1.5-1.8x faster than human-expert code for selected attention and MoE blocks. Cerebras CS-5, Groq 3 LPX and Apple M6 were also featured at the conference.

Latent Space · 21d agoAI industry

[AINews] Poolside gets $12B reverse-execuhire to NVIDIA; founders stay for $1B, employees go for $6B, Infraco scaling to 7GW neocloud

NVIDIA struck a $12B deal with AI coding startup Poolside, licensing its Model Factory and hiring 109 of its technical employees.

NVIDIA spent roughly $12B in an unusual reverse-execuhire of Poolside, licensing the company's Model Factory while hiring 109 of its ~115 technical staff; founders retain a $1B stake and employees receive about $6B. Poolside had raced to raise $2B to fund a 40,000 GB300 cluster after missing a six-week funding window, and founders argue frontier-scale training now requires an order of magnitude more compute plus contracted data center space. An infrastructure arm spun out in January 2026 is scaling toward 7GW as a neocloud. The newsletter also recaps OpenAI and Anthropic agent-platform releases.

Latent Space · 27d agoAI industry

Kimi-maker Moonshot AI targets $2 billion in annual revenue

Moonshot AI targets $2 billion annualized revenue by year-end on K3 open-weight demand; Anthropic alleges Kimi routed ~300,000 requests to Claude Opus.

Bloomberg reported that Moonshot AI is targeting $2 billion in annualized revenue by the end of 2026, double its August run rate, driven by its open-weight K3 model. OpenRouter data shows up to 300 billion tokens generated per day by K3 models, though usage has slipped slightly in recent months. Moonshot's projection remains far below reported figures for OpenAI ($40B) and Anthropic ($65B), with lower margins due to freely available weights. Anthropic this week alleged Kimi routed nearly 300,000 requests to Claude Opus and collected more than 23 million responses for use in Moonshot's training.

TechCrunch · AI · 5d agoAI industry