Theory says REINFORCE can collapse coverage in LM post-training
Resetting the KL reference in Approximate Policy Mirror Descent is shown to restore global convergence for stylized PPO and GRPO.
99 stories, newest first · one card per story
Resetting the KL reference in Approximate Policy Mirror Descent is shown to restore global convergence for stylized PPO and GRPO.
The method recasts FlowGRPO, AWM, DiffusionNFT, DiffusionOPSD and ReFL so rollouts no longer need a many-step sampler.

The startup's continual learning platform lets businesses retrain open-source AI models using user feedback for specialized tasks.
Internal expert rubrics report gains in safety, boundary compliance, output completeness, and scientific accuracy.
Reordering MiniWoB++ observation fields drops trained success from 85.0% to 19.2% without changing optimal decisions.

Across 14 models, post-training and verifiable-reward training pushed text further from human writing than base models.
Claude Code with Opus-5 raised equal-weighted generalization scores 9.2% relative, or 2.3 absolute points, over the starting models.
One checkpoint improves OVO-S-Bench, OST-Bench and UCS-Bench together, including a 13.41-point gain on OST-Bench.
The paper reports GPT-6 Astra closed a median 76% of the base-to-Instruct gap, and eight of ten models improved after a second stage.
The title says database grading is converted into reinforcement-learning rewards; the article body was not available.
MVR-4B averages 72.8 on 15 benchmarks, beating Qwen3.5-9B Instruct and MMFineReason-8B with about 70% fewer samples.
On LIBERO-PRO, a 9B planner rose from 18.1% to 71.0% success without external memory.
Papers included within 180 days stayed at 5 to 7 while quarterly cohorts grew from 72 to 386.
Across 10 open lineages, adjusted DPO still favored British and Australian spelling over AAE and Singlish.
Authors report a 72% to 81% relative attack-success drop versus Qwen3 1.7B, 4B, and 8B bases.
Market-based post-training lets decentralized agent swarms jointly learn actions and self-orchestration without a central coordinator.
Athanor agents autonomously post-trained Qwen3-4B-Base to match official Qwen3-4B-Instruct on held-out tasks.
Market-based post-training lets decentralized agent swarms learn both actions and self-orchestration.
CIPR trains LLM agents to stay consistent across renamed or notationally changed interfaces.
Authors report relative gains of up to 20.00% on VStar-Bench versus same-data SFT baselines.
Cowork-Gym post-trains Qwen agents on 64.9K synthetic workplaces, lifting six-benchmark scores.
SynthSelf lets small models continually post-train by outsourcing in-distribution rewrites to a slightly larger same-family aligner.
Activation-based value representations predict LLM alignment generalization far better than textual descriptions of values.
Three screens rank base models by likely coding-agent performance after expensive post-training.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views