Rollout-Time Intervention: Unlocking Agentic Reinforcement Learning Beyond Policy Limits
Rollout-Time Intervention supplies off-policy successes so LLM agents learn beyond their current policy.
Stories per day · 30 days
5 stories, newest first · one card per story
Stories tagged #off-policy
RollVerify: Bridging Efficiency and Accuracy in Long-Tail Rollout Reinforcement Learning
RollVerify verifies and repairs partial RL rollouts so language models keep on-policy accuracy while cutting training cost.
On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics
Controlled distillation finds KL direction matters more than on-policy versus off-policy rollouts.
ReSPO: Reshaped Sequence Policy Optimization for Gradient Starvation in Off-Policy Learning
ReSPO replaces clipping in off-policy RL to fix gradient starvation on reused rollouts for Qwen3.
CARE-VI: Conservative Adaptive Reliability Estimation for Value Improvement in Off-Policy Actor-Critic Learning
CARE-VI introduces CARS, SEVA, and DARE components for reliability-aware value targets, achieving highest mean returns across twelve SAC, TD3, and TD7 settings.