Paper bounds bandit regret when delayed rewards omit the round
Balanced Historical Optimism controls delay cost without optimal-arm reports; minimax regret is linear at c=1.
10 stories, newest first · one card per story
Balanced Historical Optimism controls delay cost without optimal-arm reports; minimax regret is linear at c=1.
For K actions in d dimensions it reaches Õ(√(dT log K)+dC) regret and settles the compact-set rate.
Regret bounds show smoothness can offset generate-then-optimize's extra dimensions, while nonnegative-weight methods face a smoothness limit.
For constant privacy and oblivious inputs, the bound matches the non-private lower bound up to polylog factors.
PC-LinUCB keeps a small persistent action set so linear bandits avoid scoring every arm each round.
A parameter-free Follow-The-Perturbed-Leader method gets near-optimal agnostic smoothed online regret without knowing the base measure.
A rare-switching bandit algorithm keeps exact sliding-window feasibility with near-optimal regret.
The paper proves matching minimax regret bounds for causal logistic bandits under counterfactual fairness.
The paper proves minimax-optimal regret of order T^(m/(m+1)) for repeated online contract design with unrestricted bounded contracts and arbitrary agent action spaces.
Theorists prove multi-step lookahead RL planning is NP-hard for every fixed rational discount factor yet give a randomized polynomial-time approximation scheme.
Today 1.6K readers · 2.5K views · 777 reads · all time 189K views