THEATRON benchmark tests persona persistence in long LLM decisions
Four LLMs show persona-driven shifts that often fail to become stable, context-sensitive policies over multi-month financial trajectories.
Stories per day · 30 days
Relatedagent1behavioral-finance1benchmark1conditional-prediction1evaluation1fairness1llm-evaluation1optimization1persona1predict-then-optimize1pretraining1regret-bounds1vlm1
10 stories, newest first · one card per story
Stories tagged #decision-making
DPDM Improves Agent Decision Making via Shared Predictor
DPDM raises mean accuracy from 78.80% to 84.92% across 50 benchmarks using one frozen predictor.
Paper compares predict-then-optimize and generate-then-optimize decisions
Regret bounds show smoothness can offset generate-then-optimize's extra dimensions, while nonnegative-weight methods face a smoothness limit.
FairStress evaluates fairness in LLM decision-making
Only the Hugging Face blog title is available, so methods, models and findings are unknown.
TabWM predicts relational edits from observed executions
Across 512 held-out worlds, complete-edit F1 rose from 0.016 with no executions to 0.685 with 64.
Outperformance Inverse Optimization: Learning Objective Functions that Outperform Agent Decisions
Outperformance inverse optimization learns MILP objective weights that beat observed decisions on every component.
EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making
EVOKE uses goal diversity to elicit LLM agents' pretrained world knowledge for better transfer.
Overwhelmed by Choice: Studying LLM Decision Making at Scale
LLM accuracy falls as candidate sets grow, and hierarchical or permutation inference recovers about 20 points at N=160.
The Tasteful Agent: Measuring and Improving Taste in Long-Horizon Tasks
Researchers introduce Taste-Bench, a benchmark measuring LLM agents' ability to make good long-horizon decisions at critical decision forks.
DRG-MAPPO: Hierarchical Dynamic Role-Graph Multi-Agent Reinforcement Learning for Cooperative Air Combat
DRG-MAPPO combines graph-based relational modeling with dynamic role assignment in multi-agent RL, reaching an 87% win rate in cooperative air combat.