Game Arena: Strategic LLM Evaluation in Competitive Environments
Kaggle Game Arena ranks LLMs through ongoing Chess, Poker, and Werewolf competitions instead of static benchmarks.
The report introduces Kaggle Game Arena, an open platform for evaluating LLMs through competitive games rather than static benchmarks. Its three pilot environments are Chess, Poker, and Werewolf, covering perfect-information, imperfect-information, and multiplayer settings. For each game it describes the environment, metrics, and results from full model competitions. The infrastructure is designed for reproducible, ground-truth evaluation and for adding new games over time.
47