Calibration as a First-Class Criterion in LLM Evaluation
MTVA-Bench: Evaluating the Language Model Inside Cascaded Voice Agents
HarnessTax: How Much Does the Harness Matter for Coding Agents?
Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluations
1
How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards
Structured Claim-Level Discourse Representations for Dense Health Narratives
Verifiable Social Reasoning for LLM Assistants
GPT-5.6 Luna vs. GPT-6 Astra: Is a $1.20 Model Good Enough for Code Review?
9 min
Before You Poll with LLMs: A Deliberative Diagnostic Framework
AWS puts AI vulnerability detection to the test, and false positives pile up
4 min
Anchoring Clinical Events in Time: UID-Preserving Multimodal Reconstruction and Source-Grounded Adjudication
1
Beyond Solver Verdicts: Generative Reward Models for Autoformalization
1
Benchmark Radar: A Living Database and Search Engine for AI Benchmarks and Evaluation
IdeaAMBIG: Benchmarking Implementation-Critical Gaps in Research-Idea Specifications
2
RESCUE-BENCH: Towards Relation-Aware Multi-Party Emotional Support Conversation Systems
IdeaAMBIG: Benchmarking Implementation-Critical Gaps in Research-Idea Specifications
MetroLLM-Bench: Evaluating Language Models as Transit Kiosk Runtimes
1
Performance of Clinical AI System and Physicians and Frontier Language Models in primary care diagnostics
xDailyBench: Benchmarking LLMs on Professional Consultation for Real-Life Problems
WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data
Molecular Déjà Vu: Digit-Level Retrieval of Published Values in Frontier Language Models
1
WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data
What Else Needs Fixing? Exploring Cost-Effective Test-Time Compute for Revision Propagation in Artifacts Generated Through Conversation
