MMDM benchmark tests 28 models on 5,448 decision tasks
Best hard multi-select accuracy is 36.81%; Decider-V1.2 falls from 78.75% on world knowledge to 47.95% on constraint planning.
1 stories, newest first · one card per story
Best hard multi-select accuracy is 36.81%; Decider-V1.2 falls from 78.75% on world knowledge to 47.95% on constraint planning.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views