ICALL-BENCH tests LLM interprocedural reasoning on real binaries
On 50 C/C++ programs, five models’ verifiable success ranged from 23% to 81%, and more information access did not reliably help the hardest cases.
Stories per day · 30 days
1 stories, newest first · one card per story