StudentBench: AI and human tutoring yield equivalent GRE learning gains
StudentBench finds AI tutoring matches human GRE gains for 2,383 learners at far lower cost.
StudentBench evaluates whether large language models produce GRE learning gains equivalent to human tutoring, using a public platform with more than 175,000 student-AI messages. Across 2,383 participants, AI tutoring was statistically equivalent to expert human tutoring (p = .015), and the best AI tutor outperformed the human tutor on average in five of seven GRE domains. A second study collected 2,028 pairwise expert ratings of lesson plans and practice problems. One AI tutor matched human learning gains (p = .044) at roughly 918 times lower cost, USD 0.0052 versus USD 4.81 per percentage point gained.
- The study includes 2,383 participants and over 175,000 student-AI messages.
- AI tutoring matched expert human GRE tutoring with p = .015.
- The best AI tutor led in five of seven GRE domains on average.
- One tutor matched human gains at about 918 times lower cost.
From the original article
1 min read at huggingface.co
Artificial intelligence offers an unprecedented opportunity to augment human capabilities, yet progress at the frontier has focused primarily on advancing model capabilities.
By Curtis Northcutt, Inaara Hasmani, Kevin Feng · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.