How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text
Study of 800 models finds wild AI web text initially helps data-starved pretraining, then raises human-text loss.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #ai-generated-text
How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text
A study of 800 models finds wild AI web text can hurt pretraining and proposes a new scaling law.