How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text
Study of 800 models finds wild AI web text initially helps data-starved pretraining, then raises human-text loss.
58
Study of 800 models finds wild AI web text initially helps data-starved pretraining, then raises human-text loss.
A study of 800 models finds wild AI web text can hurt pretraining and proposes a new scaling law.
Entities are extracted by the model from each article. First seen , last mentioned . Watching keeps it in this browser only (no account); the watchlist page and dashboard alerts use it.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views