How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text
A study of 800 models finds wild AI web text can hurt pretraining and proposes a new scaling law.
60
A study of 800 models finds wild AI web text can hurt pretraining and proposes a new scaling law.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views