Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
NVIDIA describes scaling Indic pretraining to 2.8 trillion tokens with an open data pipeline.
Stories per day · 30 days
1 stories, newest first · one card per story
1 stories, newest first · one card per story
NVIDIA describes scaling Indic pretraining to 2.8 trillion tokens with an open data pipeline.
Today 656 readers · 803 views · 606 reads · all time 158K views