Low-bit n-gram embeddings cut table memory with little loss
Four-bit tables saved about 75% of table memory on models trained from scratch while keeping over 99% of the validation-loss gain.
1 stories, newest first · one card per story
Four-bit tables saved about 75% of table memory on models trained from scratch while keeping over 99% of the validation-loss gain.
Today 2.1K readers · 2.6K views · 393 reads · all time 108K views