Janas: Run LLMs larger than RAM by streaming experts from SSD
Janas streams LLM experts from SSD so models larger than RAM can run locally.
1 stories, newest first · one card per story
Janas streams LLM experts from SSD so models larger than RAM can run locally.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views