Kimi K3 (2.8T) at 1 token/s on a MacBook Pro, streamed from four SSDs
A GitHub project streams Moonshot's 2.8T-parameter Kimi K3 from four SSDs to run at 1 token/s on a MacBook Pro.
1 stories, newest first · one card per story
A GitHub project streams Moonshot's 2.8T-parameter Kimi K3 from four SSDs to run at 1 token/s on a MacBook Pro.
Today 1K readers · 1.5K views · 1.1K reads · all time 159K views