Kimi K3 (2.8T) at 1 token/s on a MacBook Pro, streamed from four SSDs
A GitHub project streams Moonshot's 2.8T-parameter Kimi K3 from four SSDs to run at 1 token/s on a MacBook Pro.
1 stories, newest first · one card per story
A GitHub project streams Moonshot's 2.8T-parameter Kimi K3 from four SSDs to run at 1 token/s on a MacBook Pro.
Today 840 readers · 1.1K views · 843 reads · all time 159K views