
Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX Stations with vLLM
The NVFP4 checkpoint is about 464 GB, larger than one GB300 GPU's 252 GB of HBM3e, so weights are split across two stations.
1 stories, newest first · one card per story

The NVFP4 checkpoint is about 464 GB, larger than one GB300 GPU's 252 GB of HBM3e, so weights are split across two stations.
Today 1K readers · 1.2K views · 172 reads · all time 202K views