Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX stations with vLLM

2 comments

• boodleboodle 11 minutes ago
  Whats the best model i should be runnning with two dgxs? Is there a reason they chose glm and not deepseek
• walrus01 4 minutes ago
  I'll get right on that after an elderly relative passes away and leaves me a valuable piece of real estate in a major city that will sell for enough money to buy two DGX stations in the current market. Or I win the lottery.