Lab update · October 24, 2026
Large local models at around 30 tokens per second.
I’m now running GLM-5.3-Flash Q4_K_XL and DeepSeek-V4.1-Flash Q8_K_XL at around 30 tokens per second with Project Maya on Galactus: four AMD Radeon Pro V620 GPUs, an EPYC 7713, and 2 TiB of RAM. The October 23 tests measured 31.6 tokens/s for GLM with default speculation and 29.3 tokens/s for DeepSeek with DSpark drafting enabled.
The following morning’s DeepSeek dashboard adds a view of ongoing use: 90 requests and 86,075 output tokens at a reported aggregate 28.0 tokens/s. The last request generated 422 tokens at 31.6 tokens/s. These mixed requests provide a useful follow-up to the controlled measurements, with the configurations and measurement limits recorded in the notebook.