Best way to test models at different quants before buying GPUs
Via r/LocalLlama
Monday, Jun 29, 2026 · 9:38AM
Summary
I am determined to buy a bunch of GPUs. However, I would like to test the performance of models such as GLM-5.2 at different quantisation levels first. What's the best approach here? Rent a few rtx6ks on Vast.ai and run the models there?
