Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Painfully slow local llama on 5090 and 192GB RAM

Via r/LocalLlama
Monday, Mar 30, 2026 ยท 9:23AM
Summary

I am running a llama server with the following command: nohup ./llama-server \ --model "/path/to/your/models/MiniMax-M2.5-UD-Q3_K_XL.gguf" \ --alias "minimax_m2.5" \ --threads $(nproc) \ --threads-batch $(nproc) \ --n-gpu-layers -1 \ --port 8001 \ --ctx-size 65536 \ -b 4096 -ub 4096 \ --temp 1.0 \ -

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories