Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

How to add multipart GGUF models to models.ini for llama server?

Via r/LocalLlama
Sunday, Mar 29, 2026 · 4:09AM
Summary

With the recent change leading to -hf downloaded models being moved and saved as blob files, I want to change hiw I do thibgs to avoid this being a problem now or in the future. I have started using a models.ini file to list out model-specific parameters (like temp and min-p) with the 'm = ' to put

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories