Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

PSA: llama-swap released a new grouping feature, matrix, allowing you to fine tune which models can run together

Via r/LocalLlama
Thursday, Apr 30, 2026 · 1:45PM
Summary

Previously a model could only be present in a single group. Now you can create whatever groups you want: one for big models that should run on their own, a group for STT + bigger model, a group for RAG usages, etc. It'll intelligently unload models based on "cost" of doing so. Check out the config:

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories