Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

Why not dynamic active parameters (and other questions for the knowledgeable)

Via r/LocalLlama
Sunday, May 24, 2026 · 7:48AM
Summary

Why do we have to choose between MoE or Dense models? Wouldn't it be possible to have a model where the user can select the number of active parameters? If the user chooses them all, it is dense. So based on a task, a user could decide how many active parameters it needs. Or even automate some scrip

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories