Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

LoRA over GGUF: Train Qwen3.6-35B-A3B in 16G VRAM

Via r/LocalLlama
Tuesday, Jul 21, 2026 ยท 5:35AM
Summary

https://github.com/woct0rdho/transformers5-qwen3.5-recipe It's time for GGUF to replace bitsandbytes as the base model format for low-VRAM LoRA training. It's actively supporting new model types such as MoE, linear attentions, and DeepSeek WTF attentions, and new quant types such as 1-bit quants. Th

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories