Mutating Gemma 4 31B Dense in to a native Gemma 4 additive-MoE model

I recently came across an interesting model on Hugginface from JDONE-Research/AIOne-Agent-52B-A36B-it. It is the first finetune I saw that is built on the Gemma 4 31B dense model but enables MoE for it, training a router + experts and enabling the enable_moe_block config like Gemma 4 26B does. I was