27B Dense vs. 35B-A3B MoE): - Dense still holds the crown: It still wins out on most tasks overall. - The gap is closing: In 7 out of 10 benchmarks, the MoE model is quietly creeping up and closing the distance. - Coding is getting a massive boost: MoE is making serious strides here. For example, th
