I tried Gemma 4 (26b-a4b) and I was a bit blown away at how much better it is than other models. However, I soon found three things: it gets significantly worse as context fills up, moreso than other models it completely disregards the system prompt, no matter what I put in there it (almost) never d
