Got tired of $160 Opus bills so I spent a weekend wiring up a routing layer on vLLM 0.8 (2xA100, enable_auto_tool_choice). Getting the tool call parser to cooperate took longer than the actual routing logic. Once it worked though, easy agent steps go to the 21B active MoE and hard steps get Opus. Hu
