This model seems utterly broken for now. I do not recommend downloading or using it, unless you are planning to help troubleshoot it. This is not a problem with the conversion, but with the model itself. I converted Mistral medium 3.5 128B to MLX 4bit. Eagle model for speculative decoding is not yet
