Previously it was throwing a 'Not Implemented' error due to Mamba layers. Going to test it now! https://github.com/vllm-project/vllm/pull/39931