I can't wait for Jan to upgrade to a llamacpp version that supports these so I can test them! https://huggingface.co/openbmb/BitCPM4-CANN-8B https://huggingface.co/openbmb/BitCPM4-CANN-3B https://huggingface.co/openbmb/BitCPM4-CANN-1B
