This PR should be ready for testing now. I tested with a very small (8B params) sub-model extracted from the original one. Appreciate if someone can test with the bigger model. GGUF(for testing) from PR: (Please check latest comments at bottom for updated GGUFs) https://huggingface.co/ggml-org/LongC