Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

I ported NVIDIA Parakeet (speech-to-text) to ggml: same output as NeMo, faster, GGUF-quantized, no Python

Via r/LocalLlama
Sunday, May 31, 2026 ยท 8:35PM
Summary

I ported NVIDIA's Parakeet speech-to-text models to pure C++/ggml (the engine behind llama.cpp and whisper.cpp). It runs the FastConformer TDT / CTC / RNNT / hybrid models with no Python and no PyTorch, on CPU and GPU (CUDA, HIP, Vulkan, Metal). The goal was to match NeMo exactly, then make it deplo

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories