Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home Community Story
Community

I didn't know it was possible to compile llamacpp to run cuda + vulkan at the same time..

Via r/LocalLlama
Tuesday, Jun 16, 2026 · 10:10PM
Summary

cmake -B build -G "Visual Studio 17 2022" -A x64 -DCUDAToolkit_ROOT="C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v13.1" -DGGML_CUDA=ON -DGGML_VULKAN=ON -DGGML_FLASH_ATTN=ON -DGGML_BLAS=OFF -DGGML_NATIVE=OFF -DGGML_RPC=ON -DGGML_BACKEND_DL=ON -DCMAKE_CUDA_ARCHITECTURES="120a" -DGGML_CUDA_FA_AL

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories