I benchmarked 331 GGUF models on a Mac Mini M4 (16 GB) so you don't have to. Here are the results. Continuing on this past benchmark: https://www.reddit.com/r/LocalLLaMA/comments/1rhuvyc/benchmarking_88_smol_gguf_models_quickly_on_a/ - Choosing a local model for a 16 GB machine has been mostly vibes
