MMLU Pro benchmark for GGUFs (1 shot)
Collection
"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX • 13 items • Updated
• 9
Patterson
MartinPatterson
AI & ML interests
None yet
Recent Activity
new activity
1 day ago
cerebras/README:REAP for MiMo-V2-Flash(Feb 2026) requested new activity
2 days ago
mradermacher/Step-3.5-Flash-REAP-121B-A11B-GGUF:Is there Q4_K_M version coming? liked
a model 2 days ago
mradermacher/Step-3.5-Flash-REAP-121B-A11B-GGUF Organizations
None yet
upvoted a collection 4 months ago