r1-gguf Quantized checkpoints gguf npc0/R1_tool_call_Distill-Qwen-1.5B-Q4_K_M-GGUF 2B • Updated Jan 29, 2025 • 13 npc0/R1_tool_call_Distill-Qwen-7B-Q4_K_M-GGUF 8B • Updated Jan 29, 2025 • 47
GLM-4-ggml Quantized checkpoints ggml/gguf npc0/chatglm-4-9b-int4 Updated Jun 30, 2024 npc0/chatglm-4-9b-int8 Updated Jun 30, 2024
GLM-3-ggml Quantized checkpoints ggml/gguf npc0/chatglm3-6b-int8 Updated Dec 24, 2023 • 1 npc0/chatglm3-6b-int4 Updated Dec 24, 2023 • 3 • 2 npc0/chatglm3-6b-32k-int4 Updated Dec 24, 2023 • 1 npc0/chatglm3-6b-fp16 Updated Dec 30, 2023
r1-gguf Quantized checkpoints gguf npc0/R1_tool_call_Distill-Qwen-1.5B-Q4_K_M-GGUF 2B • Updated Jan 29, 2025 • 13 npc0/R1_tool_call_Distill-Qwen-7B-Q4_K_M-GGUF 8B • Updated Jan 29, 2025 • 47
GLM-3-ggml Quantized checkpoints ggml/gguf npc0/chatglm3-6b-int8 Updated Dec 24, 2023 • 1 npc0/chatglm3-6b-int4 Updated Dec 24, 2023 • 3 • 2 npc0/chatglm3-6b-32k-int4 Updated Dec 24, 2023 • 1 npc0/chatglm3-6b-fp16 Updated Dec 30, 2023
GLM-4-ggml Quantized checkpoints ggml/gguf npc0/chatglm-4-9b-int4 Updated Jun 30, 2024 npc0/chatglm-4-9b-int8 Updated Jun 30, 2024
