inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt3-speculator.eagle3
0.9B • Updated • 19
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Mistral-Small-4-119B-2603-BF16
119B • Updated • 179
inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt2-speculator.eagle3
0.9B • Updated • 95
inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch3
2B • Updated • 19
inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch2
2B • Updated • 11
inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch1
2B • Updated • 14
inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt1-speculator.eagle3
0.9B • Updated • 47
inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt0-speculator.eagle3
0.9B • Updated • 52
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-DDP8
5B • Updated • 12
inference-optimization/Qwen3-235B-A22B-Thinking-2507.w8a8
235B • Updated • 17
inference-optimization/Qwen3-235B-A22B-Instruct-2507.w8a8
235B • Updated • 11
inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator
Text Generation • 2B • Updated • 58
inference-optimization/Mistral3_speculator_dummy
2B • Updated • 27
inference-optimization/Phi-4-reasoning-vision-15B-FP8-dynamic
15B • Updated • 2
inference-optimization/Qwen3-235B-A22B-Thinking-2507.w4a16
32B • Updated • 11
inference-optimization/Qwen3-235B-A22B-Instruct-2507.w4a16
32B • Updated • 12
inference-optimization/Qwen3-32B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0
2B • Updated • 81
inference-optimization/gpt-oss-120b-from-qwen235b-ckpt5-speculator.eagle3
0.9B • Updated • 96
inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3
0.9B • Updated • 69
inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3
0.9B • Updated • 33
inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3
0.9B • Updated • 51
inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation • 12B • Updated • 1.13k
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise
3B • Updated • 18
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic
3B • Updated • 21
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise
3B • Updated • 21
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise
3B • Updated • 20