MoEs Collection This collection holds the list of all the first MoE releases from research labs. β’ 14 items β’ Updated 7 days ago β’ 4
kakaocorp/kanana-2-30b-a3b-instruct-2601 Text Generation β’ 31B β’ Updated 27 days ago β’ 800 β’ 52
Running 3.68k The Ultra-Scale Playbook π 3.68k The ultimate guide to training LLM on large GPU Clusters
Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination Paper β’ 2507.10532 β’ Published Jul 14, 2025 β’ 90
To Code, or Not To Code? Exploring Impact of Code in Pre-training Paper β’ 2408.10914 β’ Published Aug 20, 2024 β’ 45