flexitok/mod-tokenizers flexitok/mod-tokenizers-individual Updated 1 day ago flexitok/mod-tokenizers-ltr_3digit Updated 1 day ago flexitok/mod-tokenizers-ltr_2digit Updated 1 day ago flexitok/mod-tokenizers-ltr_4digit Updated 1 day ago
Fineweb2-HQ-Tokenizers flexitok/unigram_fw_edu_16000 Updated 7 days ago flexitok/bpe_vie_Latn_16000 Updated 7 days ago flexitok/bpe_ita_Latn_16000 Updated 7 days ago flexitok/bpe_rus_Cyrl_16000 Updated 7 days ago
baselines flexitok/llama_baseline_english 2B • Updated Jan 23 • 7 flexitok/llama_bpe_dropout_english 2B • Updated Jan 23 • 6 flexitok/llama_baseline 2B • Updated 24 days ago • 171 flexitok/llama_bpe_dropout 2B • Updated 24 days ago • 196
flexitok/fineweb2-hq-superset-tokenizers flexitok/bpe_arb_Arab_8000 Updated 5 days ago flexitok/bpe_ces_Latn_8000 Updated 5 days ago flexitok/bpe_cmn_Hani_8000 Updated 5 days ago flexitok/bpe_dan_Latn_8000 Updated 5 days ago
merging-toksuite moe-dtoks/qwen_onto_llama_lambda-0 Updated 14 days ago moe-dtoks/llama_onto_qwen_lambda-0 Updated 13 days ago • 5 moe-dtoks/llama_onto_qwen_lambda-1-nse-random Updated 14 days ago • 1 moe-dtoks/llama_onto_qwen_lambda-1 Updated 14 days ago • 2
flexitok/mod-tokenizers flexitok/mod-tokenizers-individual Updated 1 day ago flexitok/mod-tokenizers-ltr_3digit Updated 1 day ago flexitok/mod-tokenizers-ltr_2digit Updated 1 day ago flexitok/mod-tokenizers-ltr_4digit Updated 1 day ago
flexitok/fineweb2-hq-superset-tokenizers flexitok/bpe_arb_Arab_8000 Updated 5 days ago flexitok/bpe_ces_Latn_8000 Updated 5 days ago flexitok/bpe_cmn_Hani_8000 Updated 5 days ago flexitok/bpe_dan_Latn_8000 Updated 5 days ago
Fineweb2-HQ-Tokenizers flexitok/unigram_fw_edu_16000 Updated 7 days ago flexitok/bpe_vie_Latn_16000 Updated 7 days ago flexitok/bpe_ita_Latn_16000 Updated 7 days ago flexitok/bpe_rus_Cyrl_16000 Updated 7 days ago
merging-toksuite moe-dtoks/qwen_onto_llama_lambda-0 Updated 14 days ago moe-dtoks/llama_onto_qwen_lambda-0 Updated 13 days ago • 5 moe-dtoks/llama_onto_qwen_lambda-1-nse-random Updated 14 days ago • 1 moe-dtoks/llama_onto_qwen_lambda-1 Updated 14 days ago • 2
baselines flexitok/llama_baseline_english 2B • Updated Jan 23 • 7 flexitok/llama_bpe_dropout_english 2B • Updated Jan 23 • 6 flexitok/llama_baseline 2B • Updated 24 days ago • 171 flexitok/llama_bpe_dropout 2B • Updated 24 days ago • 196