tiny-edu-166m / tiktoken_encoding.json
SlitherCode's picture
TiktokenTokenizer: upload tiktoken_encoding.json
dd7cc67 verified
raw
history blame contribute delete
32 Bytes
{"encoding_name": "cl100k_base"}