Files
tinygrad/test/external/external_test_simple_tokenizer.py
George Hotz b9eb5b5d49 clean up the LLM tokenizer (#12653)
* clean up the LLM tokenizer

* simple tokenizer is actually simple

* ugh write good code
2025-10-14 14:22:01 +08:00

2.1 KiB