github/tinygrad
1
1
Fork 0
mirror of https://github.com/tinygrad/tinygrad.git synced 2026-04-07 03:00:26 -04:00
Code Issues Packages Projects Releases Wiki Activity
4,244 Commits 241 Branches 14 Tags
61c97d530550de032bd88d4afece5467bdec9ee6
Commit Graph

2 Commits

Author SHA1 Message Date
chenyu
82d0ed3cf3 cap default dataset wikipedia max_workers to 32 (#4345) 
64 on tinybox OOM
 2024-04-28 21:55:21 -04:00
Elias Wahl
69341144ba Wikipedia preprocessing script (#4229) 
* Preprocessing script

* short seq prob

* comments + env vars

* Add preprocessing reference. Add test

* lint fix + add eval test support

* whitespaces

* point to commit

* comment

* rename

* better comments
 2024-04-23 10:28:01 -04:00