wozeparrot 50decf0d45 train cifar using multigpu (#1529) ...

* feat: train cifar using multigpu

* feat: split eval batch across 5

* feat: cleaner allreduce

* feat: 93.88%

* feat: cleaner batch chunking from bert

* feat: cleaner grad sync

* feat: tinygrad argmax

* feat: make it work with different gpu counts

* feat: move some stuff into the normal __init__

* feat: autodetect gpu count

* feat: move import inside

2023-08-18 09:35:44 -07:00

..

__init__.py

distributed world (#1481)

2023-08-10 10:00:51 -07:00

collectives.py

train cifar using multigpu (#1529)

2023-08-18 09:35:44 -07:00

world.py

distributed collectives (#1519)

2023-08-11 10:22:07 -07:00