8 Commits

Author	SHA1	Message	Date
George Hotz	0b733ba75e	multi device training with GPT2 [pr] (#10375) ... * multi device training with GPT2 [pr] * Update grouper.py	2025-05-17 15:33:56 -07:00
George Hotz	2ed94e447f	gpt2: corealize opt and loss	2024-09-30 09:11:20 +08:00
George Hotz	a76c6c740c	hand pad gpt2 (#6805)	2024-09-30 09:03:07 +08:00
George Hotz	9a3f6f392d	llm.c tok/s	2024-09-27 00:46:18 -07:00
George Hotz	b0e70ab04f	llm.c updates	2024-09-27 15:25:59 +08:00
George Hotz	eecfdd2f6e	hotfix: fix dataset reading for new llm.c	2024-06-03 14:10:05 +02:00
chenyu	f2414c666f	fix train_gpt2.py (#4771) ... added `with Tensor.train():`	2024-05-29 12:01:34 -04:00
George Hotz	55ae73e951	Replicate llm.c in tinygrad (#4179) ... * write llm.c and add a few new methods to tensor * training works * add jit * tests for new functions * test tolist * simple fix for onnx test failures (#4186) * write llm.c and add a few new methods to tensor * training works * add jit * tests for new functions * bump line count to 7500 * simplest fix * safenumpy tolist for now --------- Co-authored-by: George Hotz <geohot@gmail.com> Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com> --------- Co-authored-by: geohotstan <135171913+geohotstan@users.noreply.github.com>	2024-04-16 15:40:48 +04:00