George Hotz
2097d814f6
Sum doesn't need to save the tensor
2022-06-05 12:04:51 -07:00
George Hotz
c8b569a8c7
cleaner comments
2022-05-14 21:28:39 -07:00
Adrian Bakke
8a7bbcc240
Accel/cuda ( #319 )
...
* start work
* right a wrong
* mimimal reduce example
* save
* get tests to pass
* fix stupid bug
* tests passing
* out of bounds error fixed, all tests passing
* revert changes to other files
* clean
* getting better, will drink a glass of wine and finish over the weekend
* clean
2022-05-14 21:25:30 -07:00
Drew Hintz
7ad60eb8b2
remove redundant list comprehensions ( #317 )
...
any() accepts a generator. This saves a few characters and can also return early without evaluating each item.
2022-04-05 10:30:50 -07:00
namliz
8ce8664024
Golfed -1 ( #315 )
...
* Golfed -1
To please the orange website
* Typo
2022-04-05 10:16:27 -07:00
Edward Betts
a6203b5ecd
Correct spelling mistakes ( #314 )
2022-04-05 05:22:18 -07:00
Andrei Augustin
050636bcb1
here's two extra lines of precious code ( #307 )
2022-02-21 11:45:19 -08:00
Ildar Kashaev
d065040df0
Fix yolo param name ( #306 )
2022-02-10 01:40:24 -07:00
George Hotz
cfb7a4c41a
back to 1000 lines
2022-01-17 10:44:39 -08:00
George Hotz
a482d56229
don't save for backward pass if we don't need to. add purple edges to graph
2022-01-16 12:18:41 -08:00
George Hotz
8dfdc4e11f
GRAPH and DEBUG can be independent. under 1k lines
2022-01-16 12:04:10 -08:00
George Hotz
2f531e35be
add ctx saved tensors to graph
2022-01-16 11:18:36 -08:00
George Hotz
2a10116bfa
support drawing graphs
2022-01-16 10:45:58 -08:00
George Hotz
6a5cb6842e
make profiler work for backward pass too
2022-01-16 09:35:10 -08:00
George Hotz
2cae2dfa07
don't crash the dataloader for imagenet
2022-01-16 08:41:26 -08:00
George Hotz
907ff7dbb6
imagenet is training
2022-01-15 23:27:31 -08:00
George Hotz
d1e082e0ef
add imagenet training support
2022-01-15 23:16:38 -08:00
George Hotz
ade2af7ac0
data doesn't require grad
2022-01-15 22:41:27 -08:00
George Hotz
0973e54eb0
fix DEBUG for GPU
2022-01-15 22:14:28 -08:00
George Hotz
d844ecee27
track running stats by default, and detach
2022-01-15 21:46:54 -08:00
George Hotz
d541e2a8e5
move assert, remove comment
2022-01-15 21:36:58 -08:00
George Hotz
845bb1fc34
bs 4 -> 2 in training test
2022-01-15 21:34:21 -08:00
George Hotz
c0d1254003
don't run unneeded grads
2022-01-15 21:32:13 -08:00
George Hotz
ecc0903451
Revert "faster deepwalk"
...
This reverts commit 931500a098 .
2022-01-15 21:02:18 -08:00
George Hotz
931500a098
faster deepwalk
2022-01-15 20:57:57 -08:00
cjg91
7025c9bbeb
Transfer learning for ResNet ( #295 )
...
* Transfer learning for ResNet
* moved ResNet depth specifics into the class
2022-01-15 23:22:10 -05:00
George Hotz
55d792b065
Revert "fixup resnet"
...
This reverts commit 4eabe677ed .
2022-01-15 20:22:01 -08:00
George Hotz
4eabe677ed
fixup resnet
2022-01-15 20:21:02 -08:00
George Hotz
e0bef0bd01
training is False by default
2022-01-15 19:57:41 -08:00
George Hotz
8ba3d1f803
fix bn test, affine is True
2022-01-15 19:52:15 -08:00
George Hotz
8ec2341cca
fix bn training
2022-01-15 19:47:01 -08:00
George Hotz
0e6832a8ea
support torch GPU, only autoinit cuda in the buffer
2022-01-15 19:15:12 -08:00
George Hotz
d8d19ed468
wikimedia wasn't returning 200
2022-01-15 19:09:29 -08:00
George Hotz
52918fbf78
cuda stub
2022-01-15 19:02:17 -08:00
Jacky Lee
81664baf64
Fix OpenCL installation ( #301 )
2022-01-06 10:35:48 -05:00
George Hotz
b0511f9392
Revert "does pybind fix CI?"
...
This reverts commit d128e4fcae .
2021-12-30 14:13:58 -05:00
George Hotz
d128e4fcae
does pybind fix CI?
2021-12-30 14:11:39 -05:00
George Hotz
5efb6653c4
a bit of work on metal
2021-12-30 13:53:08 -05:00
George Hotz
c0c2c0b041
support larger ViT models
2021-12-12 10:45:10 -08:00
George Hotz
785fe8ead7
unify torch Slice
2021-11-30 16:25:37 -05:00
George Hotz
e59381d0da
cleanups, remove np
2021-11-30 16:22:00 -05:00
George Hotz
e28cdfb0cf
clean up resnet
2021-11-30 16:14:54 -05:00
George Hotz
8f5779eeaa
very minor change
2021-11-30 15:54:03 -05:00
George Hotz
d31ef0ae48
make vit names match pytorch
2021-11-30 11:34:14 -05:00
George Hotz
4b7c31b5b7
break vit into it's own file
2021-11-30 11:19:22 -05:00
George Hotz
46bbbcf7f0
model touchups
2021-11-30 11:13:34 -05:00
George Hotz
7d7e2b690d
clean up Conv2d
2021-11-30 11:02:55 -05:00
George Hotz
835869974c
clean up vit code
2021-11-30 10:58:03 -05:00
George Hotz
6884add850
save two lines
2021-11-30 01:16:48 -05:00
George Hotz
9b538629bb
cosmetic
2021-11-30 01:01:39 -05:00