David Hou 4b95350c41 fp16 resnet (without expand backwards sum in float, doesn't work) (#3816) ...

* fp16 resnet

* cast running mean and var back to default float

* extra cast

* check symbolic no overflow

* add linearizer failure

* loss scaler after grad contig

* oops

* i think this works

* don't loss scale fp32

* remove overflow test case

* remove symbolic bounds check

* loss scaler should be float

* temporarily disable padto cuz bug

shruggie

* make running stats in batchnorm float32?

* calculate lars stuff in fp32?

* oops

* remove most changes

* move loss scaler out of optimizer

* no more FP16 var

* oops

---------

Co-authored-by: chenyu <chenyu@fastmail.com>

2024-03-28 01:25:37 -04:00

..

conversation_data

Whisper + LLAMA + VITS (#2332)

2023-12-02 15:03:46 -08:00

mlperf

fp16 resnet (without expand backwards sum in float, doesn't work) (#3816)

2024-03-28 01:25:37 -04:00

rl

more beautiful_cartpole with exposed hparams

2024-01-07 17:41:09 -08:00

sovits_helpers

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

vgg7_helpers

move to new cached fetch (#2493)

2023-11-28 17:36:55 -08:00

webgl/yolov8

webgl backend in extra (#3041)

2024-01-08 09:29:13 -08:00

webgpu/stable_diffusion

s/lazydata.realized/lazydata.base.realized/g (#2914)

2023-12-22 14:45:13 -05:00

__init__.py

failing llama test

2023-03-11 16:28:10 -08:00

beautiful_cartpole.py

more beautiful_cartpole with exposed hparams

2024-01-07 17:41:09 -08:00

beautiful_mnist.py

verify beautiful_mnist.py eval acc and put into benchmark ci (#3926)

2024-03-25 16:47:49 -04:00

benchmark_train_efficientnet.py

create engine folder and move code (#3948)

2024-03-26 20:38:03 -07:00

coder.py

apply the same fix_bf16 in llama and coder (#3789)

2024-03-17 21:25:24 -04:00

compile_efficientnet.py

webgl backend in extra (#3041)

2024-01-08 09:29:13 -08:00

compile_tensorflow.py

updating to work with new internal apis (#2755)

2023-12-13 21:54:47 -08:00

conversation.py

fix conversation: llama generates token not prob now (#3120)

2024-01-14 13:10:01 -05:00

efficientnet.py

create engine folder and move code (#3948)

2024-03-26 20:38:03 -07:00

f16_w_uint32.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

gpt2.py

simple LoadOps.ASSIGN (#3745)

2024-03-14 20:44:34 -07:00

handcode_resnet50_opt.py

split to schedule.py (#3949)

2024-03-26 21:02:46 -07:00

hlb_cifar10.py

fp16 resnet (without expand backwards sum in float, doesn't work) (#3816)

2024-03-28 01:25:37 -04:00

index.html

Enable Multi-Output Export (#2179)

2023-10-30 18:42:26 -07:00

llama.py

llama: prevent device initialization outside of __main__ (#3966)

2024-03-27 19:19:38 -04:00

mask_rcnn.py

move things, clean up extra (#2292)

2023-11-13 20:18:40 -08:00

mixtral.py

remove mixtral weight to clang first (#3792)

2024-03-17 23:33:17 -04:00

mnist_gan.py

move state to nn/state (#1619)

2023-08-22 07:36:24 -07:00

serious_mnist.py

move state to nn/state (#1619)

2023-08-22 07:36:24 -07:00

simple_conv_bn.py

with Tensor.train() (#1935)

2023-09-28 18:02:31 -07:00

so_vits_svc.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

stable_diffusion_seed0.png

validate stable diffusion for seed 0 (#2773)

2023-12-15 00:07:09 -05:00

stable_diffusion.py

create engine folder and move code (#3948)

2024-03-26 20:38:03 -07:00

train_efficientnet.py

move things, clean up extra (#2292)

2023-11-13 20:18:40 -08:00

train_resnet.py

move things, clean up extra (#2292)

2023-11-13 20:18:40 -08:00

transformer.py

fix onehot and jit in examples/transformer (#3073)

2024-01-10 02:22:41 -05:00

vgg7.py

waifu2x vgg7: testcase, auto-RGBA->RGB, function to grab pretrained models, training "fix" (#2117)

2023-10-19 22:07:15 -07:00

vit.py

move to new cached fetch (#2493)

2023-11-28 17:36:55 -08:00

vits.py

create engine folder and move code (#3948)

2024-03-26 20:38:03 -07:00

whisper.py

create engine folder and move code (#3948)

2024-03-26 20:38:03 -07:00

yolov3.py

Update yolov3.py (#2680)

2023-12-08 12:59:38 -08:00

yolov8-onnx.py

[ready] Replacing os with pathlib (#1708)

2023-08-30 10:41:08 -07:00

yolov8.py

fix yolov8.py (#3742)

2024-03-14 17:33:45 -04:00