Elias Wahl 27613dd881 MLPerf BERT: Main training loop (#4288) ...

* BERT language modeling head + trunc normal initializers

* add train loop + helpers

* shuffle in dataloaders + slight changes in main loop

* beam change

* Minor changes

* random.shuffle

* HParam update

* Use deque for dataloader

* wandb bert project name

* half fixes

* BENCHMARK + remove epoch

* cast + print()

---------

Co-authored-by: chenyu <chenyu@fastmail.com>

2024-04-29 14:35:27 -04:00

..

accel

move things, clean up extra (#2292)

2023-11-13 20:18:40 -08:00

assembly

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

backends

JitItem -> ExecItem (#4146)

2024-04-11 08:24:57 -07:00

datasets

MLPerf BERT: Main training loop (#4288)

2024-04-29 14:35:27 -04:00

gemm

wmma: widen TC usage in search by using PADTO on TC axes when possible (#4216)

2024-04-22 16:50:31 -04:00

hip_gpu_driver

KFDProgram -> AMDProgram (#4268)

2024-04-24 00:29:50 +03:00

hiprtc

use comgr to compile (#3248)

2024-01-26 18:27:49 -08:00

junk

coder.py can write and run code (#2439)

2023-11-25 12:27:54 -08:00

models

MLPerf BERT: Main training loop (#4288)

2024-04-29 14:35:27 -04:00

nv_gpu_driver

nv driver (#4044)

2024-04-22 19:50:20 +04:00

optimization

search: add a BEAM_COMPARE env to optionally not compare to hc/tc (#4107)

2024-04-08 18:54:01 -04:00

qcom_gpu_driver

start Qualcomm GPU driver (#2804)

2023-12-16 23:10:50 -08:00

archprobe.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

augment.py

[ready] Replacing os with pathlib (#1708)

2023-08-30 10:41:08 -07:00

autopad.py

split to schedule.py (#3949)

2024-03-26 21:02:46 -07:00

disk_read_speed.py

fast hip read (#3014)

2024-01-05 10:33:13 -08:00

dump_cache.py

wow how did i think that was okay (#2339)

2023-11-16 21:21:11 -08:00

export_model.py

rename rawbufs to bufs in ExecItem (#4274)

2024-04-24 11:27:27 +08:00

gradcheck.py

Fix: Jacobian tests [WIP] (#1126)

2023-07-05 15:36:22 -07:00

hip_events.py

move autogen to runtime/autogen (#3254)

2024-01-26 12:44:19 -08:00

introspection.py

move GlobalCounter to helpers (#4002)

2024-03-30 00:30:30 -04:00

lr_scheduler.py

use at least float32 for optim.lr (#4297)

2024-04-25 14:42:28 -04:00

multitensor.py

multitensor start (#2676)

2023-12-07 17:07:05 -08:00

onnx_ops.py

use tolist instead of numpy for extracting parameters in onnx (#4333)

2024-04-29 10:48:20 -04:00

onnx.py

use tolist instead of numpy for extracting parameters in onnx (#4333)

2024-04-29 10:48:20 -04:00

ring_copy.py

ring copy example (#3185)

2024-01-19 23:34:30 -05:00

thneed.py

new style device (#2530)

2023-11-30 17:07:16 -08:00

to_movement_ops.py

fixup to_movement_ops and add back to CI (#3881)

2024-03-22 18:14:49 -04:00

training.py

create engine folder and move code (#3948)

2024-03-26 20:38:03 -07:00

transfer_speed.py

hotfix: copy size is in bytes

2024-01-17 16:44:15 +00:00