Elias Wahl 27613dd881 MLPerf BERT: Main training loop (#4288) ...

* BERT language modeling head + trunc normal initializers

* add train loop + helpers

* shuffle in dataloaders + slight changes in main loop

* beam change

* Minor changes

* random.shuffle

* HParam update

* Use deque for dataloader

* wandb bert project name

* half fixes

* BENCHMARK + remove epoch

* cast + print()

---------

Co-authored-by: chenyu <chenyu@fastmail.com>

2024-04-29 14:35:27 -04:00

..

mlperf_bert/preprocessing

MLPerf BERT: Main training loop (#4288)

2024-04-29 14:35:27 -04:00

mlperf_resnet

PolynomialDecayWithWarmup + tests (#3649)

2024-03-07 18:53:36 -05:00

mlperf_unet3d

[MLPerf] UNet3D dataloader (#4343)

2024-04-28 22:34:18 -04:00

external_benchmark_hip_compile.py

hip compile speed (#2606)

2023-12-04 13:47:40 -08:00

external_benchmark_load_stable_diffusion.py

gate METAL_FAST_LOAD

2023-12-01 15:28:40 -08:00

external_benchmark_multitensor_allreduce.py

move GlobalCounter to helpers (#4002)

2024-03-30 00:30:30 -04:00

external_benchmark_resnet.py

add mem/s to external_benchmark_resnet (#4309)

2024-04-26 20:07:17 -04:00

external_cl_half_max.py

use default dict for external_model_benchmark (#2592)

2023-12-03 15:25:43 -08:00

external_hip_compiler_bug.py

CompiledASTRunner -> CompiledRunner (#4148)

2024-04-11 08:49:52 -07:00

external_jit_failure.py

fix jit realize issue (#3258)

2024-01-26 18:27:35 -08:00

external_llama_eval.py

ruff checks the max line length is 150 (#2734)

2023-12-12 17:34:47 -08:00

external_model_benchmark.py

Add driving monitoring model to benchmarks (#4134)

2024-04-10 14:27:03 -04:00

external_multi_gpu.py

s/lazydata.realized/lazydata.base.realized/g (#2914)

2023-12-22 14:45:13 -05:00

external_osx_profiling.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

external_test_datasets.py

[MLPerf] UNet3D dataloader (#4343)

2024-04-28 22:34:18 -04:00

external_test_embedding.py

make embedding and GPT-2 fast (#1631)

2023-08-22 15:14:38 -07:00

external_test_example.py

numpy device + pickle it (#4120)

2024-04-09 13:19:30 -07:00

external_test_hcq.py

hotfix: PM4 supports timing

2024-04-24 08:38:59 +00:00

external_test_hip_compile.py

split to schedule.py (#3949)

2024-03-26 21:02:46 -07:00

external_test_hsa_driver.py

JitItem -> ExecItem (#4146)

2024-04-11 08:24:57 -07:00

external_test_image.py

fixes (#1893)

2023-09-22 07:20:27 +08:00

external_test_jit_on_models.py

create engine folder and move code (#3948)

2024-03-26 20:38:03 -07:00

external_test_losses.py

[MLPerf][UNet3D] Add DICE loss + metrics (#4204)

2024-04-17 20:09:33 -04:00

external_test_mamba.py

external that test

2024-03-29 19:35:50 -07:00

external_test_metrics.py

[MLPerf][UNet3D] Add DICE loss + metrics (#4204)

2024-04-17 20:09:33 -04:00

external_test_mnist_data_select.py

add quick external data select test

2024-03-02 05:38:32 -08:00

external_test_onnx_backend.py

update onnx to 1.16.0 (#4127)

2024-04-10 11:19:13 -04:00

external_test_opt.py

reduce children fusion tests (#4321)

2024-04-28 11:14:02 -04:00

external_test_optim.py

add lars to nn (#3750)

2024-03-24 11:43:12 -04:00

external_test_speed_llama.py

multitensor shouldn't recompile (#4164)

2024-04-13 00:03:48 -07:00

external_test_uops_graphing.py

split to schedule.py (#3949)

2024-03-26 21:02:46 -07:00

external_test_whisper_librispeech.py

whisper: support audio >30s (#2378)

2023-11-21 14:37:51 -08:00

external_test_yolo.py

move to new cached fetch (#2493)

2023-11-28 17:36:55 -08:00

external_test_yolov8.py

ruff checks the max line length is 150 (#2734)

2023-12-12 17:34:47 -08:00

fuzz_kfd.py

renamed (#4260)

2024-04-23 09:00:28 +04:00

fuzz_linearizer.py

clean up update stats (#4226)

2024-04-19 15:41:30 +04:00

fuzz_schedule.py

override assign_target in fuzz_schedule (#4342)

2024-04-29 11:04:04 +03:00

fuzz_shapetracker_math.py

touchup canonicalize empty mask (#3308)

2024-02-03 21:05:10 -05:00

fuzz_shapetracker.py

minor improvements (#2845)

2023-12-18 22:09:08 -08:00

fuzz_symbolic.py

Variable.num -> NumNode (#2354)

2023-11-18 15:45:52 -05:00

graph_batchnorm.py

with Tensor.train() (#1935)

2023-09-28 18:02:31 -07:00

speed_beam_v_hcopt.py

LinearizerOptions -> CompilerOptions (#3978)

2024-03-28 17:50:23 -04:00

speed_compare_cuda_ptx.py

CompiledASTRunner -> CompiledRunner (#4148)

2024-04-11 08:49:52 -07:00

verify_kernel.py

test: add fuzz_matmul and better debugging for simple_matmul (#4199)

2024-04-16 23:40:31 -04:00