Elias Wahl 27613dd881 MLPerf BERT: Main training loop (#4288) ...

* BERT language modeling head + trunc normal initializers

* add train loop + helpers

* shuffle in dataloaders + slight changes in main loop

* beam change

* Minor changes

* random.shuffle

* HParam update

* Use deque for dataloader

* wandb bert project name

* half fixes

* BENCHMARK + remove epoch

* cast + print()

---------

Co-authored-by: chenyu <chenyu@fastmail.com>

2024-04-29 14:35:27 -04:00

..

external

MLPerf BERT: Main training loop (#4288)

2024-04-29 14:35:27 -04:00

imported

setitem no return value (#4266)

2024-04-23 16:28:14 -04:00

models

skip a few clang test that took > 30 seconds in CI (#4126)

2024-04-10 02:00:34 -04:00

testextra

add Tensor.replace (#3738)

2024-03-14 13:34:14 -07:00

unit

Fix in _reshape_mask (#4332)

2024-04-28 11:57:39 -04:00

web

fast path for copy (#2548)

2023-12-01 11:34:47 -08:00

__init__.py

All devices are equal! (#196)

2020-12-15 23:44:08 -08:00

Dockerfile

Docker fix (#1039)

2023-06-25 10:38:58 -07:00

helpers.py

disable bfloat16 from ptx tests (#4305)

2024-04-26 01:20:10 -04:00

test_arange.py

use old cumsum optimization for arange (#3813)

2024-03-18 20:01:03 -04:00

test_assign.py

test crossing diamond assigns (#4298)

2024-04-25 21:52:05 +03:00

test_const_folding.py

fix dtype of const folded sum (#4349)

2024-04-29 11:40:45 -04:00

test_conv_shapetracker.py

ScheduleItem uses Buffer (#3995)

2024-03-29 20:50:27 -07:00

test_conv.py

add back "CPU" in test_onnx_backend supports_device (#3426)

2024-02-16 00:49:30 -05:00

test_copy_speed.py

remove cpu and torch backends (#3399)

2024-02-15 16:55:39 +01:00

test_custom_function.py

CompiledASTRunner -> CompiledRunner (#4148)

2024-04-11 08:49:52 -07:00

test_device_speed.py

Use UOpGraph in test (#3876)

2024-03-22 14:12:38 -04:00

test_dtype_alu.py

add LazyOp.dtype (#4073)

2024-04-04 17:38:19 -04:00

test_dtype.py

fix mean of half tensor if sum is greater than hlaf.max (#4327)

2024-04-28 18:04:54 -04:00

test_fusion_op.py

tolist to return multidimensional list (#4192)

2024-04-18 07:43:10 +04:00

test_fuzz_shape_ops.py

skip a few clang test that took > 30 seconds in CI (#4126)

2024-04-10 02:00:34 -04:00

test_gc.py

threefry again (#3785)

2024-03-18 16:47:07 -04:00

test_image_dtype.py

ban __bool__ on Tensor (#3632)

2024-03-06 17:12:35 -05:00

test_jit.py

delete irrelevant JIT regression test (#4024)

2024-03-31 19:35:35 -04:00

test_kernel_cache.py

move the compiler cache to be global (#2957)

2024-01-01 10:59:56 -08:00

test_lazybuffer.py

split to schedule.py (#3949)

2024-03-26 21:02:46 -07:00

test_lazyop.py

split to schedule.py (#3949)

2024-03-26 21:02:46 -07:00

test_linearizer_failures.py

test_linearizer_failures 29 passes now (#4215)

2024-04-18 19:49:23 -04:00

test_linearizer_overflows.py

re-enable has_local check for linearizer test (#4034)

2024-04-02 00:02:03 -04:00

test_linearizer.py

rename rawbufs to bufs in ExecItem (#4274)

2024-04-24 11:27:27 +08:00

test_masked_st.py

multitensor start (#2676)

2023-12-07 17:07:05 -08:00

test_method_cache.py

simple LoadOps.ASSIGN (#3745)

2024-03-14 20:44:34 -07:00

test_multitensor.py

fix dtype of const folded sum (#4349)

2024-04-29 11:40:45 -04:00

test_net_speed.py

Remove pytest markers (#2831)

2023-12-18 18:53:28 -05:00

test_nn.py

Embedding in one kernel (#4036)

2024-04-02 11:38:21 -04:00

test_ops.py

no skipped tests in RHIP (#4337)

2024-04-28 12:23:05 -04:00

test_optim.py

use at least float32 for optim.lr (#4297)

2024-04-25 14:42:28 -04:00

test_pattern_matcher.py

failed test in test_pattern_matcher (#4080)

2024-04-05 02:53:50 -04:00

test_pickle.py

pickle schedules (#4114)

2024-04-09 13:47:25 -07:00

test_randomness.py

no skipped tests in RHIP (#4337)

2024-04-28 12:23:05 -04:00

test_sample.py

enable test_sample for all backend (#2593)

2023-12-03 17:20:27 -05:00

test_schedule.py

all fusion opportunities (#4348)

2024-04-29 19:32:23 +03:00

test_search.py

method cache respects beam option (#4261)

2024-04-23 09:00:41 +04:00

test_setitem.py

setitem no return value (#4266)

2024-04-23 16:28:14 -04:00

test_specific_conv.py

move is_dtype_supported to test.helpers (#3762)

2024-03-15 14:33:26 -04:00

test_speed_v_torch.py

move GlobalCounter to helpers (#4002)

2024-03-30 00:30:30 -04:00

test_symbolic_jit.py

create engine folder and move code (#3948)

2024-03-26 20:38:03 -07:00

test_symbolic_ops.py

bring ptx back (#3623)

2024-03-06 13:34:21 -08:00

test_symbolic_shapetracker.py

unbind view or shapetracker also returns var_val (#3067)

2024-01-09 21:45:05 -05:00

test_tensor_data.py

tolist to return multidimensional list (#4192)

2024-04-18 07:43:10 +04:00

test_tensor.py

tolist to return multidimensional list (#4192)

2024-04-18 07:43:10 +04:00

test_to_numpy.py

Apply ruff linting rules to tests (#2473)

2023-11-27 21:24:06 -08:00

test_uop_graph.py

Add insert_before to Linearizer Functions (#4320)

2024-04-28 11:38:36 -04:00

test_uops_stats.py

CommandQueue is the future (#3950)

2024-04-01 17:35:48 -07:00

test_uops.py

Ptx beam fix (#4296)

2024-04-25 15:39:39 -04:00

test_winograd.py

split to schedule.py (#3949)

2024-03-26 21:02:46 -07:00

test_zero_copy.py

remove numpy from device (#3123)

2024-01-14 19:36:05 -08:00