George Hotz a72b1b6d65 sharding for llama (#3151) ...

* shard llama

* sharding works

* simpler

* simpler

* consume option

* disable that test

* save a line

---------

Co-authored-by: George Hotz <george@tinygrad.org>

2024-01-16 19:28:00 -08:00

..

external

separate try except blocks in onnx2torch in model benchmark (#3126)

2024-01-15 00:39:33 -05:00

extra

Remove pytest markers (#2831)

2023-12-18 18:53:28 -05:00

imported

fix broadcasted logic if there's 0 in shapes (#3097)

2024-01-12 13:32:43 -05:00

models

move gpt2/llama sampling inside the model call (#3013)

2024-01-04 17:01:50 -05:00

unit

fast resnet eval (#3135)

2024-01-15 14:15:18 -08:00

web

fast path for copy (#2548)

2023-12-01 11:34:47 -08:00

__init__.py

All devices are equal! (#196)

2020-12-15 23:44:08 -08:00

Dockerfile

Docker fix (#1039)

2023-06-25 10:38:58 -07:00

helpers.py

new lazy, benchmark (#2878)

2023-12-20 14:33:21 -08:00

test_assign.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

test_conv_shapetracker.py

fix some tests related to JitItem (#2279)

2023-11-11 23:00:35 -05:00

test_conv.py

update pytest marks and CI test filters (#2587)

2023-12-03 15:20:44 -05:00

test_copy_speed.py

Disk shm refactor (#2912)

2023-12-22 09:23:37 -08:00

test_custom_function.py

multitensor jit (#3149)

2024-01-16 09:09:15 -08:00

test_dtype_alu.py

Christopherm99 ptx (#3139)

2024-01-15 16:44:20 -08:00

test_dtype.py

Christopherm99 ptx (#3139)

2024-01-15 16:44:20 -08:00

test_fusion_op.py

Christopherm99 ptx (#3139)

2024-01-15 16:44:20 -08:00

test_gc.py

fix up eye and fix gc test

2023-02-27 06:53:18 -08:00

test_hip_rdna3.py

HIP cleanups (#2843)

2023-12-18 21:09:32 -08:00

test_image_dtype.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

test_jit.py

jit autorealizes output (#3069)

2024-01-09 20:10:22 -08:00

test_kernel_cache.py

move the compiler cache to be global (#2957)

2024-01-01 10:59:56 -08:00

test_lazybuffer.py

move fromcpu out of lazy.py (#3122)

2024-01-14 18:21:08 -08:00

test_lazyop.py

move fromcpu out of lazy.py (#3122)

2024-01-14 18:21:08 -08:00

test_linearizer_failures.py

Revert "track size in shapetracker" (#3043)

2024-01-08 13:13:39 -08:00

test_linearizer.py

remove numpy from device (#3123)

2024-01-14 19:36:05 -08:00

test_masked_st.py

multitensor start (#2676)

2023-12-07 17:07:05 -08:00

test_method_cache.py

add test that the compiler isn't used (#3025)

2024-01-05 17:24:01 -08:00

test_multitensor.py

sharding for llama (#3151)

2024-01-16 19:28:00 -08:00

test_net_speed.py

Remove pytest markers (#2831)

2023-12-18 18:53:28 -05:00

test_nn.py

clean up test_nn.py (#3049)

2024-01-08 18:45:03 -05:00

test_ops.py

Fix backward fn for < and == (#3037)

2024-01-14 20:39:52 -08:00

test_optim.py

remove realize from optimizer (#2880)

2023-12-20 16:42:41 -08:00

test_randomness.py

fix some long lines in tests (#3006)

2024-01-03 23:53:33 -05:00

test_sample.py

enable test_sample for all backend (#2593)

2023-12-03 17:20:27 -05:00

test_schedule.py

early gate the graph (#3070)

2024-01-09 20:17:13 -08:00

test_search.py

St real size (#3046)

2024-01-08 14:44:53 -08:00

test_specific_conv.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

test_speed_v_torch.py

move globalcounters to ops (#2960)

2024-01-01 14:21:02 -08:00

test_symbolic_jit.py

new lazy, benchmark (#2878)

2023-12-20 14:33:21 -08:00

test_symbolic_ops.py

fix gpt2 with empty prompt take 2 (#3102)

2024-01-12 14:46:36 -05:00

test_symbolic_shapetracker.py

unbind view or shapetracker also returns var_val (#3067)

2024-01-09 21:45:05 -05:00

test_tensor_data.py

dtype fmt (#3132)

2024-01-15 11:31:54 -08:00

test_tensor.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

test_to_numpy.py

Apply ruff linting rules to tests (#2473)

2023-11-27 21:24:06 -08:00

test_uops.py

multitensor jit (#3149)

2024-01-16 09:09:15 -08:00

test_winograd.py

get_lazyops() -> lazyops (#2884)

2023-12-20 18:04:49 -08:00

test_zero_copy.py

remove numpy from device (#3123)

2024-01-14 19:36:05 -08:00