Jacky Lee ef5f648e2f Tensor.scaled_dot_product_attention to match torch, used in LLaMA, and tested (#1502) ...

* Implement scaled_dot_product_attention and test

* Support attn_mask

* Support is_causal too

* Use in llama

* Don't forget to reshape

* Set requires_grad=False for causal

* Remove staticmethod

* Remove extra spaces

2023-08-08 23:27:13 -07:00

..

external

use fake buffer for external_test_speed_llama.py (#1478)

2023-08-07 22:05:44 -04:00

extra

Revert "update editorconfig, enforce via CI (#1343)" (#1380)

2023-07-31 10:35:50 -07:00

models

Raise memory limit for CIFAR test (#1499)

2023-08-08 19:40:56 -04:00

unit

move renamer to linearizer (#1442)

2023-08-05 08:53:25 -07:00

__init__.py

All devices are equal! (#196)

2020-12-15 23:44:08 -08:00

Dockerfile

Docker fix (#1039)

2023-06-25 10:38:58 -07:00

test_assign.py

Limit dims based on max size (#1390)

2023-07-31 19:18:19 -07:00

test_conv_shapetracker.py

CI < 5 minutes (#1252)

2023-07-23 13:00:56 -07:00

test_conv.py

Limit dims based on max size (#1390)

2023-07-31 19:18:19 -07:00

test_custom_function.py

flake8 (#1323)

2023-07-24 11:19:58 -04:00

test_dtype.py

Add WEBGPU tests to CI (#1463)

2023-08-06 10:32:01 -07:00

test_gc.py

fix up eye and fix gc test

2023-02-27 06:53:18 -08:00

test_helpers.py

fix: Context (#1430)

2023-08-04 10:53:48 -04:00

test_jit.py

use allclose instead of equals in test_jit (#1504)

2023-08-08 22:22:17 -07:00

test_lazybuffer.py

just cmplt (#1493)

2023-08-08 13:58:10 -07:00

test_linearizer.py

dedup kernel args v2 (#1272)

2023-07-18 20:03:42 -07:00

test_net_speed.py

CI < 5 minutes (#1252)

2023-07-23 13:00:56 -07:00

test_nn.py

Limit dims based on max size (#1390)

2023-07-31 19:18:19 -07:00

test_ops.py

Tensor.scaled_dot_product_attention to match torch, used in LLaMA, and tested (#1502)

2023-08-08 23:27:13 -07:00

test_optim.py

Add WEBGPU tests to CI (#1463)

2023-08-06 10:32:01 -07:00

test_randomness.py

rng hlops: add normal and kaiming_normal (#1378)

2023-07-31 10:37:02 -07:00

test_specific_conv.py

CI < 5 minutes (#1252)

2023-07-23 13:00:56 -07:00

test_speed_v_torch.py

Add WEBGPU tests to CI (#1463)

2023-08-06 10:32:01 -07:00

test_symbolic_shapetracker.py

Support constant expand to symbolic shape (#1411)

2023-08-02 21:21:22 -07:00

test_tensor.py

Add WEBGPU tests to CI (#1463)

2023-08-06 10:32:01 -07:00

test_uops.py

just cmplt (#1493)

2023-08-08 13:58:10 -07:00

test_webgpu.js

Revert "update editorconfig, enforce via CI (#1343)" (#1380)

2023-07-31 10:35:50 -07:00