multitensor start (#2676)

* multitensor work

* early gen fixes the tests

* atol for flaky test
This commit is contained in:
George Hotz
2023-12-07 17:07:05 -08:00
committed by GitHub
parent 4b01839774
commit 4164d0ebbd
8 changed files with 118 additions and 37 deletions

View File

@@ -37,7 +37,7 @@ Try a matmul. See how, despite the style, it is fused into one kernel with the p
```sh
DEBUG=3 python3 -c "from tinygrad import Tensor;
N = 1024; a, b = Tensor.rand(N, N), Tensor.rand(N, N);
c = (a.reshape(N, 1, N) * b.permute(1,0).reshape(1, N, N)).sum(axis=2);
c = (a.reshape(N, 1, N) * b.T.reshape(1, N, N)).sum(axis=2);
print((c.numpy() - (a.numpy() @ b.numpy())).mean())"
```