Commit Graph

12814 Commits

Author SHA1 Message Date
nimlgen
5181c8e23a llm: fix nan in kvcache (#15552) 2026-04-01 00:38:45 +03:00
nimlgen
3af25ccdb4 docs: minor tinygpu changes (#15550) 2026-03-31 21:29:15 +03:00
nimlgen
477d194630 hipcomgr and tinygpu scripts (#15549) 2026-03-31 20:07:52 +03:00
nimlgen
83085f103c tinygpu docs (#15545)
* tinygpu docs

* x

* x

* fix
2026-03-31 19:49:38 +03:00
nimlgen
ca89215a59 nv: use nvcc over nak by default (#15547) 2026-03-31 18:54:56 +03:00
qazal
a15345a53e viz/cli: improve --help message (#15546)
* viz/cli: improve --help message

* not the default

* more work

* -s

* respect colored
2026-03-31 22:31:33 +09:00
nimlgen
10d570b3d5 signed tinygpu (#15541) 2026-03-31 14:55:09 +03:00
chenyu
4ac2552642 improve ReduceMixin.all (#15544)
use prod instead of min since `mul` lowered to `and` directly
2026-03-31 07:54:27 -04:00
chenyu
89ec22131a tests to show double negation in min is not cancelled (#15543) 2026-03-31 06:59:13 -04:00
qazal
8feb8edc68 gemm/asm: add fp8 support to cdna asm_gemm (#15542)
* work

* hmm, mixins

* rhs_transposed

* also fix the dtype

* check for hipcc

* Exception

* select dev

* default
2026-03-31 19:32:54 +09:00
chenyu
2939ae8b22 more mixin (#15540)
isclose is elementwise, min, any, all to OpMixin
2026-03-31 05:46:55 -04:00
chenyu
e69f5f9f69 more movement methods to mixin (#15536)
* more movement methods to mixin

* cleanups
2026-03-31 05:16:47 -04:00
nimlgen
ceb63c8c2f new bundle id (#15307)
* new bundle id

* new profiles
2026-03-31 12:16:03 +03:00
qazal
467c0af8aa viz: skip flaky sever tests (#15538) 2026-03-31 17:20:30 +09:00
qazal
f88e255cea gemm/asm: split and parameterize dtype in llama gemm tests (#15408)
* gemm/asm: more tests for emulator, parameterize llama gemm tests

* bf16 atol
2026-03-31 17:12:44 +09:00
b1tg
a63392a565 llm: pairwise ranking topk for MoE expert selection (#15499) 2026-03-31 12:46:39 +08:00
wozeparrot
79cccf3003 write sz output to file (#15534) 2026-03-30 20:16:17 -07:00
Christopher Milan
6fb038d109 replace CompilerSet with list (#15530)
* replace CompilerSet with list

* oops

* default Renderer list
2026-03-30 23:07:52 -04:00
qazal
bc866a93f0 viz: rename exec to sqtt (#15527)
* viz: rename exec to sqtt

* more
2026-03-31 08:06:51 +09:00
Christopher Milan
adbfd82d1d DEV is ContextVar, setting Device.DEFAULT is deprecated (#15508) 2026-03-30 17:10:49 -04:00
nimlgen
9583489068 add mlx driver to extra (#15526)
* mlx driver

* x

* simpler
2026-03-30 20:28:49 +03:00
qazal
ad6347f6d8 sqtt: allow mapping sopk to IMMEDIATE packets (#15525)
* work

* with s_waitcnt

* with the sopp variants, increase threads

* remove that

* sdst=NULL produces IMMEDIATE, otherwise is SALU
2026-03-30 23:12:17 +09:00
chenyu
301b2cea57 move matmul to mixin (#15524) 2026-03-30 07:39:09 -04:00
chenyu
f0eaac4235 reduce mixin (#15523) 2026-03-30 05:23:58 -04:00
chenyu
f485d0b664 UOp.sum -> usum, prod -> uprod [pr] (#15522)
rename to prep reduce mixin
2026-03-29 04:51:55 -04:00
qazal
36a925e2a2 viz: color wmma, one color map for cli and web (#15519)
* viz: color wmma, one color map for cli and web

* op_type

* like uops

* mypy cli
2026-03-29 04:53:01 +09:00
wozeparrot
0c3e438229 llama: mllog (#15502) 2026-03-28 11:18:25 -07:00
nimlgen
7e57e101d5 better oor message in profiles (#15516)
* better oor message

* x
2026-03-28 20:25:07 +03:00
qazal
266fb07721 viz: show exec duration (#15484)
* duration

* handwritten tests

* rdna3 pickle

* rdna4 pickle

* asserts

* rm that

* wmma work

* r4

* this shows the overlap well

* ohh okay it goes back

* are ds_load and ds_store different queues on RDNA4?

* print msg, v_mul_lo_u32 is 4 cycles?

* discover

* wmma something

* wmma comment

* less

* less

* better comments

* work

* inst st

* delay column

* better cli

* emit_alt

* update test_handwritten

* work
2026-03-28 22:48:59 +09:00
chenyu
fe705def0d move more broadcast method to mixin [pr] (#15513)
* move more broadcast method to mixin [pr]

all but div, mod, and where

* xor -1
2026-03-28 01:48:08 -04:00
chenyu
c0753ab62f XOR simplifcation rules (#15512)
x^-1 has good vmin/vmax, and x^y^y is x
2026-03-27 23:23:27 -04:00
qazal
ccaa6bfc19 viz/cli cleanups (#15511)
* one less function

* work

* layout

* better handling of rewrites

* mypy passes
2026-03-28 08:50:38 +09:00
qazal
dcc2a5d23b viz/cli: simplify to --source and --item flags (#15510)
* viz/cli: simplify to --source and --item flags

* update viz cli test
2026-03-28 04:46:39 +09:00
nimlgen
0d6fc0f571 jit: graphing in uops (#15489)
* jit: graphing as rewrite rule

* f

* +metal,cuda

* x

* cl

* x

* x

* simpler

* f

* m

* x

* revert?

* revert2

* back

* back

* t

* x

* m

* x

* c

* x

* l

* x

* comment

* smaller

* rv

* x

* x
2026-03-27 19:09:02 +03:00
chenyu
30ebbe7f17 few more fold valid tests (#15509)
from remove CORRECT_DIVMOD_FOLDING attempt
2026-03-27 10:38:42 -04:00
Christopher Milan
9e0cc5c6ae create image buffers in late codegen (#15493) 2026-03-27 04:50:53 -04:00
chenyu
1198d6e908 move pow to mixin (#15507) 2026-03-27 03:16:40 -04:00
chenyu
323fcefd7d Revert "DEV is a ContextVar (#15505)" (#15506)
This reverts commit fdb30cba96.
2026-03-27 02:22:40 -04:00
Christopher Milan
fdb30cba96 DEV is a ContextVar (#15505) 2026-03-27 00:57:09 -04:00
wozeparrot
a65e958be9 llama: new apply_grad (#15503) 2026-03-26 19:39:25 -07:00
Christopher Milan
67a50fb738 move where on load with casts (#15492) 2026-03-26 22:11:27 -04:00
qazal
586c49642f viz/cli: test in CI (#15501)
* viz cli work

* baseline test

* make cli test work without subprocess

* more checks

* check itrace

* s/return/return None

* change

* minimal

* colored
2026-03-27 06:47:15 +09:00
qazal
3f9f0fa846 viz: yield sqtt alt events (#15500)
* yield other

* less

* work

* less
2026-03-27 04:43:41 +09:00
qazal
237c25031f sqtt: construct OTHER_SIMD op types with for loop (#15495)
* other-lds from amd_copy_matmul

* more other

* other simd work
2026-03-26 23:07:18 +09:00
nimlgen
7193f90746 test view input in jit (#15497)
* will anything fail?

* add test
2026-03-26 16:59:47 +03:00
nimlgen
de24b3fe37 jit: pass init params straight to base (#15496)
* jit: pass init params straight to base

* linter
2026-03-26 16:59:10 +03:00
qazal
ec5b7a249e viz: refactor sqtt timeline builder (#15494)
* viz: refactor sqtt timeline builder

* barrier maps to waves

* clean up cli
2026-03-26 21:16:15 +09:00
Christopher Milan
313937ad6d fix IMAGE TestEnd2End.test_linear_mnist (#15488) 2026-03-26 04:12:47 -04:00
Christopher Milan
bc180a963c deprecate <dev>=1 in favor of DEV=<dev> (#15467)
* start work on target

* add test

* update actions to use DEV

* update docs

* update readmes

* tests need that too

* update example

* update tests (comments)

* fix that test

* ruff

* mypy

* oops

* remove getenvs

* don't add Target yet

* and the test

* lint

* and docs

* more stuff

* assert

* few more fixes

* test assert
2026-03-26 03:48:03 -04:00
chenyu
8426f820a1 Tensor.sub to mixin (#15486)
also _broadcasted skipped broadcasting shape if it does not have shape
2026-03-25 23:20:56 -04:00