chenyu a753c8e071 examples of new GPT2 and JIT change (#2261) ...

* var_vals are global

* working with global ish

* better

* fix export model

* fix tests

* better kv cache

* does it run?

* use where for kvmask

* fix excessive var_vals

* fix import

* how does multigpu use this?

* llama kinda work

* faster and simpler

* cleanup

* fix conversation mode

* test cleanups

* fix one more test

* test cleanup

---------

Co-authored-by: George Hotz <geohot@gmail.com>

2023-11-10 15:07:02 -05:00

2.3 KiB

Raw Blame History

View Raw