David Hou 3604642847 Llama shard axis 0 sometimes (#5123) ...

* make buffer view optional with a flag [run_process_replay]

* do not view when sharding to save memory [run_process_replay]

* llama shard axis=0 sometimes

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>
Co-authored-by: chenyu <chenyu@fastmail.com>

2024-06-26 10:35:25 -04:00

22 KiB

Executable File

Raw Blame History

View Raw