Eliasj42 dfdd3b1f78 improved sharded performance and fixed issue with lmhead on rocm (#2008) ...

* improved sharded performance and fixed issue with lmhead on rocm

* mmap shards + disable sharing of device arrays across devices

* fix device_idx for non-layer vmfbs

* fix time calc for sharded

---------

Co-authored-by: Elias Joseph <elias@nod-labs.com>
Co-authored-by: PhaneeshB <b.phaneesh@gmail.com>

2023-12-05 11:53:44 -08:00

..

dynamo_backend

Make the tensors contiguous.

2023-06-26 17:29:54 +05:30

examples

Add --additional_runtime_args option and use in OPT example. (#1855)

2023-10-19 13:29:39 -05:00

iree_utils

improved sharded performance and fixed issue with lmhead on rocm (#2008)

2023-12-05 11:53:44 -08:00

shark_eager

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

tests

Add stress test

2022-12-13 13:21:51 -08:00

__init__.py

Add the shark compile downstream due to https://github.com/pytorch/pytorch/pull/104185#issuecomment-1615110613 (#1615)

2023-07-01 08:30:58 -07:00

backward_makefx.py

Minor fixes for MiniLM Training

2023-07-18 17:16:44 +05:30

iree_eager_backend.py

[SharkInference] Make SharkInference compile the entire module (#708)

2023-01-03 23:25:23 +05:30

model_annotation.py

Revert "Re-enable SD tunings without matmuls. (#1976)" (#1979)

2023-11-17 23:44:33 +05:30

parser.py

Add --additional_runtime_args option and use in OPT example. (#1855)

2023-10-19 13:29:39 -05:00

shark_benchmark_runner.py

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

shark_compile.py

Update brevitas quant api (#1975)

2023-11-15 10:04:07 -08:00

shark_downloader.py

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

shark_generate_model_config.py

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

shark_importer.py

Create specified dir if needed during save_mlir and fix vulkan device fetching without URI/ID (#1989)

2023-11-23 01:01:41 -06:00

shark_inference.py

Add sharded Falcon support

2023-10-26 21:53:25 +05:30

shark_runner.py

Add sharded Falcon support

2023-10-26 21:53:25 +05:30

shark_trainer.py

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

stress_test.py

Fix concurrency issue in stress_test for CUDA devices

2022-12-22 08:54:19 -08:00

tflite_utils.py

Remove tf package dep for SharkDownloader tflite tests (#212)

2022-07-26 12:41:12 -07:00

torch_mlir_lockstep_tensor.py

[Lockstep] Hack to avoid aten._reshape_alias (#332)

2022-09-22 18:02:09 -04:00

torch_mlir_utils.py

Add mlir_type for torch_model_list.csv (#1428)

2023-05-15 10:23:54 -07:00