Abhishek Varma 9a0efffcca [Llama2] Fix wrong Vulkan device ID + Add Vulkan compile flags ...

-- This commit fixes the wrong Vulkan device being selected during
   runtime.
-- It also adds couple of IREE compilation flags to target specific
   Vulkan device.
-- It also changes the Vulkan device listing to be more in tune with
   lowering control flow.

Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>

2023-09-22 22:24:18 +05:30

..

dynamo_backend

Make the tensors contiguous.

2023-06-26 17:29:54 +05:30

examples

Add Forward method to SHARKRunner and fix examples. (#1756)

2023-08-14 19:20:37 -07:00

iree_utils

[Llama2] Fix wrong Vulkan device ID + Add Vulkan compile flags

2023-09-22 22:24:18 +05:30

shark_eager

Add shark_eager mode.

2023-06-22 22:59:14 +05:30

tests

Add stress test

2022-12-13 13:21:51 -08:00

__init__.py

Add the shark compile downstream due to https://github.com/pytorch/pytorch/pull/104185#issuecomment-1615110613 (#1615)

2023-07-01 08:30:58 -07:00

backward_makefx.py

Minor fixes for MiniLM Training

2023-07-18 17:16:44 +05:30

iree_eager_backend.py

[SharkInference] Make SharkInference compile the entire module (#708)

2023-01-03 23:25:23 +05:30

model_annotation.py

Modify the lowering config format for SPIRVMatmulPromoteVectorize pipeline (#1471)

2023-05-29 21:53:48 -07:00

parser.py

Add argument --additional_compile_args (#1119)

2023-09-19 11:26:03 -05:00

shark_benchmark_runner.py

Fix pytest benchmarks and shark_tank generation. (#1632)

2023-08-16 17:48:47 -05:00

shark_compile.py

Update conversion passes for brevitas quant op (#1795)

2023-08-25 17:28:07 -05:00

shark_downloader.py

fix name check for file existence

2023-08-05 21:33:53 +05:30

shark_generate_model_config.py

Add Llama2 13B int4 fp16 support (#1784)

2023-08-23 10:00:32 -07:00

shark_importer.py

Update decomp list and shark trainer for DLRM

2023-09-06 21:24:50 +05:30

shark_inference.py

Pipe through a debug option to iree compile utils. (#1796)

2023-08-25 07:11:11 -07:00

shark_runner.py

[SharkInference-SharkRuntime] Adds capability to mmap vmfbs

2023-06-22 20:43:40 +05:30

shark_trainer.py

Update decomp list and shark trainer for DLRM

2023-09-06 21:24:50 +05:30

stress_test.py

Fix concurrency issue in stress_test for CUDA devices

2022-12-22 08:54:19 -08:00

tflite_utils.py

Remove tf package dep for SharkDownloader tflite tests (#212)

2022-07-26 12:41:12 -07:00

torch_mlir_lockstep_tensor.py

[Lockstep] Hack to avoid aten._reshape_alias (#332)

2022-09-22 18:02:09 -04:00

torch_mlir_utils.py

Add mlir_type for torch_model_list.csv (#1428)

2023-05-15 10:23:54 -07:00