Ean Garvey 96b1560da5 Make batch size configurable via pytest and fix sharktank generation. (#1227) ...

* Fix sharktank generation and add batch_size pytest option for torch.

* Disable torch dynamo until py3.11 supported

* Compile torchmodel without dynamo if torch.compile fails

* Use release versions of TF/Keras for importer.

* Pin torchvision and remove debug prints.

* Remove duplicates from torch model list.

* Update generate_sharktank.py

* xfail a few models that fail sharktank generation/ numerics

2023-03-28 14:33:39 -05:00

..

examples

Update README.md

2023-03-12 16:54:42 -07:00

iree_utils

Remove deprecated cli option iree-hal-cuda-disable-loop-nounroll-wa (#1235)

2023-03-22 12:05:15 -05:00

sharkdynamo

Incorporate latest changes in the shark_dynamo backend.

2023-02-08 20:37:30 +05:30

tests

Add stress test

2022-12-13 13:21:51 -08:00

__init__.py

Modify the directory structure to remove conflicts.

2022-04-04 21:23:33 +05:30

backward_makefx.py

Add shark_importer for torch_models. (#183)

2022-07-12 20:38:19 -07:00

iree_eager_backend.py

[SharkInference] Make SharkInference compile the entire module (#708)

2023-01-03 23:25:23 +05:30

model_annotation.py

Fix CUDA tuned model annotation (#880)

2023-01-27 11:35:18 -08:00

parser.py

Add flag to augment the device allocator (#1182)

2023-03-13 15:49:26 -07:00

shark_benchmark_runner.py

Make batch size configurable via pytest and fix sharktank generation. (#1227)

2023-03-28 14:33:39 -05:00

shark_downloader.py

Make batch size configurable via pytest and fix sharktank generation. (#1227)

2023-03-28 14:33:39 -05:00

shark_importer.py

Add fix for attention slicing fp16 (#1217)

2023-03-20 19:11:29 -07:00

shark_inference.py

Fix formatting issues. (#903)

2023-02-01 09:12:45 +05:30

shark_runner.py

added ability to select gpu (#891)

2023-01-30 13:39:12 -08:00

shark_trainer.py

[Shark][Training] Refresh SharkTrainer to latest APIs.

2023-01-19 20:30:15 +00:00

stress_test.py

Fix concurrency issue in stress_test for CUDA devices

2022-12-22 08:54:19 -08:00

tflite_utils.py

Remove tf package dep for SharkDownloader tflite tests (#212)

2022-07-26 12:41:12 -07:00

torch_mlir_lockstep_tensor.py

[Lockstep] Hack to avoid aten._reshape_alias (#332)

2022-09-22 18:02:09 -04:00

torch_mlir_utils.py

Remove unnecessary repro_dir / shark_tmp usage

2023-02-07 14:06:07 +05:30