github/AMD-SHARK-Studio
1
1
Fork 0
mirror of https://github.com/nod-ai/AMD-SHARK-Studio.git synced 2026-04-03 03:00:17 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,745 Commits 66 Branches 705 Tags
debug
Commit Graph

219 Commits

Author SHA1 Message Date
Ean Garvey
9956099516 Add pytest option for updating tank and fix save_mlir function. (#413) 
* Use IREE tf tools to save .mlir modules when generating shark_tank.

* Add option to pytest for enabling auto-updates to local shark tank.

* xfail mobilenet torch on cpu, cuda and fix CI macos setup

* Update test-models.yml to disable macos vulkan CI.
 2022-10-25 21:29:18 +05:30
Ean Garvey
3fba8ce0e6 Update README.md (#405) 2022-10-13 12:43:03 -07:00
Ean Garvey
f3bde3c7fc Cleanup tank directory and move instructions to tank/README.md (#401) 2022-10-13 12:20:02 -05:00
Phaneesh Barwaria
00a8ce75d1 Xfail vulkan tests and Enable MacOs test on CI (#383) 2022-10-13 11:14:41 -05:00
Ean Garvey
13bae2538a Update URL for IREE compiler/runtime install (#397) 
* Update URL for IREE compiler/runtime install

* Update gh-pages-releases.yml

* Update test_models.py

* Update assets path
 2022-10-12 15:47:11 -05:00
Ean Garvey
f508c80c23 Add workflow for GH pages releases and release scraping script. (#394) 
* Add workflow for GH pages releases and release scraping script.

* Update test_models.py and change tokens for gh pages.
 2022-10-11 22:03:33 -05:00
gpetters94
53df0620e3 Add OPT to tank (#214) 2022-10-11 11:03:56 -05:00
Ean Garvey
3618fb3ada Move old test scripts out of base tank directory and add xfails. (#389) 2022-10-07 16:02:46 -07:00
Ean Garvey
006adf8746 Fix issue with FASTAPI pip install. (#382) 2022-10-01 14:55:24 -05:00
Ean Garvey
9035a2eed3 Add --local_tank_cache flag and update requirements. (#368) 
* Add --local_tank_cache flag and update requirements.

* Update requirements-importer.txt
 2022-09-28 03:02:59 -05:00
Ean Garvey
cbf3f784aa Add pytest option to specify a URL for shark tank artifacts. (#363) 
* Xfail updates.

* Generalize tank SHA option to bucket address and add pytest option.
 2022-09-27 02:40:40 -05:00
Ean Garvey
de23e5d9d7 update xfails for PyTorch DistilBERT (#355) 2022-09-24 14:53:20 -05:00
Vivek Khandelwal
93ebe07d2b Add bert_tosa script 2022-09-23 10:52:06 +05:30
Ean Garvey
c0f3a09a40 Include SHA in path to failure reproducers. Add --save_fails option. (#352) 2022-09-21 17:55:06 -05:00
Ean Garvey
c061a8897d Add pytest options to save reproducers. (#350) 
* Add pytest options to save and/or upload reproducers.

* pass shark_module to benchmark method.
 2022-09-20 20:29:46 -05:00
Ean Garvey
4253551b67 Update README with new testing instructions and filter test cases. (#349) 2022-09-20 15:55:46 -05:00
Vivek Khandelwal
e4991c049e Add Readme file for the bloom model 2022-09-20 20:27:52 +05:30
Daniel Garvey
5df582e7e8 creates abstract test case class (#333) 2022-09-20 07:06:38 -07:00
Vivek Khandelwal
7013c3cd4a Add bloom e2e script 2022-09-20 10:56:04 +05:30
Quinn Dawkins
9bd951b083 Clean up the v-diffusion install pipeline (#327) 2022-09-16 11:47:07 -04:00
Ean Garvey
6cf5564c84 Remove "gpu" device alias and migrate to using "cuda" for NVIDIA GPU. (#325) 
* Replace instances of "gpu" alias for devices with "cuda"
 2022-09-13 01:16:56 -05:00
Ean Garvey
1710abd366 Update mobilenet_v3_small_torch_test.py (#322) 2022-09-10 15:22:57 -05:00
Stanley Winata
95ec3d7216 [tank][v-diffusion] Polish up v-diffusion UX (#315) 2022-09-08 12:55:51 -07:00
Ean Garvey
3824d37d27 Add metadata to benchmark results. (#297) 2022-09-06 13:03:48 -05:00
Ean Garvey
d946287723 Update xfails for torchvision models. (#310) 2022-09-01 13:06:12 -05:00
Vivek Khandelwal
4afe2e3adb Add func to save intermediate images in v_diffusion_pytorch 2022-09-01 18:36:58 +05:30
Quinn Dawkins
3703f014d9 Add scripts for generating images on ats-m (#305) 2022-08-31 23:07:02 -07:00
Quinn Dawkins
99be837d84 Add lockstep tracer based on TorchMLIR eager mode + examples (#243) 2022-08-31 15:50:24 -04:00
Quinn Dawkins
b7766898ee Add cfg sampling from tank model for v-diffusion and move compilation outside of the sampling loop (#302) 2022-08-31 11:35:04 -07:00
Phaneesh Barwaria
1322ec5935 Simplified Testing Interface (#289) 2022-08-24 23:54:56 -05:00
Daniel Garvey
48e9818f7e adds support to default to tuned model (#287) 
currently setup for tf bert/resnet50
going to refactor test class to avoid having to
add an argument to 50+ files
 2022-08-24 16:30:02 -05:00
Vivek Khandelwal
f79a6bf5aa Update setup_v_diffusion_pytorch.sh (#291) 
Fix minor issue with v-diffusion PyTorch version
 2022-08-24 22:00:02 +05:30
Chi_Liu
17dba601c8 Add huggingface top5 image classification automodel (#268) 2022-08-22 15:05:38 -07:00
Ean Garvey
a3654f33da Fix sourcing for canonical MiniLM shark_tank model artifacts. (#278) 
* Fix generation of MiniLM artifacts.

* Fix miniLM output for validation. Xfail numerics failure on mpnet.

* Update distilbert-base-uncased_tf_test.py

* try-except for transition of minilm model
 2022-08-17 23:03:47 -05:00
Stanley Winata
55bcb2eb3c Level Zero Backend (#280) 2022-08-17 19:19:27 -07:00
Vivek Khandelwal
03601ccdd6 Add v_diffusion_pytorch model in shark/tank (#271) 2022-08-17 22:53:31 +05:30
Ean Garvey
3514822cac Improvements to pytest benchmarks. (#267) 
* Add ONNX env var flags for venv setup.

* Setup arguments for ONNX benchmarking via pytest.

* Enable ONNX benchmarking on MiniLM via pytest (experimental)

* Fix sequence lengths to 128 for TF model creation and fix issue with benchmarks.

* Disable CI CPU benchmarks on A100, change some default args.

* add xfails for roberta TF model tests on GPU.
 2022-08-17 02:29:48 -05:00
Ean Garvey
a8b021dc8d Add benchmarks to MHLO miniLM and resnet50 and add dialect, num_iterations (#264) 2022-08-16 13:55:40 -05:00
Ean Garvey
3e900d2b25 Change Resnet50 directory names. (#263) 2022-08-12 16:10:59 -07:00
Ean Garvey
4b5d09fc6c Add TF ResNet50 to tank tests. (#261) 
* Add TensorFlow Resnet50 test to shark tank.
 2022-08-12 09:20:43 -07:00
powderluv
f7f24dc4d9 Revert "Add Debug log of torch_model_blacklist.txt (#242)" (#249) 
This reverts commit 7023d556b5.
 2022-08-09 10:23:14 -07:00
Chi_Liu
7023d556b5 Add Debug log of torch_model_blacklist.txt (#242) 
* Add debug log of torch_model_blacklist.txt

* Add make_fx for torch model

* Update torch_model_blacklists.txt

* Add some Xfails
 2022-08-09 17:54:02 +05:30
Prashant Kumar
d934765b1d Add mobilenet_v3_small torch model to the test_suite. 
-- The model doesn't validate with the correct results on the GPU.
-- The model passes on CPU and levelzero.
-- The static version of the model gets stuck for vulkan.
 2022-08-05 14:10:43 +05:30
Daniel Garvey
7dc0a4f74d fine tune with shark (#211) 2022-08-04 13:14:57 -05:00
Chi_Liu
90fddc6cb0 Add more torch hg model tests (#238) 2022-08-03 18:00:04 -07:00
Chi_Liu
abce0b1c91 Move torch tests up to /tank (#234) 2022-08-03 10:50:53 -07:00
Phaneesh Barwaria
189466bbe4 Mark XFail for M1 Vulkan Failures (#235) 2022-08-02 19:56:02 -07:00
Ean Garvey
c1a14a8db1 Update wide_resnet50_2_test.py (#229) 
Removed old xfails.
 2022-08-01 20:38:53 -05:00
Chi_Liu
0e42c19f33 Test tflite quantization_info fail on cloud (#228) 2022-08-01 18:21:04 -07:00
Chi_Liu
0c31bb82cd Add hash of mlir for tf/tflite (#225) 2022-08-01 10:40:49 -07:00