github/AMD-SHARK-Studio
1
1
Fork 0
mirror of https://github.com/nod-ai/AMD-SHARK-Studio.git synced 2026-02-19 11:56:43 -05:00
Code Issues Packages Projects Releases Wiki Activity
415 Commits 66 Branches 705 Tags
RefVideo
Commit Graph

87 Commits

Author SHA1 Message Date
Stanley Winata
b73f79be66 Add Substantial testing for IntelGPU 2022-08-18 21:21:43 -07:00
Ean Garvey
a3654f33da Fix sourcing for canonical MiniLM shark_tank model artifacts. (#278) 
* Fix generation of MiniLM artifacts.

* Fix miniLM output for validation. Xfail numerics failure on mpnet.

* Update distilbert-base-uncased_tf_test.py

* try-except for transition of minilm model
 2022-08-17 23:03:47 -05:00
Stanley Winata
55bcb2eb3c Level Zero Backend (#280) 2022-08-17 19:19:27 -07:00
Vivek Khandelwal
03601ccdd6 Add v_diffusion_pytorch model in shark/tank (#271) 2022-08-17 22:53:31 +05:30
Ean Garvey
3514822cac Improvements to pytest benchmarks. (#267) 
* Add ONNX env var flags for venv setup.

* Setup arguments for ONNX benchmarking via pytest.

* Enable ONNX benchmarking on MiniLM via pytest (experimental)

* Fix sequence lengths to 128 for TF model creation and fix issue with benchmarks.

* Disable CI CPU benchmarks on A100, change some default args.

* add xfails for roberta TF model tests on GPU.
 2022-08-17 02:29:48 -05:00
Ean Garvey
a8b021dc8d Add benchmarks to MHLO miniLM and resnet50 and add dialect, num_iterations (#264) 2022-08-16 13:55:40 -05:00
Ean Garvey
3e900d2b25 Change Resnet50 directory names. (#263) 2022-08-12 16:10:59 -07:00
Ean Garvey
4b5d09fc6c Add TF ResNet50 to tank tests. (#261) 
* Add TensorFlow Resnet50 test to shark tank.
 2022-08-12 09:20:43 -07:00
powderluv
f7f24dc4d9 Revert "Add Debug log of torch_model_blacklist.txt (#242)" (#249) 
This reverts commit 7023d556b5.
 2022-08-09 10:23:14 -07:00
Chi_Liu
7023d556b5 Add Debug log of torch_model_blacklist.txt (#242) 
* Add debug log of torch_model_blacklist.txt

* Add make_fx for torch model

* Update torch_model_blacklists.txt

* Add some Xfails
 2022-08-09 17:54:02 +05:30
Prashant Kumar
d934765b1d Add mobilenet_v3_small torch model to the test_suite. 
-- The model doesn't validate with the correct results on the GPU.
-- The model passes on CPU and levelzero.
-- The static version of the model gets stuck for vulkan.
 2022-08-05 14:10:43 +05:30
Daniel Garvey
7dc0a4f74d fine tune with shark (#211) 2022-08-04 13:14:57 -05:00
Chi_Liu
90fddc6cb0 Add more torch hg model tests (#238) 2022-08-03 18:00:04 -07:00
Chi_Liu
abce0b1c91 Move torch tests up to /tank (#234) 2022-08-03 10:50:53 -07:00
Phaneesh Barwaria
189466bbe4 Mark XFail for M1 Vulkan Failures (#235) 2022-08-02 19:56:02 -07:00
Ean Garvey
c1a14a8db1 Update wide_resnet50_2_test.py (#229) 
Removed old xfails.
 2022-08-01 20:38:53 -05:00
Chi_Liu
0e42c19f33 Test tflite quantization_info fail on cloud (#228) 2022-08-01 18:21:04 -07:00
Chi_Liu
0c31bb82cd Add hash of mlir for tf/tflite (#225) 2022-08-01 10:40:49 -07:00
Ean Garvey
0ee515a7be Fix GPU benchmarks on PyTorch model tests. (#218) 
* Add CUDA_BENCHMARKS option to setup.venv to enable PyTorch benchmarks on CUDA.

* Fix PyTorch GPU benchmarks for tank models.
 2022-07-29 15:17:55 -07:00
Daniel Garvey
4c0deb9899 remove gpu script (#220) 
No longer needed after fixes in iree
 2022-07-29 15:20:03 -05:00
Chi_Liu
94d9275515 Move tf tests to tank/ (#223) 2022-07-29 09:34:50 -07:00
Chi_Liu
2c7d879a4e Add tf image classification auto model tests (#216) 2022-07-27 18:38:13 -07:00
Chi_Liu
af4257d05f Add tf image classification auto model (#213) 2022-07-26 23:18:42 -07:00
Chi_Liu
dc1a283ab7 Remove tf package dep for SharkDownloader tflite tests (#212) 2022-07-26 12:41:12 -07:00
Vivek Khandelwal
cc4fa96831 Remove op decomposition from the v_diffusion.py (#210) 
The PyTorch decomposition for the op `aten.upsample_bilinear2d.vec`
is merged in the upstream repo and hence removed from this file.
 2022-07-25 17:36:26 +05:30
Ean Garvey
921ccdc40b Force TensorFlow to use CPU when generating model and golden values. (#199) 
Split up gpu pytest runs temporarily
 2022-07-22 20:21:16 -07:00
Prashant Kumar
49fc6d2f4b Add all the tf models to gs::shark_tank. (#207) 
-- Tensorflow models have been imported to shark_tank.
-- TF Tests have been updated to use the downloader.
 2022-07-22 11:53:07 -05:00
Prashant Kumar
e62c531170 Update the torch_model for dynamic cases. 2022-07-22 00:21:35 +05:30
Prashant Kumar
3c2f8ef243 Generate shark_tank for tensorflow models. 
Updated the generate_sharktank.py script to give tensorflow models.
 2022-07-20 22:37:14 +05:30
Vivek Khandelwal
0e2485d85b Add v-diffusion model 2022-07-20 21:36:42 +05:30
Ean Garvey
6401687733 Update TF pytest marks and fix benchmark runner import. (#196) 2022-07-19 15:42:32 -05:00
Ean Garvey
c5ae01311d Make PyTorch model tests importer-independent and add benchmarks. 2022-07-15 21:54:41 -05:00
Chi_Liu
8434c67d96 Change tflite tests from sharkimporter -> sharkdownloader (#182) 
* Change tflite test from sharkimporter -> sharkdownloader

* xfail all uint/int tflite sharkdownloader tests
 2022-07-14 13:40:25 -07:00
monorimet
08448a013f Refactor TF tests for importer split, update pytorch tests. 2022-07-14 12:59:21 -05:00
Prashant Kumar
0dcf387089 Add shark_importer for torch_models. (#183) 
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
 2022-07-12 20:38:19 -07:00
Prashant Kumar
2e22d0b690 Bug fix: Pass the device attribute appropriately. 
Previously the device attribute was not passed and device was
hardcoded to "cpu". So every tests were running on cpu.
 2022-07-09 01:56:17 +05:30
Chi_Liu
b98c9ee484 torch fix in gen_shark_tank (#180) 2022-07-08 10:13:58 -07:00
Prashant Kumar
fa7ee7e099 Update pytorch tests to support vulkan and cuda. 
All the model validation pass except distilbert which is failing
in torch-mlir lowering. Also, added the mobilebert-uncased model to
the torch test suite.
 2022-07-08 14:40:13 +05:30
Chi_Liu
d496c66d11 Torch support of gen_shark_tank (#175) 2022-07-06 22:42:15 -07:00
Chi_Liu
1cad50d521 generate shark tank for tflite (#173) 
* Add gen_shark_tank support tflite

* gen_shark_tank.py use SharkImporter to save model
 2022-07-05 23:11:19 -07:00
Chi_Liu
4e9e35a9ff Fix mobilebert return bug (#171) 2022-07-01 05:46:18 -07:00
Chi_Liu
41a8cbb5b6 Fix deeplab&mobilebert tflite test bug (#170) 2022-06-30 21:42:14 -07:00
Chi Liu
c1cde2e252 Add xfail with sys.platform == "darwin" for mac 2022-06-30 15:17:59 -07:00
Chi Liu
638f982c94 Add Xfail for tflites exampls 
Know  Macos iree-tflite install error
 2022-06-30 15:02:05 -07:00
Chi Liu
84978cf3c5 Fix tflite examples fail pytest 2022-06-30 14:57:33 -07:00
Chi Liu
96dd08cca4 Fix load json input bug in SharkDownloader albert test 2022-06-30 14:57:33 -07:00
Chi Liu
06a45d9025 Rewrite tflite SharkImporter tests to compatible to most recent SharkImporter 2022-06-30 14:57:33 -07:00
Chi Liu
193a735865 Move tflite examples to up dir 2022-06-30 14:57:33 -07:00
Anush Elangovan
a7435973d9 Fix black formatting 2022-06-30 20:42:02 +00:00
Chi_Liu
2adea76b8c Enable SharkImporter Tests (#165) 
rewrite some tflite code from SharkImporter to tflite_utils.py
 2022-06-29 10:11:48 -07:00