github/SHARK-Studio
1
1
Fork 0
mirror of https://github.com/nod-ai/SHARK-Studio.git synced 2026-01-12 23:38:12 -05:00
Code Issues Packages Projects Releases Wiki Activity
415 Commits 66 Branches 705 Tags
RefVideo
Commit Graph

133 Commits

Author SHA1 Message Date
Daniel Garvey
1a85550879 fix nightly upload check (#277) 2022-08-17 14:31:15 -05:00
Ean Garvey
3514822cac Improvements to pytest benchmarks. (#267) 
* Add ONNX env var flags for venv setup.

* Setup arguments for ONNX benchmarking via pytest.

* Enable ONNX benchmarking on MiniLM via pytest (experimental)

* Fix sequence lengths to 128 for TF model creation and fix issue with benchmarks.

* Disable CI CPU benchmarks on A100, change some default args.

* add xfails for roberta TF model tests on GPU.
 2022-08-17 02:29:48 -05:00
Daniel Garvey
5e931debd5 Sharktank-ci (#262) 2022-08-15 13:32:24 -05:00
Ean Garvey
22ff92c48b Add config.VmModule argument to from_flatbuffer call. (#266) 2022-08-14 15:11:19 -07:00
powderluv
7f5aaa3477 Update nightly.yml 2022-08-14 12:22:50 -07:00
powderluv
904e0e1444 Update nightly.yml 2022-08-14 09:57:10 -07:00
Daniel Garvey
e8482d47f5 split nightly pytest commands (#259) 
prevents oom
 2022-08-12 16:11:46 -07:00
powderluv
c2aa451767 Update test-models.yml 2022-08-09 10:12:59 -07:00
powderluv
274650fd43 Update nightly.yml 
Add tests for USE_IREE=1
 2022-08-07 00:06:11 -07:00
Ean Garvey
6f5ceb4e61 Update test-models.yml (#244) 2022-08-04 21:56:08 -07:00
Ean Garvey
6c22139ac9 Upload benchmark results for every test-models workflow (excl. Vulkan) (#241) 
* Upload benchmark results for every test-models workflow (excl. Vulkan)
 2022-08-04 14:43:07 -07:00
powderluv
c6b4ad1e26 Update test-models.yml 2022-08-02 13:19:10 -07:00
Phaneesh Barwaria
198755788c Check for MacStudio Target Value (#233) 
* Identify Apple M2 for Vulkan

* Check for MacOS Target
 2022-08-02 13:18:36 -07:00
Ean Garvey
d556c0d6ef Update nightly.yml to remove IMPORTER=1 in package validation. (#226) 
* Update nightly.yml to fix wheel building issues.

* Update setup_venv.sh to only install torch+cu116 if IMPORTER=1 is set.
 2022-07-31 20:39:59 -07:00
Ean Garvey
0ee515a7be Fix GPU benchmarks on PyTorch model tests. (#218) 
* Add CUDA_BENCHMARKS option to setup.venv to enable PyTorch benchmarks on CUDA.

* Fix PyTorch GPU benchmarks for tank models.
 2022-07-29 15:17:55 -07:00
Daniel Garvey
4c0deb9899 remove gpu script (#220) 
No longer needed after fixes in iree
 2022-07-29 15:20:03 -05:00
Ean Garvey
921ccdc40b Force TensorFlow to use CPU when generating model and golden values. (#199) 
Split up gpu pytest runs temporarily
 2022-07-22 20:21:16 -07:00
Ean Garvey
d047eff086 Update test-models.yml 2022-07-16 16:38:32 -05:00
monorimet
5da32601c0 Ensure CPU workflow job suite only collects CPU tests. 2022-07-16 13:50:36 -05:00
Prashant Kumar
0dcf387089 Add shark_importer for torch_models. (#183) 
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
 2022-07-12 20:38:19 -07:00
powderluv
c351bb50b6 Update test-models.yml 2022-07-03 13:56:45 -07:00
powderluv
ca36d40f0a Update test-models.yml 2022-07-01 12:27:49 -07:00
powderluv
cc11a71ec8 Update test-models.yml 2022-06-30 18:55:38 -07:00
powderluv
1d1a1b131f Update test-models.yml 2022-06-30 18:54:50 -07:00
powderluv
84a2969381 Update test-models.yml 2022-06-30 15:57:07 -07:00
powderluv
8199ea15e8 Update test-models.yml 2022-06-30 14:42:41 -07:00
powderluv
958e0100bf Update test-models.yml 2022-06-30 14:41:26 -07:00
powderluv
6ca726615e Update test-models.yml 2022-06-30 14:40:25 -07:00
powderluv
d1b398cb9b Update test-models.yml 2022-06-30 14:28:37 -07:00
powderluv
6b0bd7181f Update test-models.yml 2022-06-30 14:20:30 -07:00
powderluv
b24ce861d0 Update test-models.yml 2022-06-30 14:14:49 -07:00
powderluv
79e392d85f enable pip cache 2022-06-30 14:11:00 -07:00
powderluv
a064a32755 Update test-models.yml 2022-06-30 13:53:19 -07:00
powderluv
24ba2bcdc8 Update test-models.yml 2022-06-30 13:50:54 -07:00
powderluv
cf4d363436 Update test-models.yml 2022-06-30 13:38:31 -07:00
powderluv
b012b9a5f7 Update test-models.yml 2022-06-30 13:37:16 -07:00
powderluv
9556060c27 Update test-models.yml 2022-06-30 13:23:20 -07:00
powderluv
1841fcc088 Update test-models.yml 2022-06-30 13:11:11 -07:00
powderluv
36e2f80fdb Update test-models.yml 2022-06-30 13:07:36 -07:00
powderluv
188ec5431f update to matrix builds 2022-06-30 13:04:02 -07:00
powderluv
7532a8db0c Update test-models.yml 2022-06-30 00:44:08 -07:00
powderluv
6ed957f5fb enable fast fail 2022-06-30 00:35:00 -07:00
powderluv
b01ffb5a22 delete black builder 2022-06-30 00:33:14 -07:00
Chi_Liu
2adea76b8c Enable SharkImporter Tests (#165) 
rewrite some tflite code from SharkImporter to tflite_utils.py
 2022-06-29 10:11:48 -07:00
Prashant Kumar
e8aa105b2a Divide iree_utils and do module imports on function calls. 2022-06-22 14:17:33 +05:30
powderluv
6bc9ebad24 Update test-models.yml 
ignore onnx benchmarks for now
 2022-06-21 13:12:59 -07:00
powderluv
0093610054 Update test-models.yml 
disable a100 cpu for now
 2022-06-16 16:27:11 -07:00
powderluv
918b36c177 Split perf-builder into cpu/gpu/vulkan 2022-06-16 14:08:36 -07:00
powderluv
334b50b963 Update test-models.yml 2022-06-16 07:44:20 -07:00
Prashant Kumar
4d3acff484 Add tf masked lm models (17 models - 12 pass, 5 fail). (#135) 2022-06-16 07:28:00 -07:00