Ean Garvey
3514822cac
Improvements to pytest benchmarks. ( #267 )
...
* Add ONNX env var flags for venv setup.
* Setup arguments for ONNX benchmarking via pytest.
* Enable ONNX benchmarking on MiniLM via pytest (experimental)
* Fix sequence lengths to 128 for TF model creation and fix issue with benchmarks.
* Disable CI CPU benchmarks on A100, change some default args.
* add xfails for roberta TF model tests on GPU.
2022-08-17 02:29:48 -05:00
Ean Garvey
22ff92c48b
Add config.VmModule argument to from_flatbuffer call. ( #266 )
2022-08-14 15:11:19 -07:00
powderluv
c2aa451767
Update test-models.yml
2022-08-09 10:12:59 -07:00
Ean Garvey
6f5ceb4e61
Update test-models.yml ( #244 )
2022-08-04 21:56:08 -07:00
Ean Garvey
6c22139ac9
Upload benchmark results for every test-models workflow (excl. Vulkan) ( #241 )
...
* Upload benchmark results for every test-models workflow (excl. Vulkan)
2022-08-04 14:43:07 -07:00
powderluv
c6b4ad1e26
Update test-models.yml
2022-08-02 13:19:10 -07:00
Phaneesh Barwaria
198755788c
Check for MacStudio Target Value ( #233 )
...
* Identify Apple M2 for Vulkan
* Check for MacOS Target
2022-08-02 13:18:36 -07:00
Ean Garvey
0ee515a7be
Fix GPU benchmarks on PyTorch model tests. ( #218 )
...
* Add CUDA_BENCHMARKS option to setup.venv to enable PyTorch benchmarks on CUDA.
* Fix PyTorch GPU benchmarks for tank models.
2022-07-29 15:17:55 -07:00
Daniel Garvey
4c0deb9899
remove gpu script ( #220 )
...
No longer needed after fixes in iree
2022-07-29 15:20:03 -05:00
Ean Garvey
921ccdc40b
Force TensorFlow to use CPU when generating model and golden values. ( #199 )
...
Split up gpu pytest runs temporarily
2022-07-22 20:21:16 -07:00
Ean Garvey
d047eff086
Update test-models.yml
2022-07-16 16:38:32 -05:00
monorimet
5da32601c0
Ensure CPU workflow job suite only collects CPU tests.
2022-07-16 13:50:36 -05:00
Prashant Kumar
0dcf387089
Add shark_importer for torch_models. ( #183 )
...
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
2022-07-12 20:38:19 -07:00
powderluv
c351bb50b6
Update test-models.yml
2022-07-03 13:56:45 -07:00
powderluv
ca36d40f0a
Update test-models.yml
2022-07-01 12:27:49 -07:00
powderluv
cc11a71ec8
Update test-models.yml
2022-06-30 18:55:38 -07:00
powderluv
1d1a1b131f
Update test-models.yml
2022-06-30 18:54:50 -07:00
powderluv
84a2969381
Update test-models.yml
2022-06-30 15:57:07 -07:00
powderluv
8199ea15e8
Update test-models.yml
2022-06-30 14:42:41 -07:00
powderluv
958e0100bf
Update test-models.yml
2022-06-30 14:41:26 -07:00
powderluv
6ca726615e
Update test-models.yml
2022-06-30 14:40:25 -07:00
powderluv
d1b398cb9b
Update test-models.yml
2022-06-30 14:28:37 -07:00
powderluv
6b0bd7181f
Update test-models.yml
2022-06-30 14:20:30 -07:00
powderluv
b24ce861d0
Update test-models.yml
2022-06-30 14:14:49 -07:00
powderluv
79e392d85f
enable pip cache
2022-06-30 14:11:00 -07:00
powderluv
a064a32755
Update test-models.yml
2022-06-30 13:53:19 -07:00
powderluv
24ba2bcdc8
Update test-models.yml
2022-06-30 13:50:54 -07:00
powderluv
cf4d363436
Update test-models.yml
2022-06-30 13:38:31 -07:00
powderluv
b012b9a5f7
Update test-models.yml
2022-06-30 13:37:16 -07:00
powderluv
9556060c27
Update test-models.yml
2022-06-30 13:23:20 -07:00
powderluv
1841fcc088
Update test-models.yml
2022-06-30 13:11:11 -07:00
powderluv
36e2f80fdb
Update test-models.yml
2022-06-30 13:07:36 -07:00
powderluv
188ec5431f
update to matrix builds
2022-06-30 13:04:02 -07:00
powderluv
7532a8db0c
Update test-models.yml
2022-06-30 00:44:08 -07:00
powderluv
6ed957f5fb
enable fast fail
2022-06-30 00:35:00 -07:00
Chi_Liu
2adea76b8c
Enable SharkImporter Tests ( #165 )
...
rewrite some tflite code from SharkImporter to tflite_utils.py
2022-06-29 10:11:48 -07:00
Prashant Kumar
e8aa105b2a
Divide iree_utils and do module imports on function calls.
2022-06-22 14:17:33 +05:30
powderluv
6bc9ebad24
Update test-models.yml
...
ignore onnx benchmarks for now
2022-06-21 13:12:59 -07:00
powderluv
0093610054
Update test-models.yml
...
disable a100 cpu for now
2022-06-16 16:27:11 -07:00
powderluv
918b36c177
Split perf-builder into cpu/gpu/vulkan
2022-06-16 14:08:36 -07:00
powderluv
334b50b963
Update test-models.yml
2022-06-16 07:44:20 -07:00
Prashant Kumar
4d3acff484
Add tf masked lm models (17 models - 12 pass, 5 fail). ( #135 )
2022-06-16 07:28:00 -07:00
Stanley Winata
95c2e3d6ea
Enable Benchmark tests ( #129 )
2022-06-14 14:05:26 -07:00
powderluv
cb7007ce16
Update test-models.yml
...
remove pip cache hang on osx and enable benchmarks on perf-linux
2022-06-14 12:23:07 -07:00
Stanley Winata
e48642f8a5
Update benchmark command to ToM and Add to test ( #125 )
...
-Update benchmark_cl to latest benchmark_module API
-tensorflow OOM issue.
2022-06-13 23:57:05 -07:00
powderluv
3cbd697aa6
Update test-models.yml
2022-06-13 09:12:26 -07:00
Ean Garvey
acdd1d1785
Update model testing utilities. ( #119 )
2022-06-13 02:16:30 -07:00
Ean Garvey
cbd131d588
Refactor testing framework. ( #117 )
2022-06-12 20:15:30 -07:00
powderluv
bcf9dbb3bf
Update test-models.yml
2022-06-12 17:28:18 -07:00
powderluv
ac84f3b0d5
Update test-models.yml
2022-06-12 17:08:00 -07:00