Ean Garvey
a3654f33da
Fix sourcing for canonical MiniLM shark_tank model artifacts. ( #278 )
...
* Fix generation of MiniLM artifacts.
* Fix miniLM output for validation. Xfail numerics failure on mpnet.
* Update distilbert-base-uncased_tf_test.py
* try-except for transition of minilm model
2022-08-17 23:03:47 -05:00
Ean Garvey
a8b021dc8d
Add benchmarks to MHLO miniLM and resnet50 and add dialect, num_iterations ( #264 )
2022-08-16 13:55:40 -05:00
Ean Garvey
4b5d09fc6c
Add TF ResNet50 to tank tests. ( #261 )
...
* Add TensorFlow Resnet50 test to shark tank.
2022-08-12 09:20:43 -07:00
Chi_Liu
0c31bb82cd
Add hash of mlir for tf/tflite ( #225 )
2022-08-01 10:40:49 -07:00
Ean Garvey
0ee515a7be
Fix GPU benchmarks on PyTorch model tests. ( #218 )
...
* Add CUDA_BENCHMARKS option to setup.venv to enable PyTorch benchmarks on CUDA.
* Fix PyTorch GPU benchmarks for tank models.
2022-07-29 15:17:55 -07:00
Chi_Liu
94d9275515
Move tf tests to tank/ ( #223 )
2022-07-29 09:34:50 -07:00
Chi_Liu
2c7d879a4e
Add tf image classification auto model tests ( #216 )
2022-07-27 18:38:13 -07:00
Chi_Liu
af4257d05f
Add tf image classification auto model ( #213 )
2022-07-26 23:18:42 -07:00
Ean Garvey
921ccdc40b
Force TensorFlow to use CPU when generating model and golden values. ( #199 )
...
Split up gpu pytest runs temporarily
2022-07-22 20:21:16 -07:00
Prashant Kumar
49fc6d2f4b
Add all the tf models to gs::shark_tank. ( #207 )
...
-- Tensorflow models have been imported to shark_tank.
-- TF Tests have been updated to use the downloader.
2022-07-22 11:53:07 -05:00
Prashant Kumar
3c2f8ef243
Generate shark_tank for tensorflow models.
...
Updated the generate_sharktank.py script to give tensorflow models.
2022-07-20 22:37:14 +05:30
Ean Garvey
6401687733
Update TF pytest marks and fix benchmark runner import. ( #196 )
2022-07-19 15:42:32 -05:00
monorimet
08448a013f
Refactor TF tests for importer split, update pytorch tests.
2022-07-14 12:59:21 -05:00
Prashant Kumar
0dcf387089
Add shark_importer for torch_models. ( #183 )
...
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
2022-07-12 20:38:19 -07:00
Anush Elangovan
a7435973d9
Fix black formatting
2022-06-30 20:42:02 +00:00
Ean Garvey
0a6bc6e17f
Generate test-specific repro path for each TF model test. ( #158 )
...
Set TempFileSaver path directory to shark_args.repro_dir
2022-06-23 21:58:45 -07:00
Prashant Kumar
e8aa105b2a
Divide iree_utils and do module imports on function calls.
2022-06-22 14:17:33 +05:30
Ean Garvey
08eda2ce35
Equip TF tests with save_mlir, save_vmfb, and benchmark to .csv options. ( #148 )
2022-06-21 21:54:44 -07:00
Chi_Liu
f6e9f2d571
Generate Shark Tank for tflite ( #142 )
...
generate shark_tank for tflite
2022-06-20 14:35:35 -07:00
Ean Garvey
7198f0db0e
Add TempFileSaver pytest option to tank TF tests. ( #144 )
...
add/remove pytest marks to TF tests
2022-06-20 10:00:28 -07:00
Ean Garvey
f1edf88c33
Revert "add/remove pytest marks to TF tests"
...
This reverts commit b522f933a9
2022-06-20 16:06:40 +00:00
Ean Garvey
b522f933a9
add/remove pytest marks to TF tests
2022-06-20 15:23:28 +00:00
Ean Garvey
dbabb48582
Add TempFileSaver pytest option to tank TF tests.
2022-06-20 15:02:36 +00:00
Anush Elangovan
de223e7824
Add xfail reason
2022-06-18 08:31:26 +00:00
Ean Garvey
ce7350f5f8
Mark all TF model tests as expected to fail. ( #139 )
2022-06-16 16:25:18 -07:00
Prashant Kumar
4d3acff484
Add tf masked lm models (17 models - 12 pass, 5 fail). ( #135 )
2022-06-16 07:28:00 -07:00
Prashant Kumar
380b0b7c54
Add seq_classification shark module to run seq_classification
...
on hugging face supported models.
2022-06-14 22:36:19 +05:30
Ean Garvey
acdd1d1785
Update model testing utilities. ( #119 )
2022-06-13 02:16:30 -07:00
Ean Garvey
cbd131d588
Refactor testing framework. ( #117 )
2022-06-12 20:15:30 -07:00
Prashant Kumar
93bf13199f
Add tensorflow models under AutoModelForMaskedLM class.
2022-06-09 22:02:21 +05:30
anush elangovan
9c70dea957
Pull in TF models
2022-06-03 06:10:24 +00:00
