73 Commits

Author SHA1 Message Date
Stanley Winata
c47218c972 WIP: Intel-GPU integration 2022-08-10 11:24:00 -07:00
Ean Garvey
c1a14a8db1 Update wide_resnet50_2_test.py (#229)
Removed old xfails.
2022-08-01 20:38:53 -05:00
Chi_Liu
0e42c19f33 Test tflite quantization_info fail on cloud (#228) 2022-08-01 18:21:04 -07:00
Chi_Liu
0c31bb82cd Add hash of mlir for tf/tflite (#225) 2022-08-01 10:40:49 -07:00
Ean Garvey
0ee515a7be Fix GPU benchmarks on PyTorch model tests. (#218)
* Add CUDA_BENCHMARKS option to setup.venv to enable PyTorch benchmarks on CUDA.

* Fix PyTorch GPU benchmarks for tank models.
2022-07-29 15:17:55 -07:00
Daniel Garvey
4c0deb9899 remove gpu script (#220)
No longer needed after fixes in iree
2022-07-29 15:20:03 -05:00
Chi_Liu
94d9275515 Move tf tests to tank/ (#223) 2022-07-29 09:34:50 -07:00
Chi_Liu
2c7d879a4e Add tf image classification auto model tests (#216) 2022-07-27 18:38:13 -07:00
Chi_Liu
af4257d05f Add tf image classification auto model (#213) 2022-07-26 23:18:42 -07:00
Chi_Liu
dc1a283ab7 Remove tf package dep for SharkDownloader tflite tests (#212) 2022-07-26 12:41:12 -07:00
Vivek Khandelwal
cc4fa96831 Remove op decomposition from the v_diffusion.py (#210)
The PyTorch decomposition for the op `aten.upsample_bilinear2d.vec`
is merged in the upstream repo and hence removed from this file.
2022-07-25 17:36:26 +05:30
Ean Garvey
921ccdc40b Force TensorFlow to use CPU when generating model and golden values. (#199)
Split up gpu pytest runs temporarily
2022-07-22 20:21:16 -07:00
Prashant Kumar
49fc6d2f4b Add all the tf models to gs::shark_tank. (#207)
-- Tensorflow models have been imported to shark_tank.
-- TF Tests have been updated to use the downloader.
2022-07-22 11:53:07 -05:00
Prashant Kumar
e62c531170 Update the torch_model for dynamic cases. 2022-07-22 00:21:35 +05:30
Prashant Kumar
3c2f8ef243 Generate shark_tank for tensorflow models.
Updated the generate_sharktank.py script to give tensorflow models.
2022-07-20 22:37:14 +05:30
Vivek Khandelwal
0e2485d85b Add v-diffusion model 2022-07-20 21:36:42 +05:30
Ean Garvey
6401687733 Update TF pytest marks and fix benchmark runner import. (#196) 2022-07-19 15:42:32 -05:00
Ean Garvey
c5ae01311d Make PyTorch model tests importer-independent and add benchmarks. 2022-07-15 21:54:41 -05:00
Chi_Liu
8434c67d96 Change tflite tests from sharkimporter -> sharkdownloader (#182)
* Change tflite test from sharkimporter -> sharkdownloader

* xfail all uint/int tflite sharkdownloader tests
2022-07-14 13:40:25 -07:00
monorimet
08448a013f Refactor TF tests for importer split, update pytorch tests. 2022-07-14 12:59:21 -05:00
Prashant Kumar
0dcf387089 Add shark_importer for torch_models. (#183)
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
2022-07-12 20:38:19 -07:00
Prashant Kumar
2e22d0b690 Bug fix: Pass the device attribute appropriately.
Previously the device attribute was not passed and device was
hardcoded to "cpu". So every tests were running on cpu.
2022-07-09 01:56:17 +05:30
Chi_Liu
b98c9ee484 torch fix in gen_shark_tank (#180) 2022-07-08 10:13:58 -07:00
Prashant Kumar
fa7ee7e099 Update pytorch tests to support vulkan and cuda.
All the model validation pass except distilbert which is failing
in torch-mlir lowering. Also, added the mobilebert-uncased model to
the torch test suite.
2022-07-08 14:40:13 +05:30
Chi_Liu
d496c66d11 Torch support of gen_shark_tank (#175) 2022-07-06 22:42:15 -07:00
Chi_Liu
1cad50d521 generate shark tank for tflite (#173)
* Add gen_shark_tank support tflite

* gen_shark_tank.py use SharkImporter to save model
2022-07-05 23:11:19 -07:00
Chi_Liu
4e9e35a9ff Fix mobilebert return bug (#171) 2022-07-01 05:46:18 -07:00
Chi_Liu
41a8cbb5b6 Fix deeplab&mobilebert tflite test bug (#170) 2022-06-30 21:42:14 -07:00
Chi Liu
c1cde2e252 Add xfail with sys.platform == "darwin" for mac 2022-06-30 15:17:59 -07:00
Chi Liu
638f982c94 Add Xfail for tflites exampls
Know  Macos iree-tflite install error
2022-06-30 15:02:05 -07:00
Chi Liu
84978cf3c5 Fix tflite examples fail pytest 2022-06-30 14:57:33 -07:00
Chi Liu
96dd08cca4 Fix load json input bug in SharkDownloader albert test 2022-06-30 14:57:33 -07:00
Chi Liu
06a45d9025 Rewrite tflite SharkImporter tests to compatible to most recent SharkImporter 2022-06-30 14:57:33 -07:00
Chi Liu
193a735865 Move tflite examples to up dir 2022-06-30 14:57:33 -07:00
Anush Elangovan
a7435973d9 Fix black formatting 2022-06-30 20:42:02 +00:00
Chi_Liu
2adea76b8c Enable SharkImporter Tests (#165)
rewrite some tflite code from SharkImporter to tflite_utils.py
2022-06-29 10:11:48 -07:00
Chi_Liu
210d28fce9 Add more tflite shark_importer examples (#163) 2022-06-28 08:39:56 -07:00
Prashant Kumar
b07377cbfd Refactor the shark_runner shark_inference to only support mlir_modules.
1. The shark_inference is divided into shark_importer and
   shark_inference.
2. All the tank/pytorch tests have been updated.
2022-06-28 18:46:18 +05:30
Chi_Liu
44dce561e9 SharkImporter for tflite without forward and compile (#159) 2022-06-23 22:49:35 -07:00
Ean Garvey
0a6bc6e17f Generate test-specific repro path for each TF model test. (#158)
Set TempFileSaver path directory to shark_args.repro_dir
2022-06-23 21:58:45 -07:00
Chi_Liu
fa0aaf63c2 Fix repo_dir cannot export/write mlir file bug (#157)
-Set repro_dir as a temporary dir within current working directory.
2022-06-23 18:37:16 -07:00
Ean Garvey
71f5cfcb30 Fix package management in tank for Nightly build. (#152)
Fix formatting.
2022-06-22 15:51:57 -07:00
Chi_Liu
a635b6fbef Add tf/torch/mhlo/tosa support for SharkDownloader (#151) 2022-06-22 11:25:34 -07:00
Prashant Kumar
e8aa105b2a Divide iree_utils and do module imports on function calls. 2022-06-22 14:17:33 +05:30
Ean Garvey
08eda2ce35 Equip TF tests with save_mlir, save_vmfb, and benchmark to .csv options. (#148) 2022-06-21 21:54:44 -07:00
Chi_Liu
206ba11cc8 Add SharkDownloader for end users (#147)
* Add SharkDownloader for user

* Change tank_url to gs://shark_tank
2022-06-21 16:42:23 -07:00
Chi_Liu
af582925f2 Enable tosa.mlir as input for SharkImporter inference (#145)
* Change shark_importer to use tosa.mlir as tflite model input from  local gen_shark_tank
2022-06-20 23:15:14 -07:00
Chi_Liu
f6e9f2d571 Generate Shark Tank for tflite (#142)
generate shark_tank for tflite
2022-06-20 14:35:35 -07:00
Ean Garvey
7198f0db0e Add TempFileSaver pytest option to tank TF tests. (#144)
add/remove pytest marks to TF tests
2022-06-20 10:00:28 -07:00
Ean Garvey
f1edf88c33 Revert "add/remove pytest marks to TF tests"
This reverts commit b522f933a9.
2022-06-20 16:06:40 +00:00