126 Commits

Author SHA1 Message Date
Stanley Winata
c47218c972 WIP: Intel-GPU integration 2022-08-10 11:24:00 -07:00
Phaneesh Barwaria
198755788c Check for MacStudio Target Value (#233)
* Identify Apple M2 for Vulkan

* Check for MacOS Target
2022-08-02 13:18:36 -07:00
Chi_Liu
0c31bb82cd Add hash of mlir for tf/tflite (#225) 2022-08-01 10:40:49 -07:00
Prashant Kumar
315ec72984 Add check for hash.npy in the models folder. 2022-08-01 22:40:25 +05:30
Ean Garvey
0ee515a7be Fix GPU benchmarks on PyTorch model tests. (#218)
* Add CUDA_BENCHMARKS option to setup.venv to enable PyTorch benchmarks on CUDA.

* Fix PyTorch GPU benchmarks for tank models.
2022-07-29 15:17:55 -07:00
Chi_Liu
c1cb7bb3fd Rename tank tflite/torch model dir (#219) 2022-07-29 01:56:05 -05:00
Prashant Kumar
ff20ddeb97 Add hash of the mlir for checking upstream changes. (#217)
-- hash of the mlir files have been added in the shark_tank. (If there
is upstream changes, the model will be downloaded otherwise not).
-- The models have been placed in `~/.local/shark_tank/` folder as
opposed to the current folder not to redownload the files again.
2022-07-28 21:54:50 -05:00
Chi_Liu
2c7d879a4e Add tf image classification auto model tests (#216) 2022-07-27 18:38:13 -07:00
Prashant Kumar
4e5c592094 Enable --devices to pass through CLI. 2022-07-27 22:13:52 +05:30
Chi_Liu
af4257d05f Add tf image classification auto model (#213) 2022-07-26 23:18:42 -07:00
Chi_Liu
dc1a283ab7 Remove tf package dep for SharkDownloader tflite tests (#212) 2022-07-26 12:41:12 -07:00
Prashant Kumar
49fc6d2f4b Add all the tf models to gs::shark_tank. (#207)
-- Tensorflow models have been imported to shark_tank.
-- TF Tests have been updated to use the downloader.
2022-07-22 11:53:07 -05:00
Prashant Kumar
e62c531170 Update the torch_model for dynamic cases. 2022-07-22 00:21:35 +05:30
Prashant Kumar
3c2f8ef243 Generate shark_tank for tensorflow models.
Updated the generate_sharktank.py script to give tensorflow models.
2022-07-20 22:37:14 +05:30
Ean Garvey
6401687733 Update TF pytest marks and fix benchmark runner import. (#196) 2022-07-19 15:42:32 -05:00
Prashant Kumar
39c5f940c9 Add v_diffusion model into shark examples. (#195) 2022-07-19 09:51:10 -07:00
powderluv
9fc1c84cef Switch to disable multiprocessing as it fails on macOS (#194) 2022-07-19 01:25:13 -07:00
Ean Garvey
fa6f19679e Merge pull request #186 from nod-ai/benchmarks
Make PyTorch model tests importer-independent and add benchmarks.
2022-07-18 12:23:48 -05:00
Prashant Kumar
9105f5d54e Use the downloaded folder instead of re-downloading.
shark_tank models.
2022-07-18 17:10:54 +05:30
Prashant Kumar
54a642e76a Update the resnet50 example to use the shark_downloader.
The resnet50 example is updated to use the shark_downloader instead
of shark_importer and inference.
2022-07-18 13:41:38 +05:30
Ean Garvey
c5ae01311d Make PyTorch model tests importer-independent and add benchmarks. 2022-07-15 21:54:41 -05:00
Prashant Kumar
1191f53c9d Add the shark_downloader for the torch_models. (#184) 2022-07-14 13:41:43 -07:00
Chi_Liu
8434c67d96 Change tflite tests from sharkimporter -> sharkdownloader (#182)
* Change tflite test from sharkimporter -> sharkdownloader

* xfail all uint/int tflite sharkdownloader tests
2022-07-14 13:40:25 -07:00
Prashant Kumar
0dcf387089 Add shark_importer for torch_models. (#183)
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
2022-07-12 20:38:19 -07:00
Prashant Kumar
2e22d0b690 Bug fix: Pass the device attribute appropriately.
Previously the device attribute was not passed and device was
hardcoded to "cpu". So every tests were running on cpu.
2022-07-09 01:56:17 +05:30
Prashant Kumar
fa7ee7e099 Update pytorch tests to support vulkan and cuda.
All the model validation pass except distilbert which is failing
in torch-mlir lowering. Also, added the mobilebert-uncased model to
the torch test suite.
2022-07-08 14:40:13 +05:30
Prashant Kumar
2e5cb4ba76 Add resnest model to the shark_inference examples list. 2022-07-07 19:51:53 +05:30
Prashant Kumar
1a861acbb2 Add the torch_mlir.compile API for static cases. (#174) 2022-07-06 09:21:17 -07:00
Chi_Liu
1cad50d521 generate shark tank for tflite (#173)
* Add gen_shark_tank support tflite

* gen_shark_tank.py use SharkImporter to save model
2022-07-05 23:11:19 -07:00
Chi Liu
c1cde2e252 Add xfail with sys.platform == "darwin" for mac 2022-06-30 15:17:59 -07:00
Chi Liu
638f982c94 Add Xfail for tflites exampls
Know  Macos iree-tflite install error
2022-06-30 15:02:05 -07:00
Chi Liu
84978cf3c5 Fix tflite examples fail pytest 2022-06-30 14:57:33 -07:00
Chi Liu
96dd08cca4 Fix load json input bug in SharkDownloader albert test 2022-06-30 14:57:33 -07:00
Chi Liu
06a45d9025 Rewrite tflite SharkImporter tests to compatible to most recent SharkImporter 2022-06-30 14:57:33 -07:00
powderluv
e57cee21a5 Delete shark/tmp directory 2022-06-30 14:03:35 -07:00
Anush Elangovan
a7435973d9 Fix black formatting 2022-06-30 20:42:02 +00:00
Prashant Kumar
83855e7b08 Capture input information from mlir_graph and generate random inputs. 2022-06-29 22:51:53 +05:30
Chi_Liu
2adea76b8c Enable SharkImporter Tests (#165)
rewrite some tflite code from SharkImporter to tflite_utils.py
2022-06-29 10:11:48 -07:00
Prashant Kumar
b07377cbfd Refactor the shark_runner shark_inference to only support mlir_modules.
1. The shark_inference is divided into shark_importer and
   shark_inference.
2. All the tank/pytorch tests have been updated.
2022-06-28 18:46:18 +05:30
Chi_Liu
44dce561e9 SharkImporter for tflite without forward and compile (#159) 2022-06-23 22:49:35 -07:00
Ean Garvey
0a6bc6e17f Generate test-specific repro path for each TF model test. (#158)
Set TempFileSaver path directory to shark_args.repro_dir
2022-06-23 21:58:45 -07:00
Chi_Liu
fa0aaf63c2 Fix repo_dir cannot export/write mlir file bug (#157)
-Set repro_dir as a temporary dir within current working directory.
2022-06-23 18:37:16 -07:00
Chi_Liu
b7b2dfaa8d Fix shark_importer.py iree_utils import bug (#156) 2022-06-23 16:40:11 -07:00
powderluv
a7ca9b8d68 Update parser.py 2022-06-23 15:26:17 -07:00
Chi_Liu
a635b6fbef Add tf/torch/mhlo/tosa support for SharkDownloader (#151) 2022-06-22 11:25:34 -07:00
Prashant Kumar
e8aa105b2a Divide iree_utils and do module imports on function calls. 2022-06-22 14:17:33 +05:30
Ean Garvey
08eda2ce35 Equip TF tests with save_mlir, save_vmfb, and benchmark to .csv options. (#148) 2022-06-21 21:54:44 -07:00
Chi_Liu
206ba11cc8 Add SharkDownloader for end users (#147)
* Add SharkDownloader for user

* Change tank_url to gs://shark_tank
2022-06-21 16:42:23 -07:00
Prashant Kumar
334d129443 Changes to minilm to make it one on one with tensorflow. 2022-06-21 22:08:59 +05:30
Chi_Liu
af582925f2 Enable tosa.mlir as input for SharkImporter inference (#145)
* Change shark_importer to use tosa.mlir as tflite model input from  local gen_shark_tank
2022-06-20 23:15:14 -07:00