Commit Graph

279 Commits

Author SHA1 Message Date
PhaneeshB
fd578a48a9 add cli args for vulkan target triple 2022-10-25 21:47:26 +05:30
Quinn Dawkins
1d33913d48 Add option to save and load precompiled flatbuffer (#425) 2022-10-23 16:24:09 -07:00
Prashant Kumar
a48eaaed20 Pass the flags to vae. 2022-10-23 23:57:48 +05:30
Prashant Kumar
2741b8be53 Pass the flags to vae. (#422) 2022-10-23 11:23:13 -07:00
Anush Elangovan
4f906a265c Fix lint 2022-10-22 12:43:52 -07:00
Anush Elangovan
0dff8d7af0 Simple download script to prime the hf model cache 2022-10-21 17:42:05 -07:00
Quinn Dawkins
4f0d0d8167 Update vulkan gui README for iree-vulkan-gui + Stable Diffusion (#399) 2022-10-21 14:02:40 -04:00
Vivek Khandelwal
d513060b21 Add params for Stable Diffusion (#420) 2022-10-21 23:11:09 +05:30
Prashant Kumar
d1a25ce4f3 Update stable_args.py 2022-10-21 17:26:31 +05:30
Quinn Dawkins
b448770ec2 Add ms/iter timing for stable diffusion script (#414) 2022-10-20 13:32:37 -04:00
Prashant Kumar
5fe22a7980 Minor fix. 2022-10-20 22:57:22 +05:30
Prashant Kumar
38ae6b5af4 Add stable_diffusion fp16 and fp32 with args. 2022-10-20 21:47:11 +05:30
Quinn Dawkins
7be1d7d0be Add option for extra arguments through SharkInference.compile (#408) 2022-10-19 15:32:48 -05:00
Prashant Kumar
0d74c873f0 Add stable_diff_f16 version. (#407) 2022-10-19 10:04:24 -07:00
Vivek Khandelwal
0e217d6180 Add Stable Diffusion Img2Img model script 2022-10-13 21:56:46 +05:30
Quinn Dawkins
d93d0783a8 Add script for tensorflow stable diffusion (#391) 2022-10-10 12:01:49 -04:00
Vivek Khandelwal
70a29b03e0 Add FP16 Resnet50 script 2022-10-06 21:56:43 +05:30
Quinn Dawkins
33b53e7caf Add flag for specifying the vae mlir file location in stable diffusion (#381) 2022-09-30 00:37:58 -04:00
Prashant Kumar
c7b2d39ab2 Update stable_diff to contain vae. 2022-09-26 20:11:43 +05:30
Prashant Kumar
b9c8985047 Add sharkdynamo which combines shark with torchdynamo.
-- Adds graph breaks when necessary.
-- Even for loops are supported.
2022-09-23 22:40:02 +05:30
Ean Garvey
d82b305781 Fix issues with loading .vmfb into SharkInference 2022-09-23 09:53:13 +05:30
Prashant Kumar
991e7043d1 Add stable diffusion model. 2022-09-22 13:40:51 +05:30
Vivek Khandelwal
864723a473 add bloom model example 2022-09-15 18:23:09 +05:30
Prashant Kumar
bb52b224d0 Add sparse architecture and test with torchrec SparseArch.
Features that don't work with current implementation:
    -- embeddingbag config with multiple features.
2022-09-09 21:49:30 +05:30
Prashant Kumar
5105f62551 Add the dlrm_model in shark example. (#301)
-- DLRM model is added in the shark example.
-- The model is verified on cpu, gpu and vulkan.

Co-authored-by: powderluv <powderluv@users.noreply.github.com>
2022-08-31 12:54:21 -07:00
Quinn Dawkins
99be837d84 Add lockstep tracer based on TorchMLIR eager mode + examples (#243) 2022-08-31 15:50:24 -04:00
Stanley Winata
55bcb2eb3c Level Zero Backend (#280) 2022-08-17 19:19:27 -07:00
Prashant Kumar
88b0dec0ee Update unet_model to run on shark.
-- Verified unet_model runs on the cpu/gpu/vulkan backend.
2022-08-17 13:16:02 +05:30
Prashant Kumar
4e5c592094 Enable --devices to pass through CLI. 2022-07-27 22:13:52 +05:30
Prashant Kumar
39c5f940c9 Add v_diffusion model into shark examples. (#195) 2022-07-19 09:51:10 -07:00
Prashant Kumar
54a642e76a Update the resnet50 example to use the shark_downloader.
The resnet50 example is updated to use the shark_downloader instead
of shark_importer and inference.
2022-07-18 13:41:38 +05:30
Prashant Kumar
1191f53c9d Add the shark_downloader for the torch_models. (#184) 2022-07-14 13:41:43 -07:00
Prashant Kumar
0dcf387089 Add shark_importer for torch_models. (#183)
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
2022-07-12 20:38:19 -07:00
Prashant Kumar
2e5cb4ba76 Add resnest model to the shark_inference examples list. 2022-07-07 19:51:53 +05:30
Anush Elangovan
a7435973d9 Fix black formatting 2022-06-30 20:42:02 +00:00
Prashant Kumar
83855e7b08 Capture input information from mlir_graph and generate random inputs. 2022-06-29 22:51:53 +05:30
Prashant Kumar
b07377cbfd Refactor the shark_runner shark_inference to only support mlir_modules.
1. The shark_inference is divided into shark_importer and
   shark_inference.
2. All the tank/pytorch tests have been updated.
2022-06-28 18:46:18 +05:30
Prashant Kumar
e8aa105b2a Divide iree_utils and do module imports on function calls. 2022-06-22 14:17:33 +05:30
Prashant Kumar
334d129443 Changes to minilm to make it one on one with tensorflow. 2022-06-21 22:08:59 +05:30
Prashant Kumar
4d3acff484 Add tf masked lm models (17 models - 12 pass, 5 fail). (#135) 2022-06-16 07:28:00 -07:00
Prashant Kumar
bf02c8d0db Add t5(https://huggingface.co/docs/transformers/model_doc/t5) model. 2022-06-08 16:25:23 +00:00
Prashant Kumar
1394255fc9 Add gpt2 model(https://huggingface.co/distilgpt2) via tensorflow
frontend.
2022-06-08 18:06:35 +05:30
Prashant Kumar
d86ca8e174 Add inference of https://huggingface.co/openai/clip-vit-base-patch32
via tensorflow pipeline.
2022-06-08 18:03:36 +05:30
Stanley Winata
c70ab55717 Add saving and loading of mlir to run. (#89) 2022-06-05 08:42:40 -07:00
Stanley Winata
276dcf1441 Add benchmark for TF (#87)
-Refactor SharkBenchmarker to run TF
-Add example and test to benchmark TF
2022-06-03 22:10:27 -07:00
yzhang93
16c50cac15 Add the option to use tuned model in shark_runner (#79) 2022-06-02 18:25:33 -07:00
Maksim Levental
4ba3c03c3f Merge pull request #81 from makslevental/dynamo
Dynamo notebook
2022-06-01 21:16:59 -05:00
Ean Garvey
8ad73d365c Add support for training TF models + fix TF BERT training example (#80) 2022-06-01 18:46:07 -07:00
Maksim Levental
c058b39c7c Merge branch 'nod-ai:main' into dynamo 2022-06-01 20:02:24 -05:00
max
1d2c3ee584 Demo for how dynamo with mlir backend can exist out of (dynamo) tree. 2022-06-01 18:57:58 -05:00