PhaneeshB
fd578a48a9
add cli args for vulkan target triple
2022-10-25 21:47:26 +05:30
Quinn Dawkins
1d33913d48
Add option to save and load precompiled flatbuffer ( #425 )
2022-10-23 16:24:09 -07:00
Prashant Kumar
a48eaaed20
Pass the flags to vae.
2022-10-23 23:57:48 +05:30
Prashant Kumar
2741b8be53
Pass the flags to vae. ( #422 )
2022-10-23 11:23:13 -07:00
Anush Elangovan
4f906a265c
Fix lint
2022-10-22 12:43:52 -07:00
Anush Elangovan
0dff8d7af0
Simple download script to prime the hf model cache
2022-10-21 17:42:05 -07:00
Quinn Dawkins
4f0d0d8167
Update vulkan gui README for iree-vulkan-gui + Stable Diffusion ( #399 )
2022-10-21 14:02:40 -04:00
Vivek Khandelwal
d513060b21
Add params for Stable Diffusion ( #420 )
2022-10-21 23:11:09 +05:30
Prashant Kumar
d1a25ce4f3
Update stable_args.py
2022-10-21 17:26:31 +05:30
Quinn Dawkins
b448770ec2
Add ms/iter timing for stable diffusion script ( #414 )
2022-10-20 13:32:37 -04:00
Prashant Kumar
5fe22a7980
Minor fix.
2022-10-20 22:57:22 +05:30
Prashant Kumar
38ae6b5af4
Add stable_diffusion fp16 and fp32 with args.
2022-10-20 21:47:11 +05:30
Quinn Dawkins
7be1d7d0be
Add option for extra arguments through SharkInference.compile ( #408 )
2022-10-19 15:32:48 -05:00
Prashant Kumar
0d74c873f0
Add stable_diff_f16 version. ( #407 )
2022-10-19 10:04:24 -07:00
Vivek Khandelwal
0e217d6180
Add Stable Diffusion Img2Img model script
2022-10-13 21:56:46 +05:30
Quinn Dawkins
d93d0783a8
Add script for tensorflow stable diffusion ( #391 )
2022-10-10 12:01:49 -04:00
Vivek Khandelwal
70a29b03e0
Add FP16 Resnet50 script
2022-10-06 21:56:43 +05:30
Quinn Dawkins
33b53e7caf
Add flag for specifying the vae mlir file location in stable diffusion ( #381 )
2022-09-30 00:37:58 -04:00
Prashant Kumar
c7b2d39ab2
Update stable_diff to contain vae.
2022-09-26 20:11:43 +05:30
Prashant Kumar
b9c8985047
Add sharkdynamo which combines shark with torchdynamo.
...
-- Adds graph breaks when necessary.
-- Even for loops are supported.
2022-09-23 22:40:02 +05:30
Ean Garvey
d82b305781
Fix issues with loading .vmfb into SharkInference
2022-09-23 09:53:13 +05:30
Prashant Kumar
991e7043d1
Add stable diffusion model.
2022-09-22 13:40:51 +05:30
Vivek Khandelwal
864723a473
add bloom model example
2022-09-15 18:23:09 +05:30
Prashant Kumar
bb52b224d0
Add sparse architecture and test with torchrec SparseArch.
...
Features that don't work with current implementation:
-- embeddingbag config with multiple features.
2022-09-09 21:49:30 +05:30
Prashant Kumar
5105f62551
Add the dlrm_model in shark example. ( #301 )
...
-- DLRM model is added in the shark example.
-- The model is verified on cpu, gpu and vulkan.
Co-authored-by: powderluv <powderluv@users.noreply.github.com >
2022-08-31 12:54:21 -07:00
Quinn Dawkins
99be837d84
Add lockstep tracer based on TorchMLIR eager mode + examples ( #243 )
2022-08-31 15:50:24 -04:00
Stanley Winata
55bcb2eb3c
Level Zero Backend ( #280 )
2022-08-17 19:19:27 -07:00
Prashant Kumar
88b0dec0ee
Update unet_model to run on shark.
...
-- Verified unet_model runs on the cpu/gpu/vulkan backend.
2022-08-17 13:16:02 +05:30
Prashant Kumar
4e5c592094
Enable --devices to pass through CLI.
2022-07-27 22:13:52 +05:30
Prashant Kumar
39c5f940c9
Add v_diffusion model into shark examples. ( #195 )
2022-07-19 09:51:10 -07:00
Prashant Kumar
54a642e76a
Update the resnet50 example to use the shark_downloader.
...
The resnet50 example is updated to use the shark_downloader instead
of shark_importer and inference.
2022-07-18 13:41:38 +05:30
Prashant Kumar
1191f53c9d
Add the shark_downloader for the torch_models. ( #184 )
2022-07-14 13:41:43 -07:00
Prashant Kumar
0dcf387089
Add shark_importer for torch_models. ( #183 )
...
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
2022-07-12 20:38:19 -07:00
Prashant Kumar
2e5cb4ba76
Add resnest model to the shark_inference examples list.
2022-07-07 19:51:53 +05:30
Anush Elangovan
a7435973d9
Fix black formatting
2022-06-30 20:42:02 +00:00
Prashant Kumar
83855e7b08
Capture input information from mlir_graph and generate random inputs.
2022-06-29 22:51:53 +05:30
Prashant Kumar
b07377cbfd
Refactor the shark_runner shark_inference to only support mlir_modules.
...
1. The shark_inference is divided into shark_importer and
shark_inference.
2. All the tank/pytorch tests have been updated.
2022-06-28 18:46:18 +05:30
Prashant Kumar
e8aa105b2a
Divide iree_utils and do module imports on function calls.
2022-06-22 14:17:33 +05:30
Prashant Kumar
334d129443
Changes to minilm to make it one on one with tensorflow.
2022-06-21 22:08:59 +05:30
Prashant Kumar
4d3acff484
Add tf masked lm models (17 models - 12 pass, 5 fail). ( #135 )
2022-06-16 07:28:00 -07:00
Prashant Kumar
bf02c8d0db
Add t5( https://huggingface.co/docs/transformers/model_doc/t5 ) model.
2022-06-08 16:25:23 +00:00
Prashant Kumar
1394255fc9
Add gpt2 model( https://huggingface.co/distilgpt2 ) via tensorflow
...
frontend.
2022-06-08 18:06:35 +05:30
Prashant Kumar
d86ca8e174
Add inference of https://huggingface.co/openai/clip-vit-base-patch32
...
via tensorflow pipeline.
2022-06-08 18:03:36 +05:30
Stanley Winata
c70ab55717
Add saving and loading of mlir to run. ( #89 )
2022-06-05 08:42:40 -07:00
Stanley Winata
276dcf1441
Add benchmark for TF ( #87 )
...
-Refactor SharkBenchmarker to run TF
-Add example and test to benchmark TF
2022-06-03 22:10:27 -07:00
yzhang93
16c50cac15
Add the option to use tuned model in shark_runner ( #79 )
2022-06-02 18:25:33 -07:00
Maksim Levental
4ba3c03c3f
Merge pull request #81 from makslevental/dynamo
...
Dynamo notebook
2022-06-01 21:16:59 -05:00
Ean Garvey
8ad73d365c
Add support for training TF models + fix TF BERT training example ( #80 )
2022-06-01 18:46:07 -07:00
Maksim Levental
c058b39c7c
Merge branch 'nod-ai:main' into dynamo
2022-06-01 20:02:24 -05:00
max
1d2c3ee584
Demo for how dynamo with mlir backend can exist out of (dynamo) tree.
2022-06-01 18:57:58 -05:00