Commit Graph

64 Commits

Author SHA1 Message Date
Quinn Dawkins
d93d0783a8 Add script for tensorflow stable diffusion (#391) 2022-10-10 12:01:49 -04:00
Vivek Khandelwal
70a29b03e0 Add FP16 Resnet50 script 2022-10-06 21:56:43 +05:30
Quinn Dawkins
33b53e7caf Add flag for specifying the vae mlir file location in stable diffusion (#381) 2022-09-30 00:37:58 -04:00
Prashant Kumar
c7b2d39ab2 Update stable_diff to contain vae. 2022-09-26 20:11:43 +05:30
Prashant Kumar
b9c8985047 Add sharkdynamo which combines shark with torchdynamo.
-- Adds graph breaks when necessary.
-- Even for loops are supported.
2022-09-23 22:40:02 +05:30
Ean Garvey
d82b305781 Fix issues with loading .vmfb into SharkInference 2022-09-23 09:53:13 +05:30
Prashant Kumar
991e7043d1 Add stable diffusion model. 2022-09-22 13:40:51 +05:30
Vivek Khandelwal
864723a473 add bloom model example 2022-09-15 18:23:09 +05:30
Prashant Kumar
bb52b224d0 Add sparse architecture and test with torchrec SparseArch.
Features that don't work with current implementation:
    -- embeddingbag config with multiple features.
2022-09-09 21:49:30 +05:30
Prashant Kumar
5105f62551 Add the dlrm_model in shark example. (#301)
-- DLRM model is added in the shark example.
-- The model is verified on cpu, gpu and vulkan.

Co-authored-by: powderluv <powderluv@users.noreply.github.com>
2022-08-31 12:54:21 -07:00
Quinn Dawkins
99be837d84 Add lockstep tracer based on TorchMLIR eager mode + examples (#243) 2022-08-31 15:50:24 -04:00
Stanley Winata
55bcb2eb3c Level Zero Backend (#280) 2022-08-17 19:19:27 -07:00
Prashant Kumar
88b0dec0ee Update unet_model to run on shark.
-- Verified unet_model runs on the cpu/gpu/vulkan backend.
2022-08-17 13:16:02 +05:30
Prashant Kumar
4e5c592094 Enable --devices to pass through CLI. 2022-07-27 22:13:52 +05:30
Prashant Kumar
39c5f940c9 Add v_diffusion model into shark examples. (#195) 2022-07-19 09:51:10 -07:00
Prashant Kumar
54a642e76a Update the resnet50 example to use the shark_downloader.
The resnet50 example is updated to use the shark_downloader instead
of shark_importer and inference.
2022-07-18 13:41:38 +05:30
Prashant Kumar
1191f53c9d Add the shark_downloader for the torch_models. (#184) 2022-07-14 13:41:43 -07:00
Prashant Kumar
0dcf387089 Add shark_importer for torch_models. (#183)
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
2022-07-12 20:38:19 -07:00
Prashant Kumar
2e5cb4ba76 Add resnest model to the shark_inference examples list. 2022-07-07 19:51:53 +05:30
Anush Elangovan
a7435973d9 Fix black formatting 2022-06-30 20:42:02 +00:00
Prashant Kumar
83855e7b08 Capture input information from mlir_graph and generate random inputs. 2022-06-29 22:51:53 +05:30
Prashant Kumar
b07377cbfd Refactor the shark_runner shark_inference to only support mlir_modules.
1. The shark_inference is divided into shark_importer and
   shark_inference.
2. All the tank/pytorch tests have been updated.
2022-06-28 18:46:18 +05:30
Prashant Kumar
e8aa105b2a Divide iree_utils and do module imports on function calls. 2022-06-22 14:17:33 +05:30
Prashant Kumar
334d129443 Changes to minilm to make it one on one with tensorflow. 2022-06-21 22:08:59 +05:30
Prashant Kumar
4d3acff484 Add tf masked lm models (17 models - 12 pass, 5 fail). (#135) 2022-06-16 07:28:00 -07:00
Prashant Kumar
bf02c8d0db Add t5(https://huggingface.co/docs/transformers/model_doc/t5) model. 2022-06-08 16:25:23 +00:00
Prashant Kumar
1394255fc9 Add gpt2 model(https://huggingface.co/distilgpt2) via tensorflow
frontend.
2022-06-08 18:06:35 +05:30
Prashant Kumar
d86ca8e174 Add inference of https://huggingface.co/openai/clip-vit-base-patch32
via tensorflow pipeline.
2022-06-08 18:03:36 +05:30
Stanley Winata
c70ab55717 Add saving and loading of mlir to run. (#89) 2022-06-05 08:42:40 -07:00
Stanley Winata
276dcf1441 Add benchmark for TF (#87)
-Refactor SharkBenchmarker to run TF
-Add example and test to benchmark TF
2022-06-03 22:10:27 -07:00
yzhang93
16c50cac15 Add the option to use tuned model in shark_runner (#79) 2022-06-02 18:25:33 -07:00
Maksim Levental
4ba3c03c3f Merge pull request #81 from makslevental/dynamo
Dynamo notebook
2022-06-01 21:16:59 -05:00
Ean Garvey
8ad73d365c Add support for training TF models + fix TF BERT training example (#80) 2022-06-01 18:46:07 -07:00
Maksim Levental
c058b39c7c Merge branch 'nod-ai:main' into dynamo 2022-06-01 20:02:24 -05:00
max
1d2c3ee584 Demo for how dynamo with mlir backend can exist out of (dynamo) tree. 2022-06-01 18:57:58 -05:00
Maksim Levental
05dffd4d59 Demo for how dynamo with mlir backend can exist out of (dynamo) tree. (#78) 2022-06-01 14:57:04 -07:00
max
4572d2bfba Demo for how dynamo with mlir backend can exist out of (dynamo) tree. 2022-06-01 15:32:17 -05:00
Stanley Winata
b271daa748 Rectify Vulkan Flags and Command to obtain Vulkan Target Triple (#77)
-Add correct vulkan flag to run minilm_jit
-Add automatic specification of target triple for better speed.
-Will work when https://github.com/nod-ai/SHARK-Runtime/releases/tag/candidate-20220601.20 gets
released, for now we can replace the shark release link to this on setup_venv.sh to work.
2022-06-01 11:33:53 -07:00
Maksim Levental
5530b56921 Shark Eager Mode jupyter notebook (#76) 2022-06-01 09:21:32 -07:00
Prashant Kumar
c69baa3b1e Rename and refactoring. 2022-05-27 15:17:08 +05:30
Prashant Kumar
e5517f63f5 Add the refactored training module. 2022-05-27 14:21:34 +05:30
stanley
91867e1fc2 Add Shark Benchmark
-Introduce SharkBenchmark that bench models on regular torch, shark-py, and shark-c.
-Integrate iree-benchmark-module into Shark.
2022-05-27 00:07:31 +00:00
Prashant Kumar
15c99adab8 Refactor the whole SharkInference API.
1. SharkInference API is refactored to target any frontends or files,
   i.e. pytorch, tensorflow, mhlo, linalg, tosa.
2. Refactor all torch APIs.
2022-05-26 18:55:47 +05:30
Maksim Levental
ef6f3a7b74 Eager mode with IREE (#25)
Eager mode with IREE

reenable iree integration
2022-05-25 21:49:19 -07:00
Ean Garvey
772f60c313 Add support for TensorFlow modules + TF miniLM example (#51) 2022-05-25 18:50:43 -07:00
Prashant Kumar
6a358cb90a Update the examples removing functorch dependency. 2022-05-24 19:10:01 +05:30
Prashant Kumar
96c28685ce Added device map and runs test according to the driver.
Automatically runs test according to the device driver present.
2022-05-17 19:33:54 +05:30
Prashant Kumar
0bd5f22f63 Remove redundant examples. 2022-05-17 17:50:16 +05:30
Prashant Kumar
63f9b206ac Modify pytest to run a certain test. 2022-05-17 16:58:08 +05:30
Prashant Kumar
dcc1bbac14 Add pytests-parametrize with device and dynamic option.
Added pytests-parametrize with device and dynamic options, also
added worker flag in pytest to run tests concurrently.
2022-05-17 11:07:56 +05:30