Quinn Dawkins
d93d0783a8
Add script for tensorflow stable diffusion ( #391 )
2022-10-10 12:01:49 -04:00
Vivek Khandelwal
70a29b03e0
Add FP16 Resnet50 script
2022-10-06 21:56:43 +05:30
Quinn Dawkins
33b53e7caf
Add flag for specifying the vae mlir file location in stable diffusion ( #381 )
2022-09-30 00:37:58 -04:00
Prashant Kumar
c7b2d39ab2
Update stable_diff to contain vae.
2022-09-26 20:11:43 +05:30
Prashant Kumar
b9c8985047
Add sharkdynamo which combines shark with torchdynamo.
...
-- Adds graph breaks when necessary.
-- Even for loops are supported.
2022-09-23 22:40:02 +05:30
Ean Garvey
d82b305781
Fix issues with loading .vmfb into SharkInference
2022-09-23 09:53:13 +05:30
Prashant Kumar
991e7043d1
Add stable diffusion model.
2022-09-22 13:40:51 +05:30
Vivek Khandelwal
864723a473
add bloom model example
2022-09-15 18:23:09 +05:30
Prashant Kumar
bb52b224d0
Add sparse architecture and test with torchrec SparseArch.
...
Features that don't work with current implementation:
-- embeddingbag config with multiple features.
2022-09-09 21:49:30 +05:30
Prashant Kumar
5105f62551
Add the dlrm_model in shark example. ( #301 )
...
-- DLRM model is added in the shark example.
-- The model is verified on cpu, gpu and vulkan.
Co-authored-by: powderluv <powderluv@users.noreply.github.com >
2022-08-31 12:54:21 -07:00
Quinn Dawkins
99be837d84
Add lockstep tracer based on TorchMLIR eager mode + examples ( #243 )
2022-08-31 15:50:24 -04:00
Stanley Winata
55bcb2eb3c
Level Zero Backend ( #280 )
2022-08-17 19:19:27 -07:00
Prashant Kumar
88b0dec0ee
Update unet_model to run on shark.
...
-- Verified unet_model runs on the cpu/gpu/vulkan backend.
2022-08-17 13:16:02 +05:30
Prashant Kumar
4e5c592094
Enable --devices to pass through CLI.
2022-07-27 22:13:52 +05:30
Prashant Kumar
39c5f940c9
Add v_diffusion model into shark examples. ( #195 )
2022-07-19 09:51:10 -07:00
Prashant Kumar
54a642e76a
Update the resnet50 example to use the shark_downloader.
...
The resnet50 example is updated to use the shark_downloader instead
of shark_importer and inference.
2022-07-18 13:41:38 +05:30
Prashant Kumar
1191f53c9d
Add the shark_downloader for the torch_models. ( #184 )
2022-07-14 13:41:43 -07:00
Prashant Kumar
0dcf387089
Add shark_importer for torch_models. ( #183 )
...
All the torch_models are imported to gs::shark_tank.
Scripts have been updated.
2022-07-12 20:38:19 -07:00
Prashant Kumar
2e5cb4ba76
Add resnest model to the shark_inference examples list.
2022-07-07 19:51:53 +05:30
Anush Elangovan
a7435973d9
Fix black formatting
2022-06-30 20:42:02 +00:00
Prashant Kumar
83855e7b08
Capture input information from mlir_graph and generate random inputs.
2022-06-29 22:51:53 +05:30
Prashant Kumar
b07377cbfd
Refactor the shark_runner shark_inference to only support mlir_modules.
...
1. The shark_inference is divided into shark_importer and
shark_inference.
2. All the tank/pytorch tests have been updated.
2022-06-28 18:46:18 +05:30
Prashant Kumar
e8aa105b2a
Divide iree_utils and do module imports on function calls.
2022-06-22 14:17:33 +05:30
Prashant Kumar
334d129443
Changes to minilm to make it one on one with tensorflow.
2022-06-21 22:08:59 +05:30
Prashant Kumar
4d3acff484
Add tf masked lm models (17 models - 12 pass, 5 fail). ( #135 )
2022-06-16 07:28:00 -07:00
Prashant Kumar
bf02c8d0db
Add t5( https://huggingface.co/docs/transformers/model_doc/t5 ) model.
2022-06-08 16:25:23 +00:00
Prashant Kumar
1394255fc9
Add gpt2 model( https://huggingface.co/distilgpt2 ) via tensorflow
...
frontend.
2022-06-08 18:06:35 +05:30
Prashant Kumar
d86ca8e174
Add inference of https://huggingface.co/openai/clip-vit-base-patch32
...
via tensorflow pipeline.
2022-06-08 18:03:36 +05:30
Stanley Winata
c70ab55717
Add saving and loading of mlir to run. ( #89 )
2022-06-05 08:42:40 -07:00
Stanley Winata
276dcf1441
Add benchmark for TF ( #87 )
...
-Refactor SharkBenchmarker to run TF
-Add example and test to benchmark TF
2022-06-03 22:10:27 -07:00
yzhang93
16c50cac15
Add the option to use tuned model in shark_runner ( #79 )
2022-06-02 18:25:33 -07:00
Maksim Levental
4ba3c03c3f
Merge pull request #81 from makslevental/dynamo
...
Dynamo notebook
2022-06-01 21:16:59 -05:00
Ean Garvey
8ad73d365c
Add support for training TF models + fix TF BERT training example ( #80 )
2022-06-01 18:46:07 -07:00
Maksim Levental
c058b39c7c
Merge branch 'nod-ai:main' into dynamo
2022-06-01 20:02:24 -05:00
max
1d2c3ee584
Demo for how dynamo with mlir backend can exist out of (dynamo) tree.
2022-06-01 18:57:58 -05:00
Maksim Levental
05dffd4d59
Demo for how dynamo with mlir backend can exist out of (dynamo) tree. ( #78 )
2022-06-01 14:57:04 -07:00
max
4572d2bfba
Demo for how dynamo with mlir backend can exist out of (dynamo) tree.
2022-06-01 15:32:17 -05:00
Stanley Winata
b271daa748
Rectify Vulkan Flags and Command to obtain Vulkan Target Triple ( #77 )
...
-Add correct vulkan flag to run minilm_jit
-Add automatic specification of target triple for better speed.
-Will work when https://github.com/nod-ai/SHARK-Runtime/releases/tag/candidate-20220601.20 gets
released, for now we can replace the shark release link to this on setup_venv.sh to work.
2022-06-01 11:33:53 -07:00
Maksim Levental
5530b56921
Shark Eager Mode jupyter notebook ( #76 )
2022-06-01 09:21:32 -07:00
Prashant Kumar
c69baa3b1e
Rename and refactoring.
2022-05-27 15:17:08 +05:30
Prashant Kumar
e5517f63f5
Add the refactored training module.
2022-05-27 14:21:34 +05:30
stanley
91867e1fc2
Add Shark Benchmark
...
-Introduce SharkBenchmark that bench models on regular torch, shark-py, and shark-c.
-Integrate iree-benchmark-module into Shark.
2022-05-27 00:07:31 +00:00
Prashant Kumar
15c99adab8
Refactor the whole SharkInference API.
...
1. SharkInference API is refactored to target any frontends or files,
i.e. pytorch, tensorflow, mhlo, linalg, tosa.
2. Refactor all torch APIs.
2022-05-26 18:55:47 +05:30
Maksim Levental
ef6f3a7b74
Eager mode with IREE ( #25 )
...
Eager mode with IREE
reenable iree integration
2022-05-25 21:49:19 -07:00
Ean Garvey
772f60c313
Add support for TensorFlow modules + TF miniLM example ( #51 )
2022-05-25 18:50:43 -07:00
Prashant Kumar
6a358cb90a
Update the examples removing functorch dependency.
2022-05-24 19:10:01 +05:30
Prashant Kumar
96c28685ce
Added device map and runs test according to the driver.
...
Automatically runs test according to the device driver present.
2022-05-17 19:33:54 +05:30
Prashant Kumar
0bd5f22f63
Remove redundant examples.
2022-05-17 17:50:16 +05:30
Prashant Kumar
63f9b206ac
Modify pytest to run a certain test.
2022-05-17 16:58:08 +05:30
Prashant Kumar
dcc1bbac14
Add pytests-parametrize with device and dynamic option.
...
Added pytests-parametrize with device and dynamic options, also
added worker flag in pytest to run tests concurrently.
2022-05-17 11:07:56 +05:30