Sungsoon Cho
51e1bd1c5d
(OPT) Fix typo in the message; s/reponse/response ( #1920 )
2023-11-09 11:00:48 -06:00
Ean Garvey
98244232dd
Add smoothquant OPT to examples. ( #1922 )
2023-10-27 12:32:12 -05:00
PhaneeshB
679a452139
fix calls and remove unused imports for check_device_drivers
2023-10-27 10:30:40 +05:30
Sungsoon Cho
0c38c33d0a
Add opt_causallm_samples.py. ( #1916 )
2023-10-25 11:52:51 -05:00
Ean Garvey
841773fa32
Updates to opt_causallm example ( #1905 )
...
* Updates to opt_causallm example
* Fixup opt_perf_comparison.py
* Use same filenames across opt examples.
2023-10-24 10:54:39 -07:00
Ean Garvey
e6cb5cef57
Add --additional_runtime_args option and use in OPT example. ( #1855 )
...
* Add --additional_runtime_args option and use in OPT example.
Fix the func name. (#1838 )
Co-authored-by: Sungsoon Cho <sungsoon.cho@gmail.com >
2023-10-19 13:29:39 -05:00
Ean Garvey
caf6cc5d8f
Switch most compile flows to use ireec.compile_file. ( #1863 )
...
* Switch most compile flows to use ireec.compile_file.
* re-add input type to compile_str path.
* Check if mlir_module exists before checking if it's a path or pyobject.
* Fix some save_dir cases
2023-10-06 23:04:43 -05:00
Sungsoon Cho
0d16c81687
Remove unused import. ( #1857 )
2023-10-02 11:36:08 -05:00
Sungsoon Cho
b5fbb1a8a0
Rename the func arg save_json to avoid name collision. ( #1837 )
...
* Rename the func arg save_json to avoid name collision.
* black formatted.
2023-09-19 17:29:27 -05:00
Ean Garvey
9697981004
Pipe through a debug option to iree compile utils. ( #1796 )
...
* Update compile_utils.py
* Pipe through a flag to toggle debug options in compile utils.
* Update SharkLLMBase.py
2023-08-25 07:11:11 -07:00
Ean Garvey
07f6f4a2f7
Add a short README for the OPT examples and small tweaks. ( #1793 )
...
* Small changes to OPT example.
* Update opt README.
* Add a few modes to batch script.
* Update README.md
2023-08-24 17:26:11 -07:00
Sungsoon Cho
79075a1a07
Opt perf ( #1786 )
...
* Define command line args, model-name, max-seq-len, platform, etc.
* Add usage example.
* Add opt_perf_comparision_batch.py.
* Use shlex instead.
2023-08-24 08:33:12 -05:00
Ean Garvey
dd738a0e02
small changes to opt_perf_comparison.py ( #1670 )
...
* Use longer prompts for OPT comparison script
* small tweaks
2023-07-19 06:26:50 -07:00
Ean Garvey
7cf19230e2
add perf comparison script for opt. ( #1650 )
2023-07-13 13:29:48 -05:00
Ean Garvey
6e6c90f62b
Pin torch-mlir and use local-task in OPT. ( #1592 )
2023-06-23 19:17:05 -07:00
Ean Garvey
f53e3594c3
OPT Refactor ( #1516 )
...
* Change script to 1.3b model and add pytorch comparison
* fix CLI command
* Match OPT transformers model updates + numerics against latest version
* Cleanup OPT sentence completion script.
* Fix formatting and add standalone validation scripts.
* Add minimal OPT wrapper and example with import_with_fx
* Rename OPT full model wrapper.
* Cleanup test scripts for OPT.
2023-06-13 22:40:07 -05:00
Ean Garvey
2c3485ca3e
Add standalone OPT sentence completion script. ( #1506 )
2023-06-07 10:58:03 -07:00
Ean Garvey
a07fe80530
Update OPT, ResNet example scripts. ( #1492 )
...
* Update API in OPT example.
* fix resnet50 script
* Add OPT1.3b test script.
2023-06-05 20:19:35 -07:00
Ean Garvey
3cddd01b10
Update OPT tokenizer and xfail a few more large tests on macos CI ( #1459 )
...
* Update opt_torch_test.py
* Update all_models.csv
2023-05-23 14:36:57 -07:00
Ean Garvey
a504903dd5
Fix formatting issues. ( #903 )
2023-02-01 09:12:45 +05:30
Daniel Garvey
8859853b41
Revert "Revert "find gsutil on linux ( #557 )" ( #560 )" ( #561 )
...
This reverts commit 3c46021102
2022-12-05 20:27:43 -08:00
Daniel Garvey
3c46021102
Revert "find gsutil on linux ( #557 )" ( #560 )
...
This reverts commit bba8646669
2022-12-05 21:53:47 -06:00
Daniel Garvey
bba8646669
find gsutil on linux ( #557 )
...
* find gsutil on linux
* cleaned up downloader and ditched gsutil
Co-authored-by: dan <dan@nod-labs.com >
2022-12-05 19:03:48 -08:00
Ean Garvey
f3bde3c7fc
Cleanup tank directory and move instructions to tank/README.md ( #401 )
2022-10-13 12:20:02 -05:00
