Ean Garvey
116b128802
Use nightly shark_tank for test-models ( #1133 )
...
* Use nightly shark_tank for test-models
* Update all_models.csv
2023-03-02 12:33:36 -06:00
Daniel Garvey
23f1468cc6
disable most models on windows pytest ( #1125 )
2023-03-02 01:37:50 -06:00
Daniel Garvey
b1113ab551
disable benchmark on windows for pytest ( #1100 )
2023-02-28 18:10:29 -06:00
powderluv
abab59c25f
Update nightly.yml
2023-02-22 18:44:43 -08:00
powderluv
c25840b585
Update nightly.yml
2023-02-22 18:34:37 -08:00
powderluv
1b3f9125bb
Update nightly.yml
2023-02-22 18:23:44 -08:00
powderluv
b5d9f5ba49
Update nightly.yml
2023-02-22 18:20:31 -08:00
powderluv
e912c42bf0
update the openxla links
2023-02-22 12:10:23 -08:00
powderluv
e6841acf36
Publish nightlies as pre-releases
...
So stable versions can be marked on the Releases page
2023-02-22 12:05:28 -08:00
Daniel Garvey
681332ef32
fix tests after default flag changes ( #1009 )
...
* fix tests after default flag changes
also adds support for import-mlir
* Update setup_venv.ps1
---------
2023-02-16 12:57:50 -06:00
powderluv
13a255afad
Update nightly.yml
2023-02-15 17:11:38 -08:00
Abhishek Varma
c203b65bf1
Fix __file__ AttributeError + Remove --enable_stack_trace ( #1015 )
2023-02-14 07:55:02 -08:00
powderluv
899cb9cc1f
Temporarily disable signing of exe
2023-02-12 20:37:42 -08:00
powderluv
ef7d31293d
Update tests to 3.11
2023-02-11 15:38:27 -08:00
powderluv
30eb10c990
Update to 3.11
2023-02-11 03:47:14 -08:00
Ean Garvey
c28cc4c919
Fix local_tank_cache handling in shark_downloader. ( #981 )
2023-02-09 14:52:03 -06:00
Ean Garvey
51300d33a7
Remove non-SD args from generate_sharktank.py ( #970 )
2023-02-07 13:29:55 -06:00
Ean Garvey
1eb9436836
Fix generate_sharktank args.
2023-02-07 14:06:07 +05:30
Ean Garvey
9604d9ce81
make --update_tank update only if hash mismatch
2023-02-07 14:06:07 +05:30
Ean Garvey
481d0553d8
Remove unnecessary repro_dir / shark_tmp usage
2023-02-07 14:06:07 +05:30
Daniel Garvey
157ae64f9d
print to stdout for test visibility ( #937 )
...
Co-authored-by: dan <dan@nod-labs.com >
2023-02-06 01:03:27 -08:00
Ean Garvey
a90812133b
Enable pytests on Windows ( #901 )
2023-02-01 18:36:41 -06:00
Daniel Garvey
e374074013
Windows test ( #896 )
...
* add generate_sharktank for stable_diffusion model defaults
* add windows test for sd
---------
Co-authored-by: dan <dan@nod-labs.com >
2023-02-01 12:03:54 -06:00
powderluv
81e3d1c2c6
switch to apps/
2023-02-01 06:54:20 -08:00
Daniel Garvey
6bf991edf6
adding more robust main.py testing ( #889 )
...
Co-authored-by: dan <dan@nod-labs.com >
2023-01-30 00:14:26 -08:00
Ean Garvey
fb6beae27c
Adds pytest-forked dependency to fix pytest memory accumulation issues. ( #876 )
...
* Minor improvements to test-models workflow
- cleaned up pytest command line args in Validate Models job scripts.
- Removed -s flag to provide more readable logs
- Changed shark_cache location to within github workspace and removed --update_tank flag from Linux workflows.
* Use pytest-forked for managing pytest memory usage.
2023-01-26 18:20:15 -06:00
powderluv
8265e34a29
Add SHARK SD CLI tool ( #870 )
2023-01-24 23:14:32 -08:00
powderluv
d55d8be504
Add signing of release builds
2023-01-24 21:32:21 -08:00
powderluv
a5db785dd7
checkoutv2 on windows
2023-01-24 18:23:22 -08:00
powderluv
1c1c5cd611
Build Windows nightly on 7950x
2023-01-24 16:21:56 -08:00
Daniel Garvey
e842c8c19b
add main.py testing for sdiff ( #836 )
...
Co-authored-by: dan <dan@nod-labs.com >
Co-authored-by: powderluv <powderluv@users.noreply.github.com >
2023-01-22 01:16:17 -08:00
Ean Garvey
a14a47af12
Move most xfails to entries in tank/all_models.csv and temporarily remove multiprocessing and TF gpu support. ( #646 )
...
-Adds date variable back to nightly.yml so shark_tank uploads are dated again
-added specification for nightly pytests to not run tests on metal (vulkan is sufficient)
-added some paths/filetypes to be ignored when triggering workflow runs. (no test-models on changes to .md files or anything in the shark/examples/ directory or its subdirectories.
-pytest only picks up tank/test_models.py, so no need to specify which file to run when running pytest from SHARK base directory.
-Cleaned up xfails so that they can be added to models as csv entries. Columns 7-9 in all_models.csv trigger xfails with cpu, cuda, vulkan, respectively, and row 10 can be populated with a reason for the xfails.
-Fixed a few defaults for shark_args and pytest args (defined in conftest.py)
-Fixes --update_tank option in shark_downloader
removes some multiprocessing in pytest / TF+CUDA support because it breaks pytest and false passes, leaving regressions at large.
-Adds xfails for and removes albert torch from gen_sharktank list (tank/torch_model_list.csv).
-Cleans up xfails for cpu, cuda, vulkan (removing old ones)
2022-12-16 12:56:32 +05:30
Phaneesh Barwaria
6aed4423b2
add vulkan lib path ( #638 )
2022-12-15 19:48:29 +07:00
powderluv
d946cffabc
Revert "Move most xfails to entries in tank/all_models.csv and temporarily remove multiprocessing and TF gpu support. ( #602 )" ( #622 )
...
This reverts commit fe618811ee .
2022-12-13 21:49:46 -08:00
Ean Garvey
fe618811ee
Move most xfails to entries in tank/all_models.csv and temporarily remove multiprocessing and TF gpu support. ( #602 )
...
* Move most xfails to entries in tank/all_models.csv
* enable usage of pytest without specifying tank/test_models.py
* add dict_configs.py to gitignore.
* Pin versions for runtimes and torch-mlir for setup.
2022-12-13 18:11:17 -08:00
powderluv
48ec11c514
Build wheels ( #613 )
...
* Build wheels
* Update nightly.yml
* Update nightly.yml
* Update nightly.yml
2022-12-12 20:53:08 -08:00
powderluv
e64aa40b17
Add Windows nightly builder
2022-12-11 19:31:02 -08:00
Ean Garvey
616ee9b824
Don't include baseline benchmarks if setup without IMPORTER=1. ( #607 )
2022-12-10 14:58:29 -06:00
PhaneeshB
64d6da75c7
Resolve Mac torch-mlir torch setup dependency. Enable MacOS CI
2022-11-07 15:38:37 +05:30
Ean Garvey
9956099516
Add pytest option for updating tank and fix save_mlir function. ( #413 )
...
* Use IREE tf tools to save .mlir modules when generating shark_tank.
* Add option to pytest for enabling auto-updates to local shark tank.
* xfail mobilenet torch on cpu, cuda and fix CI macos setup
* Update test-models.yml to disable macos vulkan CI.
2022-10-25 21:29:18 +05:30
Ean Garvey
0bfe30d75d
Fix issues with extra_args in benchmarks, pin tf==2.10 ( #411 )
2022-10-20 06:55:26 -07:00
powderluv
139aff2938
Update nightly.yml
...
fix links
2022-10-18 23:42:22 -07:00
Ean Garvey
3405607917
(TESTING) Fix .whl assets path ( #404 )
2022-10-14 12:13:14 -05:00
Phaneesh Barwaria
21fee8ef33
enable only one workflow job per branch ( #402 )
2022-10-13 12:15:30 -05:00
Phaneesh Barwaria
00a8ce75d1
Xfail vulkan tests and Enable MacOs test on CI ( #383 )
2022-10-13 11:14:41 -05:00
Ean Garvey
13bae2538a
Update URL for IREE compiler/runtime install ( #397 )
...
* Update URL for IREE compiler/runtime install
* Update gh-pages-releases.yml
* Update test_models.py
* Update assets path
2022-10-12 15:47:11 -05:00
Ean Garvey
f508c80c23
Add workflow for GH pages releases and release scraping script. ( #394 )
...
* Add workflow for GH pages releases and release scraping script.
* Update test_models.py and change tokens for gh pages.
2022-10-11 22:03:33 -05:00
Daniel Garvey
d38e37bd99
seperate importer and benchmark deps ( #393 )
2022-10-08 23:31:20 -05:00
Daniel Garvey
c54815de17
edit assets path ( #376 )
2022-09-28 16:42:36 -05:00
Ean Garvey
9035a2eed3
Add --local_tank_cache flag and update requirements. ( #368 )
...
* Add --local_tank_cache flag and update requirements.
* Update requirements-importer.txt
2022-09-28 03:02:59 -05:00