15 Commits

Author SHA1 Message Date
pdhirajkumarprasad
fe03539901 Migration to AMDShark (#2182)
Signed-off-by: pdhirajkumarprasad <dhirajp@amd.com>
2025-11-20 12:52:07 +05:30
Daniel Garvey
ebfcfec338 remove shark 1.0 tests, add support for 2.0 llm
* add support for external weights

* add tests and edit deps
2023-12-14 21:44:37 -06:00
Ean Garvey
2191fc8952 Separate pytest benchmark modes and fix model updates for SHARK downloader / pytest. (#1264)
* Only xfail windows models in CI

* downloader: make model updates more robust.

* Separate baseline and native benchmarks in pytest.

* Fix native benchmarks

* Fix torchvision model utils.
2023-04-03 08:24:21 -07:00
Ean Garvey
a14a47af12 Move most xfails to entries in tank/all_models.csv and temporarily remove multiprocessing and TF gpu support. (#646)
-Adds date variable back to nightly.yml so shark_tank uploads are dated again
-added specification for nightly pytests to not run tests on metal (vulkan is sufficient)
-added some paths/filetypes to be ignored when triggering workflow runs. (no test-models on changes to .md files or anything in the shark/examples/ directory or its subdirectories.
-pytest only picks up tank/test_models.py, so no need to specify which file to run when running pytest from SHARK base directory.
-Cleaned up xfails so that they can be added to models as csv entries. Columns 7-9 in all_models.csv trigger xfails with cpu, cuda, vulkan, respectively, and row 10 can be populated with a reason for the xfails.
-Fixed a few defaults for shark_args and pytest args (defined in conftest.py)
-Fixes --update_tank option in shark_downloader
removes some multiprocessing in pytest / TF+CUDA support because it breaks pytest and false passes, leaving regressions at large.
-Adds xfails for and removes albert torch from gen_sharktank list (tank/torch_model_list.csv).
-Cleans up xfails for cpu, cuda, vulkan (removing old ones)
2022-12-16 12:56:32 +05:30
powderluv
d946cffabc Revert "Move most xfails to entries in tank/all_models.csv and temporarily remove multiprocessing and TF gpu support. (#602)" (#622)
This reverts commit fe618811ee.
2022-12-13 21:49:46 -08:00
Ean Garvey
fe618811ee Move most xfails to entries in tank/all_models.csv and temporarily remove multiprocessing and TF gpu support. (#602)
* Move most xfails to entries in tank/all_models.csv

* enable usage of pytest without specifying tank/test_models.py

* add dict_configs.py to gitignore.

* Pin versions for runtimes and torch-mlir for setup.
2022-12-13 18:11:17 -08:00
Ean Garvey
cbd131d588 Refactor testing framework. (#117) 2022-06-12 20:15:30 -07:00
anush elangovan
1fa05fc7c8 Rename to tflite and ignore lit.cfg.py in flake8 2022-06-03 05:21:23 +00:00
anush elangovan
1186d7c58e disable tflite tests 2022-06-02 20:16:16 +00:00
Stanley Winata
c8fcfd6077 Set parallel work as manually configured option (#58) 2022-05-24 15:26:28 -07:00
Prashant Kumar
96c28685ce Added device map and runs test according to the driver.
Automatically runs test according to the device driver present.
2022-05-17 19:33:54 +05:30
Prashant Kumar
63f9b206ac Modify pytest to run a certain test. 2022-05-17 16:58:08 +05:30
Prashant Kumar
dcc1bbac14 Add pytests-parametrize with device and dynamic option.
Added pytests-parametrize with device and dynamic options, also
added worker flag in pytest to run tests concurrently.
2022-05-17 11:07:56 +05:30
anush elangovan
628d5aa112 Ingore inference tests 2022-05-16 03:04:51 +00:00
Prashant Kumar
bd212634c1 Add CI for testing of various models. (#28)
Added pytest CI for testing for Pytorch Inference and vision models.
2022-04-27 06:52:49 -07:00