AMD-SHARK-Studio/tank/all_models.csv at fb6beae27c4b076cbbf9d88d6bcbc084ede899a1

mirror of https://github.com/nod-ai/AMD-SHARK-Studio.git synced 2026-04-03 03:00:17 -04:00

Files

Ean Garvey fb6beae27c Adds pytest-forked dependency to fix pytest memory accumulation issues. (#876 )

* Minor improvements to test-models workflow

- cleaned up pytest command line args in Validate Models job scripts.
- Removed -s flag to provide more readable logs
- Changed shark_cache location to within github workspace and removed --update_tank flag from Linux workflows.

* Use pytest-forked for managing pytest memory usage.

2023-01-26 18:20:15 -06:00

3.6 KiB

Raw Blame History

1	resnet50	mhlo	tf	1e-2	1e-3	default	nhcw-nhwc	False	False	True	Vulkan Numerical Error: mostly conv
2	albert-base-v2	mhlo	tf	1e-2	1e-2	default	None	False	False	False
3	roberta-base	mhlo	tf	1e-02	1e-3	default	nhcw-nhwc	False	False	False
4	bert-base-uncased	mhlo	tf	1e-2	1e-3	default	None	False	False	False
5	camembert-base	mhlo	tf	1e-2	1e-3	default	None	False	False	False
6	dbmdz/convbert-base-turkish-cased	mhlo	tf	1e-2	1e-3	default	nhcw-nhwc	True	True	True	https://github.com/iree-org/iree/issues/9971
7	distilbert-base-uncased	mhlo	tf	1e-2	1e-3	default	None	False	False	False
8	facebook/convnext-tiny-224	mhlo	tf	1e-2	1e-3	tf_vit	nhcw-nhwc	True	True	True	https://github.com/nod-ai/SHARK/issues/311 & https://github.com/nod-ai/SHARK/issues/342
9	funnel-transformer/small	mhlo	tf	1e-2	1e-3	default	None	True	True	True	https://github.com/nod-ai/SHARK/issues/201
10	google/electra-small-discriminator	mhlo	tf	1e-2	1e-3	default	None	False	False	False
11	google/mobilebert-uncased	mhlo	tf	1e-2	1e-3	default	None	True	False	False	Fails during iree-compile.
12	google/vit-base-patch16-224	mhlo	tf	1e-2	1e-3	tf_vit	nhcw-nhwc	False	False	True	Vulkan Numerical Error (mostly conv)
13	microsoft/MiniLM-L12-H384-uncased	mhlo	tf	1e-2	1e-3	tf_hf	None	True	False	False	Fails during iree-compile.
14	microsoft/layoutlm-base-uncased	mhlo	tf	1e-2	1e-3	default	None	False	False	False
15	microsoft/mpnet-base	mhlo	tf	1e-2	1e-2	default	None	False	False	False
16	albert-base-v2	linalg	torch	1e-2	1e-3	default	None	True	True	True	issue with aten.tanh in torch-mlir
17	alexnet	linalg	torch	1e-2	1e-3	default	None	True	False	True	https://github.com/nod-ai/SHARK/issues/879
18	bert-base-cased	linalg	torch	1e-2	1e-3	default	None	False	False	False
19	bert-base-uncased	linalg	torch	1e-2	1e-3	default	None	False	False	False
20	bert-base-uncased_fp16	linalg	torch	1e-1	1e-1	default	None	True	False	True
21	facebook/deit-small-distilled-patch16-224	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	True	False	Fails during iree-compile.
22	google/vit-base-patch16-224	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	True	False	https://github.com/nod-ai/SHARK/issues/311
23	microsoft/beit-base-patch16-224-pt22k-ft22k	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	True	False	https://github.com/nod-ai/SHARK/issues/390
24	microsoft/MiniLM-L12-H384-uncased	linalg	torch	1e-2	1e-3	default	None	False	False	True
25	microsoft/resnet-50	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	False	True	Vulkan Numerical Error (mostly conv)
26	google/mobilebert-uncased	linalg	torch	1e-2	1e-3	default	None	False	False	True	https://github.com/nod-ai/SHARK/issues/344
27	mobilenet_v3_small	linalg	torch	1e-1	1e-2	default	nhcw-nhwc	False	True	True	https://github.com/nod-ai/SHARK/issues/388
28	nvidia/mit-b0	linalg	torch	1e-2	1e-3	default	None	True	True	True	https://github.com/nod-ai/SHARK/issues/343
29	resnet101	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	False	True	Vulkan Numerical Error (mostly conv)
30	resnet18	linalg	torch	1e-2	1e-3	default	None	True	True	True
31	resnet50	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	False	True	Vulkan Numerical Error (mostly conv)
32	resnet50_fp16	linalg	torch	1e-2	1e-2	default	nhcw-nhwc	True	False	True
33	squeezenet1_0	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	False	True	https://github.com/nod-ai/SHARK/issues/388
34	wide_resnet50_2	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	False	True	Vulkan Numerical Error (mostly conv)
35	efficientnet-v2-s	mhlo	tf	1e-02	1e-3	default	nhcw-nhwc	False	False	True	https://github.com/nod-ai/SHARK/issues/575
36	mnasnet1_0	linalg	torch	1e-2	1e-3	default	nhcw-nhwc	False	False	True	https://github.com/nod-ai/SHARK/issues/388

3.6 KiB Raw Blame History

3.6 KiB

Raw Blame History