50 Commits

Author	SHA1	Message	Date
Stanley Winata	95c2e3d6ea	Enable Benchmark tests (#129)	2022-06-14 14:05:26 -07:00
powderluv	cb7007ce16	Update test-models.yml ... remove pip cache hang on osx and enable benchmarks on perf-linux	2022-06-14 12:23:07 -07:00
Stanley Winata	e48642f8a5	Update benchmark command to ToM and Add to test (#125) ... -Update benchmark_cl to latest benchmark_module API -tensorflow OOM issue.	2022-06-13 23:57:05 -07:00
powderluv	3cbd697aa6	Update test-models.yml	2022-06-13 09:12:26 -07:00
Ean Garvey	acdd1d1785	Update model testing utilities. (#119)	2022-06-13 02:16:30 -07:00
Ean Garvey	cbd131d588	Refactor testing framework. (#117)	2022-06-12 20:15:30 -07:00
powderluv	bcf9dbb3bf	Update test-models.yml	2022-06-12 17:28:18 -07:00
powderluv	ac84f3b0d5	Update test-models.yml	2022-06-12 17:08:00 -07:00
powderluv	719d053ba8	Update test-models.yml	2022-06-12 17:03:18 -07:00
powderluv	c68e572f1a	Update test-models.yml ... add a100	2022-06-12 15:55:39 -07:00
powderluv	d6785cdce7	Update test-models.yml	2022-06-12 01:02:03 -07:00
powderluv	4b35dec83b	Update test-models.yml	2022-06-12 00:43:22 -07:00
powderluv	35fa22f167	Update test-models.yml	2022-06-11 00:54:27 -07:00
powderluv	1887e8e3ef	Update test-models.yml	2022-06-11 00:42:07 -07:00
Chi_Liu	8640c3ebfe	Add shark_importer tflite module and albert_shark_test example (#110)	2022-06-09 06:17:22 -07:00
Stanley Winata	8565be9b6b	ORT-HF Benchmark Integration (#101) ... -Add HF Benchmarker class. -Add sample to benchmark HF model. Example: ```bash python -m benchmarks.hf_model_benchmark --num_iterations=10 --model_name="microsoft/MiniLM-L12-H384-uncased" ```	2022-06-07 23:49:39 -07:00
powderluv	ea54298d6c	Update test-models.yml	2022-06-06 12:08:40 -07:00
powderluv	2d09b0600d	Update test-models.yml ... add yapf	2022-06-06 11:46:24 -07:00
powderluv	886912f9a0	Update test-models.yml ... delete a100 for now	2022-06-05 10:26:25 -07:00
powderluv	f24b1a7eee	Update test-models.yml	2022-06-05 10:08:30 -07:00
powderluv	269493c678	Disable gpu tests for now	2022-06-04 23:25:12 -07:00
powderluv	718c235bad	Update test-models.yml	2022-06-04 21:52:02 -07:00
powderluv	11b99c9b30	add pip cache	2022-06-04 21:44:35 -07:00
powderluv	afe246b71b	Update test-models.yml	2022-06-04 21:28:07 -07:00
powderluv	17ae15d9f8	Update test-models.yml	2022-06-04 20:06:29 -07:00
powderluv	d99859596b	Update test-models.yml	2022-06-04 19:41:04 -07:00
powderluv	75db9a30f1	Update test-models.yml	2022-06-04 16:32:26 -07:00
powderluv	02fcdc4cc8	Update test-models.yml	2022-06-04 16:05:49 -07:00
powderluv	9457e9850c	Update test-models.yml	2022-06-04 15:59:24 -07:00
powderluv	e340b85128	Update test-models.yml	2022-06-04 15:49:26 -07:00
powderluv	21e9b6f6c2	Update test-models.yml ... source and then conda activate perfbot	2022-06-04 15:04:33 -07:00
powderluv	e91ee9e165	use conda on a100	2022-06-04 14:59:33 -07:00
powderluv	d2a2c9066d	Update test-models.yml ... back to 3.9	2022-06-04 14:38:00 -07:00
powderluv	cca4837bc9	Update test-models.yml	2022-06-04 14:29:13 -07:00
powderluv	274d2ca9c2	Add perf-linux bot ... add perf-linux	2022-06-04 14:27:08 -07:00
powderluv	f3bc775d18	Update test-models.yml	2022-06-04 14:02:46 -07:00
powderluv	9a5a5841a1	Update test-models.yml ... remove benchmarks in GH	2022-06-04 09:45:50 -07:00
powderluv	a7f75d329e	Update test-models.yml ... one worker on mac	2022-06-03 23:50:38 -07:00
powderluv	7fac03a023	Update test-models.yml ... ignore benchmark on osx	2022-06-03 20:01:42 -07:00
powderluv	2c743fec78	Update test-models.yml ... fix osx builder	2022-06-03 15:10:30 -07:00
powderluv	88e86142f0	Update test-models.yml	2022-06-03 14:45:42 -07:00
powderluv	5b2d4292b1	Update test-models.yml ... use python3.9 on osx	2022-06-03 14:20:15 -07:00
powderluv	60962dc7c1	add osx tester	2022-06-03 12:30:37 -07:00
powderluv	aba351c493	auto detect number of workers. ... use auto detect for number of pytest workers	2022-06-02 23:32:36 -07:00
anush elangovan	1fa05fc7c8	Rename to tflite and ignore lit.cfg.py in flake8	2022-06-03 05:21:23 +00:00
Prashant Kumar	04291fdfcb	Add vgg and alexnet models to passing tests.	2022-05-27 21:35:02 +05:30
powderluv	96acb32fc1	Update test-models.yml	2022-05-26 21:06:20 -07:00
powderluv	a72f727501	Update test-models.yml	2022-05-26 21:03:35 -07:00
Stanley Winata	c8fcfd6077	Set parallel work as manually configured option (#58)	2022-05-24 15:26:28 -07:00
Prashant Kumar	bd212634c1	Add CI for testing of various models. (#28) ... Added pytest CI for testing for Pytorch Inference and vision models.	2022-04-27 06:52:49 -07:00