ORT-HF Benchmark Integration (#101)

-Add HF Benchmarker class.
-Add sample to benchmark HF model.

Example:
```bash
python -m benchmarks.hf_model_benchmark --num_iterations=10 --model_name="microsoft/MiniLM-L12-H384-uncased"
```
This commit is contained in:
Stanley Winata
2022-06-07 23:49:39 -07:00
committed by GitHub
parent a9faeae794
commit 8565be9b6b
11 changed files with 221 additions and 6 deletions

View File

@@ -90,5 +90,5 @@ jobs:
- name: Validate Models
run: |
source shark.venv/bin/activate
pytest -k 'not benchmark'
pytest -k 'not benchmark' --ignore=shark/tests/test_hf_benchmark.py