Commit Graph

159 Commits

Author SHA1 Message Date
nharris-lmg
a89bf135fe add version to test report (#52) 2024-04-18 13:42:01 -07:00
Nikolas
e5da504928 add version to test report 2024-04-18 13:23:49 -07:00
nharris-lmg
7eb9fe3617 Add pugetbench harness (#51) 2024-04-17 16:08:24 -07:00
Nikolas
81f8e2430d add readme 2024-04-17 16:04:29 -07:00
Nikolas
f21410b802 is it over? 2024-04-17 15:59:23 -07:00
Nikolas
98ab43bcf6 more fixes 2024-04-17 15:52:33 -07:00
Nikolas
158f31c44f linter fixes 2024-04-17 15:49:31 -07:00
Nikolas
7b90142dc0 remove comment 2024-04-17 15:35:05 -07:00
Nikolas
a24aae5187 add puget fixes 2024-04-17 15:30:45 -07:00
Nikolas
9b4414e61e some fixes 2024-04-15 13:36:48 -07:00
derek-hirotsu
1d3d0a1c5a add option for version 4.1.0 to blender benchmark harness (#50) 2024-04-15 13:20:22 -07:00
Nikolas
a761abccf6 first draft for testing 2024-04-15 11:43:23 -07:00
nharris-lmg
2497c797e6 Add API to test name for reports (#49)
Some of the tests have API choices!
2024-03-05 10:56:11 -08:00
Nikolas
70f70cf28d Add API to test name for reports 2024-03-05 10:36:43 -08:00
nharris-lmg
9f9ebc029a Update non-game benchmark report jsons (#48)
- Added `unit` properties to each report.json missing one.
- Updated the test names to be more display friendly
2024-02-26 09:21:29 -08:00
Nikolas
c22d981c41 everyone loves a linter 2024-02-26 09:13:40 -08:00
Nikolas
19054e98f0 Update non-game benchmark report jsons 2024-02-26 09:05:27 -08:00
derek-hirotsu
ba5652f934 fix type error (#47)
- Fix type error
- Make error log slightly more descriptive
2024-02-20 15:03:57 -08:00
derek-hirotsu
bc205701a0 update search for config file (#45)
- Update DOTA 2 test utils script to check for alternative file path
when attempting to read video config file if initial file is not found
2024-02-16 11:52:01 -08:00
derek-hirotsu
148855e01e small tweak to mouse input timings for Total War: Warhammer III (#46) 2024-02-16 11:45:31 -08:00
derek-hirotsu
2a3cd9ae60 DOTA 2 start/end time default values (#43)
Provide default values for start and end times to relax requirements of
needing to find these values for a test to pass.

- Add default/fallback values for test start/end times.
- Remove `sys.exit` if prompt for marking start/end times are not found
2024-01-04 13:19:53 -08:00
nharris-lmg
888c0ceee0 Updating recording harness to have a report.json (#42) 2024-01-03 17:50:59 -08:00
Nikolas
cdd2d330ec linter update 2024-01-03 17:45:01 -08:00
Nikolas
686ecda3cd Linter have mercy 2024-01-03 17:43:33 -08:00
derek-hirotsu
00889abc30 TLoU start/end time marking (#41)
- Update start and end time marking strategies for TLoU: Part I test
harness
2024-01-02 14:47:50 -08:00
derek-hirotsu
5a6d60f4f2 F1 23 - Start/End time marking strategies (#40)
Update start and end time marking strategies for F1 23 test harness
2024-01-02 14:22:18 -08:00
derek-hirotsu
aab68ee821 Atomic Heart start/end time strategies (#39)
- Update start time marking strategy to mark start time once in game
dialog is found instead of relying on loading screen text.
- Update end time marking strategy to mark end time once waypoint text
is found instead of relying on quest UI text popup
2024-01-02 10:36:21 -08:00
nharris-lmg
0eb3bb1925 Fix gravitymark report (#38) 2023-12-27 14:13:53 -08:00
Nikolas
e959882b16 fix report for gravitymark 2023-12-27 14:02:09 -08:00
Nikolas
591725afd4 Merge branch 'main' of github.com:LTTLabsOSS/markbench-tests into niharris/update-benchmark-reports 2023-12-27 14:01:53 -08:00
nharris-lmg
f6c78093ee Update blender render duration format (#37) 2023-12-27 08:11:34 -08:00
Nikolas
39425f39b0 Merge branch 'main' of github.com:LTTLabsOSS/markbench-tests into niharris/update-benchmark-reports 2023-12-26 11:42:44 -08:00
Nikolas
7554c12ead Update blender render duration format 2023-12-26 11:42:36 -08:00
nharris-lmg
f5c4ff3346 Update non-game benchmarks reports to fit new schema (#36) 2023-12-26 09:57:55 -08:00
Nikolas
fee08ae2e3 Update 2023-12-26 09:13:16 -08:00
Nikolas
17681e9c80 Further linting 2023-12-26 09:11:23 -08:00
Nikolas
5545ac09e0 cspell my nemesis 2023-12-26 08:54:51 -08:00
Nikolas
d14f9049bb Fix blender benchmark for intel arc 2023-12-26 08:45:13 -08:00
Nikolas
41e4f9c0ae Merge branch 'main' of github.com:LTTLabsOSS/markbench-tests into niharris/update-benchmark-reports 2023-12-26 08:40:13 -08:00
derek-hirotsu
7563ae4483 update manifest with version 4.0.0 (#35) 2023-12-22 16:04:21 -08:00
nharris-lmg
1735ed5f67 Remove accidental zip (#34) 2023-12-22 15:46:13 -08:00
nharris-lmg
92da6d3249 Remove accidental zip 2023-12-22 15:43:23 -08:00
Nikolas
c5fb378e2b update blender time comparison 2023-12-22 10:49:26 -08:00
Nikolas
7e2f28062e Update non-game benchmarks 2023-12-19 15:09:21 -08:00
derek-hirotsu
c9484019d0 Cyberpunk 2077 navigation and start/end time marking update (#33)
- Update menu navigation and start/end time marking strategies for
Cyberpunk 2077 test harness
2023-12-19 13:20:04 -08:00
derek-hirotsu
b407f46b2b Rocket League navigation and timing adjustments (#31)
- Adjustments to main menu navigation and strategies for marking
start/end times for better reliability on lower resolutions
2023-12-19 13:15:04 -08:00
derek-hirotsu
a4199118ec Update Returnal end time requirements (#32)
- Update Returnal script to not fail if end time prompt not found. The
script will still look for the results screen prompt to determine if a
run has completed successfully.
2023-12-19 13:09:36 -08:00
nharris-lmg
49b1c0aa86 Add initial 3dMark harness (#30) 2023-12-15 10:40:54 -08:00
Nikolas
4a80f75ffa fix linter 2023-12-15 10:37:51 -08:00
Nikolas
5e7f6081ac Switch to purely pathlib 2023-12-15 10:35:37 -08:00