github/ROCm
1
1
Fork 0
mirror of https://github.com/ROCm/ROCm.git synced 2026-04-05 03:01:17 -04:00
Code Issues Packages Projects Releases Wiki Activity

[HOPPER] Move to tl.make_block_ptr in flash_attention backward scripts (#2395)

Browse Source
This commit is contained in:
runseny
2023-10-20 11:06:48 +08:00
committed by GitHub
parent 30186f401e
commit dc9e3063d7
3 changed files with 93 additions and 28 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/test/regression/test_performance.py
View File

@@ -158,7 +158,7 @@ flash_attention_data = {
(4, 48, 4096, 64, False, True, 'forward', 'float16'): 0.541,
(4, 48, 4096, 64, False, True, 'forward', 'bfloat16'): 0.471,
(4, 48, 1024, 16, False, True, 'forward', 'float32'): 0.150,
(4, 48, 4096, 64, False, True, 'backward', 'float16'): 0.263,
(4, 48, 4096, 64, False, True, 'backward', 'float16'): 0.291,
(4, 48, 4096, 64, False, True, 'backward', 'bfloat16'): 0.255,
(4, 48, 1024, 16, False, True, 'backward', 'float32'): 0.144,
(4, 48, 4096, 64, False, False, 'forward', 'float16'): 0.306,