Thomas Raoux 6ac9d51ff0 [OPTIMIZATION] Enable pipelining for bwd flash attention (#2590) ...

This allow pipelining when a load is used by multiple dot in a loop.

Relax the condition to pipeline dot operands for mma v3 case. This
improves performance for the bwd pass from 260TF to 275TF. However this
expose a performance problem due to the wmma pipelining as ptxas will
now fall back to serial wgmma. A follow up PR will fix a bug in how we
emit wgmma_wait during pipelining and will bring performance to 335TF

2023-11-03 11:46:51 -07:00

..

examples

Reformat Python code with yapf. (#2589)

2023-11-02 20:44:17 -07:00

src

[OPTIMIZER] Thread local reduction optimization (#2542)

2023-10-31 16:13:36 -07:00

test

Reformat Python code with yapf. (#2589)

2023-11-02 20:44:17 -07:00

triton

[OPTIMIZATION] Enable pipelining for bwd flash attention (#2590)

2023-11-03 11:46:51 -07:00

tutorials

[OPTIMIZATION] Enable pipelining for bwd flash attention (#2590)

2023-11-03 11:46:51 -07:00

MANIFEST.in

[TOOLS] improved ahead-of-time compiler (#1805)

2023-06-21 01:02:58 -07:00

pyproject.toml

Enable ruff linter instead of flake8 (#2574)

2023-10-31 21:28:24 +00:00

setup.py

Reformat Python code with yapf. (#2589)

2023-11-02 20:44:17 -07:00