AMD port of TurboDiffusion - Working on gfx1151 on Windows

[jammm]

Use rocWMMA for GEMM kernels, and use triton-windows and SpargeAttn modified to support AMD on Windows.
See README_AMD_WINDOWS.md for setup steps.

Generated video using Wan2.1 1.4b 480p default command as per README.md:

generated_video.mp4

Limitations:

• Currently supports only RDNA3/3.5, though can possibly work on RDNA4 with minor modificaitons.
• multi-cta/distributed not tested

[bat3a]

3 Install Dependencies

pip install -r requirements.txt
in which repo?

[jammm]

3 Install Dependencies

pip install -r requirements.txt in which repo?

In Turbodiffusion repo (on this PR branch)

[bat3a]

3 Install Dependencies
pip install -r requirements.txt in which repo?

In Turbodiffusion repo (on this PR branch)

couldnt git clone this branch, so i modified the files by hand
git clone --branch jam/windows_amd https://github.com/woct0rdho/triton-windows.git triton-windows-patch Cloning into 'triton-windows-patch'... fatal: Remote branch jam/windows_amd not found in upstream origin

[jammm]

3 Install Dependencies
pip install -r requirements.txt in which repo?

In Turbodiffusion repo (on this PR branch)

couldnt git clone this branch, so i modified the files by hand git clone --branch jam/windows_amd https://github.com/woct0rdho/triton-windows.git triton-windows-patch Cloning into 'triton-windows-patch'... fatal: Remote branch jam/windows_amd not found in upstream origin

ah, for triton-windows you just need pip install triton-windows. I'll update the README to mention this. My bad

[githust66]

The step “pip install -r requirements.txt” should not be necessary, as the TurboDiffusion project does not contain a requirements.txt file; only the SpargeAttn project includes such a file.

[0xDELUXA]

...though can possibly work on RDNA4 with minor modificaitons.

Sounds promising 👀

[jammm]

The step “pip install -r requirements.txt” should not be necessary, as the TurboDiffusion project does not contain a requirements.txt file; only the SpargeAttn project includes such a file.

Fixed, thanks!

...though can possibly work on RDNA4 with minor modificaitons.

Sounds promising 👀

Yes, it's just a matter of refactoring the rocWMMA code to not assume that the per-thread matrix fragments are replicated across the half-waves. It's just another prompt to claude actually.

[0xDELUXA]

Yes, it's just a matter of refactoring the rocWMMA code to not assume that the per-thread matrix fragments are replicated across the half-waves. It's just another prompt to claude actually.

I'll be the 1st tester though, when the time comes ^^