CUDA for AMD on Windows

chiassedu80

CUDA for AMD on Windows I’ve been working on a Windows setup that lets CUDA-targeted applications run on AMD GPUs using ZLUDA + ROCm/HIP. Repo: https://github.com/Speedstu/CUDA-for-AMD-Windows So far, it has only been tested on my RX 9060 XT (gfx1200), where I’ve used it with CUDA-enabled LibTorch workloads, including long ai training and use. I also added a GPU scanner / auto-detection system that detects: AMD GPU model gfxXXXX architecture ROCm/HIP installation driver info whether the GPU has already been validated by the project Example: RX 9060 XT → gfx1200 → RDNA4 → HIP detected → validated The goal now is to test it on more hardware, especially RX 6000 / 7000 / 9000 cards. If you have an AMD GPU on Windows and want to try it, I’d really appreciate compatibility reports working or broken. There’s a dedicated GPU compatibility issue template in the repo. If this is useful to you, a star would also help the project get more testers.

system2

I wish there were a way to use RDNA1 cards with CUDA for AMD. My 5700XTs are sitting in a drawer.

lulzx

I made cuda-metal btw (for mac kek), https://github.com/lulzx/cuda-metal

linuxhansl

Off-topic and somewhat of a rant, but I'd far prefer us all focusing on open standards like HIP, SYCL, OpenCL, etc. It's unbearable that most LLM inference happens on closed H/W, closed drivers, and closed SDKs.

swerner

AI will take down Nvidia’s moat. When it becomes trivial to translate CUDA/PTX to HIP, SYCL or Metal, CUDA is no longer the moat, it becomes the intermediate representation.

Nurysso

man i can't say how much i used to like cuda when i had a nvidia gpu it made ml so much fun and on amd its a war especially on rdna 2 cards which i have. hopefully one day we will be able to properly translate cuda for its amd counter parts

latchkey

There are also interesting efforts like: https://github.com/Zaneham/Booth https://scale-lang.com/

KennyBlanken

To save everyone a click: No cuDNN and based off an ancient version of ROCm for windows (7.1 has been out for ages, 7.2 is current.)

triwats

Interesting option for CDNA architecture chips. I wonder if this moves to an open standard? AMD GPUs build for AI specs for reference: https://flopper.io/gpus?vendor=AMD&page=1

vivzkestrel

stupid question - what exactly is CUDA? - is it patented hardware tech that AMD cannot replicate? - is it a library that ll also work on AMD while it currently works on nvidia - can AMD cook an equivalent of CUDA, if so why havent they done it?

harhargange

If anyone has used this, how good is this? And will it allow running AMD GPU with MATLAB? I have a 7900xt