I’m curious if anyone has had much luck leveraging older AMD hardware to use ROCm, I have an 6700 xt that I’ve just begun inquiring about, and it seems it falls outside of official support.
Right now I intend to pass it through to my Debian Docker VM to support transcoding in some containers in addition to machine learning applications.
You must log in or # to comment.
I run it on a 6650xt just fine. I have to explicitly set what version I want, but no issues.
You should be in a better spot with a 6700xt.
Mostly bad, but running AI models on Vulkan surprisingly isn’t any worse than ROCm, so there is little point in using that it seems.
Just use Vulkan backends.
My 6700xt works pretty well with nixos, arch, Debian and Ubuntu. Can’t seem to get comfyui to recognize it, but ollama and lama.ccp use it just fine. Just cause it’s not supported doesn’t mean it won’t work. I have an instinct mi25 that I flashed to a wx9100, per this. About 6 months ago, was working great on Debian 12, Ubuntu 20 and 22, nixos and arch. Now, can’t even get it to work on Ubuntu 20 using rocm 5.4. Super sad I can’t leverage the extra vram.
ROCm on my 7900xt is solid. ROCm on my MI50s (Vega) is a NIGHTMARE
and here I thought the instinct vega line was within supported scope, no wonder nvidia is eating amd’s lunch
It’s a lot easier to just use the vulkan support for models and seems to work well enough
Yeah, it technically works, but requires telling ROCm you have a 6800 XT instead
My RX 6600 can use HIP just fine in blender
I had it working on a 5700xt a couple years ago
God after buying an amd machine last year I’m never doing it again.
What are you trying to use rocm for? Their own guides don’t work.
A couple of years ago, I bought a Radeon laptop, just to see how things were going with ROCm. It worked out ok, but convinced me not to buy a discrete Radeon GPU for my desktop.
I decided to buy another Nvidia card, and finally start investing in NVDA.
mostly it is the hardware I have on hand; first project in mind is ROCm machine learning for immich. after that it’s pretty much trying to understand the technology, I’m sure I’ll come up with something fun.
I don’t know how the immich ml works, but if you’re going LLMs stick to llama.cpp.
going beyond that, I’ve had serious kernel bugs with PyTorch and onnx that are still unresolved. The most popular ML/AI frameworks basically don’t work due to drivers for me.
Vulkan flows are fine and generally comparable in speed so far, so if there’s a vulkan option try rock first then revert to vulkan.
thanks for the heads up, in truth I’d probably be headed to vulkan now if it were compatible with immich. I’ll put llama.cpp on my radar.
