I’ve not yet had a chance to build or run this, but many of the changes look very positive! Thank you! Something missing here as compared to what I did in the overlay is to move rocm-opencl-runtime from Python 2 to 3. I don’t think that change caused any trouble, and it will help address the nixpkgs migration from 2 to 3.

Thanks for the comment!
I updated the patches to include more of the overlay changes (diff).

One issue I'm having now is that when I try to build something with the hipcc from this PR, I get,

/nix/store/lbxfixyw1yk099pjyaiy3xj5dl7kxm1g-binutils-2.35.2/bin/ld: cannot find -lamdhip64
clang-13: error: linker command failed with exit code 1 (use -v to see invocation)

So it's missing something like a -L $out/lib. Can you see where that might be missing?

I think it might be the way we patch HIP_LIB_PATH in hipcc. You do this nice thing where you build a hip derivation that the final hipamd derivation points to, while I took a single source view approach by copying the hip source into the hipamd build tree. One difference between those approaches is the meaning of $out in different places.

Thanks for testing and digging into this, the HIP_LIB_PATH is indeed wrong!

I previously tested hip with having hip in nativeBuildInputs in a shell.nix and that also added the hip/lib path to NIX_LDFLAGS, so I didn’t encounter this error in my testing.
I now tried again without hip in the build inputs and it works after removing the HIP_LIB_PATH replacement (which makes HIP_LIB_PATH default to $HIP_ROCCLR_HOME/lib, which is the correct path).

@Flakebi Do you by any chance have cachix setup with CI builds for your fork? Building llvm and clang to test is a real drag on cycle time.

I usually use my beefy work machine to compile anything that contains llvm, that alleviates the pain 🙂 I guess I could push the builds somewhere, but it looks like cachix costs something?

cachix has a free tier for open source projects, and it can be hooked into GitHub CI quite nicely. This is sloppy, but you can see how it's used in the nixos-rocm overlay so that users don't have to build anything.

I've not set it up myself for a nixpkgs fork, so that could be an issue. But there is also the option to manually push store paths which would work for this case.

No matter: my small tests of hip and OpenCL ran properly, so I'm happy with this. If you're satisfied with the PR now, @Flakebi , and neither @matthewbauer nor @lovesegfault chime in, I'll merge the PR later tonight.

That’s fine with me, thanks for testing again.
Next time, I’ll try pushing the builds to cachix.

Looks AOK for me :)

Thank you for taking this on and seeing it through, @Flakebi!