Skip to content

[CUDA] Fix gather_mm - #3503

Merged
zcbenz merged 1 commit into
ml-explore:mainfrom
zcbenz:cuda-gather-gemm
May 12, 2026
Merged

zcbenz merged 1 commit into
ml-explore:mainfrom
zcbenz:cuda-gather-gemm

Conversation

@zcbenz

@zcbenz zcbenz commented May 10, 2026 •

Copy link
Copy Markdown
Member

The sm70/sm80 kernels of CUTLASS v3 are in a weird state: no one uses them, no one maintains them, they have bugs and I had a really hard time trying to find a maintainer who actually understand the kernels to look into the bugs.

Anyway it is much easier to just write the kernel in plain CuTe and it should be better for long term maintenance since the code no longer requires domain-specific knowledge of CUTLASS C++ APIs.

This PR removes the last entries in cuda_skip.py‎ and I'm deleting the file, for future TODO items in CUDA backend we can just use @unittest.skipIf.

@zcbenz
zcbenz force-pushed the cuda-gather-gemm branch 2 times, most recently from 30ef7e1 to b104e41 Compare May 10, 2026 11:12
@zcbenz
zcbenz force-pushed the cuda-gather-gemm branch from b104e41 to 0e29858 Compare May 10, 2026 11:49

@angeloskath angeloskath left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome!

@zcbenz
zcbenz merged commit 0778926 into ml-explore:main May 12, 2026
16 checks passed
@zcbenz
zcbenz deleted the cuda-gather-gemm branch May 12, 2026 00:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants