rocmPackages.aotriton: 0.9.2b -> 0.10b#439056
Merged
pbsds merged 1 commit intoNixOS:masterfrom Sep 7, 2025
Merged
Conversation
This comment was marked as outdated.
This comment was marked as outdated.
|
This pull request has been mentioned on NixOS Discourse. There might be relevant details there: |
18 tasks
pbsds
reviewed
Sep 3, 2025
3a36d43 to
248906f
Compare
This comment was marked as outdated.
This comment was marked as outdated.
248906f to
1bb7513
Compare
This comment was marked as outdated.
This comment was marked as outdated.
Member
Author
|
Oh that's fun. The combination of this diff and 2a2a51e doesn't build, but either works alone. Marking draft since that just got merged, glad we didn't merge both in quick succession. |
1bb7513 to
fc5983d
Compare
LunNova
commented
Sep 3, 2025
fc5983d to
400c14c
Compare
Member
Author
|
GaetanLepage
approved these changes
Sep 4, 2025
Contributor
GaetanLepage
left a comment
There was a problem hiding this comment.
LGTM overall. Made minor comments.
Diff: ROCm/aotriton@0.9.2b...0.10b Significantly improves the build by reusing python3Packages.triton
400c14c to
4f33cb4
Compare
Member
Author
|
Applied both suggestions |
GaetanLepage
approved these changes
Sep 4, 2025
Contributor
GaetanLepage
left a comment
There was a problem hiding this comment.
Thanks. Would like a second opinion though.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Diff: ROCm/aotriton@0.9.2b...0.10b
This is a rewrite of
aotriton/default.nix. We're properly reusing the existingpython3Packages.tritoninstance as the build-time triton instead of letting aotriton's CMakeLists.txt build its own triton, so lots of hackery can be dropped! and some packages that weren't actually used and were in buildInputs 😅If in future we needed to pin a specific triton source rev here with an override it should be relatively safe as it's a build time only dependency and won't run into collisions like in many cases in python packaging.
For now we have no need to pin triton; aotriton builds happily against triton 3.4.
This is a followup to the recent torch bump #431973. torch 2.8 introduced faster sliding window attention via aotriton but requires a minimum version of 0.10b to enable it.
https://github.com/pytorch/pytorch/blob/379ebdaf5e2fbf387de297f673254d005e583b31/aten/src/ATen/native/transformers/hip/flash_attn/aot/mha_all_aot.hip#L96-L119
Things done
passthru.tests.nixpkgs-reviewon this PR. See nixpkgs-review usage../result/bin/.Add a 👍 reaction to pull requests you find important.