Skip to content

Revert "ci: disable tutorial pipeline (#3249)"#3255

Merged
alecbcs merged 2 commits intodevelopfrom
ci/enable-tutorial-pipeline
Feb 6, 2026
Merged

Revert "ci: disable tutorial pipeline (#3249)"#3255
alecbcs merged 2 commits intodevelopfrom
ci/enable-tutorial-pipeline

Conversation

@becker33
Copy link
Copy Markdown
Member

@becker33 becker33 commented Feb 5, 2026

This reverts commits c3ce4ac and 8d0701f.

We need the tutorial pipeline to keep running in CI. Yes, it elides the differences between two of the zlib-ng specs and that's not ideal. Yes, it will be better once we merge the concretization groups PR. But we still need to keep building it for now so that errors don't accumulate.

The tutorial stack as used in the tutorial is not currently buildable in CI, but the old version with an external gcc is buildable to ensure things don't break.

This reverts commit c3ce4ac.

Signed-off-by: Gregory Becker <[email protected]>
@spackbot-triage spackbot-triage bot added the ci Issues related to Continuous Integration label Feb 5, 2026
alecbcs
alecbcs previously approved these changes Feb 5, 2026
Copy link
Copy Markdown
Member

@alecbcs alecbcs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with Greg's assessment here. Although it's not building a perfect tutorial stack, it's useful to continue building these packages to in the interim to ensure they continue working for the tutorial.

@alecbcs alecbcs enabled auto-merge (squash) February 5, 2026 01:54
kwryankrattiger
kwryankrattiger previously approved these changes Feb 5, 2026
Copy link
Copy Markdown
Contributor

@kwryankrattiger kwryankrattiger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agreed. I was a bit surprised to see it disabled

tgamblin
tgamblin previously approved these changes Feb 5, 2026
@alalazo
Copy link
Copy Markdown
Member

alalazo commented Feb 5, 2026

For context, this was disabled because the packages were built with a mix of gcc and clang in the netlib-scalapack matrix due to unify:when_possible. This results in pipelines that are always ❌ in spack/spack and in specs that are not what they meant to be for the tutorial.

The tutorial pipeline is fixed in #3175 but that PR needs spack/spack#51891 to work

@alalazo
Copy link
Copy Markdown
Member

alalazo commented Feb 5, 2026

@kwryankrattiger Is there a way to mark a pipeline xfail so that it doesn't result in a ❌ pushed to PR status?

Copy link
Copy Markdown
Member

@haampie haampie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with @alalazo's xfail suggestion. Greg's reason to revert skips over the other reason this was merged.

I think it's more important to use latest Spack in this repo (#3253), especially after concretizer related changes, than it is to build the tutorial stack. It's not for lack of trying to make both work: https://spackpm.slack.com/archives/CJUC2P5M2/p1769612032952209, it's just practically impossible (either the concretizer gets stuck for ~2h, or it runs out of memory, or it produces incorrect results).

@haampie haampie disabled auto-merge February 5, 2026 07:03
@haampie
Copy link
Copy Markdown
Member

haampie commented Feb 5, 2026

Hm, no, I take back that xfail is a good solution, disabling it is best.

For example the tutorial pipeline continues to block improvements to packages: #3234. Concretization consistently times out after 1h+ there.

@tgamblin
Copy link
Copy Markdown
Member

tgamblin commented Feb 5, 2026

For context, this was disabled because the packages were built with a mix of gcc and clang in the netlib-scalapack matrix due to unify:when_possible. This results in pipelines that are always ❌ in spack/spack and in specs that are not what they meant to be for the tutorial.

This is a way better reason to disable and/or xfail the pipeline than the reasons outlined in #3249. Or maybe bullet 3 in #3249 is trying to address this? It's not as clear there as how @alalazo explains it above. I don't think others got the full context either.

I am ok with keeping this disabled if we can:

  1. Keep the tutorial alive in stacks: use environment with groups #3175 and keep rebasing that (via environment: allow group of specs with dependencies spack#51891) on spack-packages/develop until we get this fixed.
  2. Prioritize environment: allow group of specs with dependencies spack#51891.

Is that workable? I agree that it is important to keep the tutorial alive -- updating it before conferences is important. Thinking particularly for ISC -- if we do not reinstate the pipeline well before that, then getting the tutorial working for ISC is going to be painful.

For users who want to do the tutorial, the build cache will live on, while we work out the kinks here -- in that people doing the tutorial via our containers can still rely on the binaries -- right?

@haampie
Copy link
Copy Markdown
Member

haampie commented Feb 5, 2026

Sounds reasonable to me if the tutorial stack is only tested in #3175 where it actually concretizes to specs used in the tutorial ;)

Then #3234 and #3253, which would be blocked by the revert, can be merged after this PR is closed/resolved.

…ntainer) (#2277)"

This reverts commit 8d0701f.

Signed-off-by: Gregory Becker <[email protected]>
@becker33 becker33 dismissed stale reviews from tgamblin, kwryankrattiger, and alecbcs via 36f3ed8 February 5, 2026 18:01
@becker33 becker33 requested a review from tldahlgren as a code owner February 5, 2026 18:01
@becker33
Copy link
Copy Markdown
Member Author

becker33 commented Feb 5, 2026

As suggested in our slack conversation, I am also reverting the changes to the tutorial pipeline to use when_possible

This will result in a stack that is not usable in the tutorial, but will at least check the relevant specs/builds until we can refactor this after spack/spack#51891 goes in.

@haampie
Copy link
Copy Markdown
Member

haampie commented Feb 5, 2026

Duration: 2 minutes 42 seconds

:)

@alecbcs
Copy link
Copy Markdown
Member

alecbcs commented Feb 6, 2026

@spackbot run pipeline

@spackbot-app
Copy link
Copy Markdown

spackbot-app bot commented Feb 6, 2026

I've started that pipeline for you!

@alecbcs alecbcs enabled auto-merge (squash) February 6, 2026 01:44
@alecbcs alecbcs merged commit 06c2cf8 into develop Feb 6, 2026
23 checks passed
@alecbcs alecbcs deleted the ci/enable-tutorial-pipeline branch February 6, 2026 02:17
@alalazo
Copy link
Copy Markdown
Member

alalazo commented Feb 9, 2026

I'd still be for reverting the revert, unless somebody wants to fix silo in this pipeline

2026-02-09_11-54

# Test package relocation on linux using a modified prefix
# This is not well supported on MacOS (https://github.com/spack/spack/issues/37162)
- - spack config add "config:install_tree:projections:${SPACK_JOB_SPEC_PKG_NAME}/${SPACK_JOB_SPEC_DAG_HASH}:'morepadding/{architecture.platform}-{architecture.target}/{name}-{version}-{hash}'"
- - spack config add "config:install_tree:projections:${SPACK_JOB_SPEC_PKG_NAME}:'morepadding/{architecture.platform}-{architecture.target}/{name}-{version}-{hash}'"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This introduces bugs when we have multiple instances of the same package in the DAG. Just hit one in a branch with multiple gcc-runtime.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll re-submit this change in a PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci Issues related to Continuous Integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants