Skip to content

hpctoolkit: add version 2022.10.01#33078

Merged
eugeneswalker merged 7 commits intospack:developfrom
mwkrentel:krentel/toolkit-2022.10.01
Oct 11, 2022
Merged

hpctoolkit: add version 2022.10.01#33078
eugeneswalker merged 7 commits intospack:developfrom
mwkrentel:krentel/toolkit-2022.10.01

Conversation

@mwkrentel
Copy link
Copy Markdown
Member

  1. add version 2022.10.01
  2. remove version for master branch, develop is now the main branch
  3. add CPATH and LD_LIBRARY_PATH to module run environment, this is for apps that want to use the start/stop interface
  4. cleanup style in variants, depends and conflicts
  5. remove all-static variant, nothing uses it
  6. deprecate more old versions

 1. add version 2022.10.01
 2. remove version for master branch, develop is now the main branch
 3. add CPATH and LD_LIBRARY_PATH to module run environment,
    this is for apps that want to use the start/stop interface
 4. cleanup style in variants, depends and conflicts
 5. remove all-static variant, nothing uses it
 6. deprecate more old versions
@mwkrentel
Copy link
Copy Markdown
Member Author

@alalazo @tldahlgren
My PR fails one of the black formatting rules.
How do I find what line number and how to reformat?

Is there some way to automatically reformat?
I can't find the button for that.

@alalazo
Copy link
Copy Markdown
Member

alalazo commented Oct 7, 2022

@spackbot fix style

@spackbot-app
Copy link
Copy Markdown

spackbot-app bot commented Oct 7, 2022

Let me see if I can fix that for you!

@spackbot-app
Copy link
Copy Markdown

spackbot-app bot commented Oct 7, 2022

I was able to run spack style --fix for you!

spack style --fix
==> Running style checks on spack
  selected: isort, mypy, black, flake8
==> Modified files
  var/spack/repos/builtin/packages/hpctoolkit/package.py
==> Running isort checks
  isort checks were clean
==> Running mypy checks
Success: no issues found in 558 source files
  mypy checks were clean
==> Running black checks
reformatted var/spack/repos/builtin/packages/hpctoolkit/package.py
All done! ✨ 🍰 ✨
1 file reformatted.
  black checks were clean
==> Running flake8 checks
  flake8 checks were clean
==> spack style checks were clean
Keep in mind that I cannot fix your flake8 or mypy errors, so if you have any you'll need to fix them and update the pull request. If I was able to push to your branch, if you make further changes you will need to pull from your updated branch before pushing again.

I've updated the branch with isort fixes.

@mwkrentel
Copy link
Copy Markdown
Member Author

@alalazo Thanks! I'm still adjusting to the new formatter,
but I'll try to remember that.

Btw, besides the items 1-6 listed above, most of the diff is I did a little
rearranging of the variants and conflict to put related items together.

alalazo
alalazo previously approved these changes Oct 7, 2022
Copy link
Copy Markdown
Member

@alalazo alalazo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One comment. Let me know if it is fine to merge as is.

alalazo
alalazo previously approved these changes Oct 7, 2022
@mwkrentel
Copy link
Copy Markdown
Member Author

@alalazo Ok, I incorporated your suggestion.
I also eliminated the conflict for +gtpin ~level_zero since it's now redundant.

Unfortunately, adding +level_zero expands the "when" column awkwardly.
It might be better if spack allocated a width for each field and then
paginated within that width.
As is, running 'spack info' uses a lot of columns and the spillover looks ugly.

@alalazo
Copy link
Copy Markdown
Member

alalazo commented Oct 7, 2022

@spackbot run pipeline

@spackbot-app
Copy link
Copy Markdown

spackbot-app bot commented Oct 7, 2022

I've started that pipeline for you!

@mwkrentel
Copy link
Copy Markdown
Member Author

@alalazo @hainest @blue42u
It took some digging, but I figured out why the ci pipeline is
failing. In the 2022.10.01 release, we have temporarily disabled +mpi
for hpcprof-mpi because there are some unresolved errors in the code.
And some of the e4s tests try to build hpcprof-mpi.

We would prefer not to delay the release to take the time to track
down the bugs and fix them. That's scheduled for the next release.

How should I handle this? I can think of a couple options:

  1. Turn off the e4s test for hpcprof-mpi. I think this is the right
    thing to do.

Can someone show me how to do that?

  1. Put in a hack in the spack recipe to build hpcprof-mpi anyway
    (there is a "force build" option). It should build, but some inputs
    cause it to crash. I think this is the wrong option and defeats the
    purpose of disabling hpcprof-mpi for now.

Plus, I see that I forgot to add a conflict for +mpi when @2022.10.01.
That would break any attempt to build +mpi.

Sorry for causing this trouble. We didn't realize that this would
break one of the tests.

@alalazo
Copy link
Copy Markdown
Member

alalazo commented Oct 9, 2022

@mwkrentel Let me know when the mitigation looks good to you and I'll merge.

alalazo
alalazo previously approved these changes Oct 10, 2022
@alalazo
Copy link
Copy Markdown
Member

alalazo commented Oct 10, 2022

@mwkrentel Is it good to be merged?

@mwkrentel
Copy link
Copy Markdown
Member Author

@alalazo Not quite yet. First, I want to ask E4S if it's feasible to temporarily
disable the ci/pipeline test that failed in the first place.
I decide sometime later today.

@mwkrentel
Copy link
Copy Markdown
Member Author

@alalazo @eugeneswalker
Ok, I've pushed up what I hope will be the last edit.
Assuming the CI tests pass and I expect they will,
then I'm ready to merge.
Thanks

@hainest
Copy link
Copy Markdown
Contributor

hainest commented Oct 10, 2022

@mwkrentel At the E4S meeting today, I brought up this issue with the ci pipeline. Sameer told me to email him and Wyatt, so they will take a look.

@mwkrentel
Copy link
Copy Markdown
Member Author

@eugeneswalker Ok, all green checks !

@eugeneswalker eugeneswalker merged commit c7472c8 into spack:develop Oct 11, 2022
@mwkrentel
Copy link
Copy Markdown
Member Author

@hainest We decided to go ahead and merge the workaround for now.
But I'd still like to know how to handle this type of issue in the future.

What if we make a change in the package.py recipe that causes one of
the ci/gitlab tests to break?

Where do we go to update the ci tests?
And how big a deal is that?

@hainest
Copy link
Copy Markdown
Contributor

hainest commented Oct 11, 2022

@mwkrentel I'm afraid I don't know. I hope Sameer or Wyatt can help us with that.

luke-dt pushed a commit to dantaslab/spack that referenced this pull request Oct 12, 2022
* hpctoolkit: add version 2022.10.01

 1. add version 2022.10.01
 2. remove version for master branch, develop is now the main branch
 3. add CPATH and LD_LIBRARY_PATH to module run environment,
    this is for apps that want to use the start/stop interface
 4. cleanup style in variants, depends and conflicts
 5. remove all-static variant, nothing uses it
 6. deprecate more old versions

* [@spackbot] updating style on behalf of mwkrentel

* Add when(+level_zero) to the gtpin variant.

* Test commit to see if this passes E4S.

* Another test commit to see if E4S succeeds.

* Add temporary hack to ignore +mpi for version 2022.10.01 and issue a
warning instead.

Co-authored-by: mwkrentel <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants