Skip to content

WRF: Add version 3.9.1.1 and improve recipe robustness#19882

Merged
adamjstewart merged 5 commits intospack:developfrom
numericalalgorithmsgroup:robust_wrf
Nov 16, 2020
Merged

WRF: Add version 3.9.1.1 and improve recipe robustness#19882
adamjstewart merged 5 commits intospack:developfrom
numericalalgorithmsgroup:robust_wrf

Conversation

@ptooley
Copy link
Copy Markdown
Contributor

@ptooley ptooley commented Nov 12, 2020

PR to improve several aspects of WRF support in Spack:

The headline issue here is the fact that upstream use make -i -k and their custom make script always returns 0. This means that the standard approach of checking the return code won't detect a failed build. Instead we need to actually check the output of the script to see if it succeeded. My approach is the least-bad solution I could find.

Second big issue is that the configure script enforces interactivity and dynamically generates its option. Previous recipe version had response values hardcoded for an assumed x86 platform. This new version should be platform independent and has been tested on at least aarch64 and x86_64.

Additionally I have added support for v 3.9 which is a common HPC benchmarking workload, and fixed an issue with failure to compile against recent glibcs that don't ship sunrpc headers.

  • Include version 3.9.1.1 as common benchmarking workload
  • Fix compilation against recent glibc (use spack installed libtirpc)
  • Detect and handle failed compilation (upstream use make -i)

Copy link
Copy Markdown
Member

@adamjstewart adamjstewart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@MichaelLaufer can you review this?

* Include version 3.9.1.1 as common benchmarking workload
* Fix compilation against recent glibc (detect spack installed libtirpc)
* Detect and handle failed compilation (upstream use make -i)
fix build jobs
fix maintainers
fix pkgconfig dependency
use Executable to run compile stage
repair some overzealous autoformatting by black
@ptooley
Copy link
Copy Markdown
Contributor Author

ptooley commented Nov 13, 2020

All changes included and I also cleaned up some of the more egregious formatting choices my autoformatter made...

Apologies for the force push - I tried to rebase my local repo onto the latest develop and got in a complete mess.

Copy link
Copy Markdown
Member

@adamjstewart adamjstewart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Few more comments on the Spack recipe. I don't know much about WRF so I can't review the patches.

Copy link
Copy Markdown
Member

@adamjstewart adamjstewart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me from my end. Since this is a pretty big change I'm still hoping for a review from @MichaelLaufer or another WRF user. Let's give it a few days. If we don't hear back, ping me and I'll merge.

@ptooley
Copy link
Copy Markdown
Contributor Author

ptooley commented Nov 16, 2020

Looks good to me from my end. Since this is a pretty big change I'm still hoping for a review from @MichaelLaufer or another WRF user. Let's give it a few days. If we don't hear back, ping me and I'll merge.

Thanks! Do you want this squashed to a single commit before merge?

@adamjstewart
Copy link
Copy Markdown
Member

Do you want this squashed to a single commit before merge?

Nah, we automatically squash and merge all PRs, so there's no need to do it yourself.

@MichaelLaufer
Copy link
Copy Markdown
Contributor

Looks good to me from my end. Since this is a pretty big change I'm still hoping for a review from @MichaelLaufer or another WRF user. Let's give it a few days. If we don't hear back, ping me and I'll merge.

@ptooley @adamjstewart
We are having some IT issues on our cluster at the moment so I could not test this out. I hope to have it fixed by tomorrow. Looks good, and I am happy to see V3.9.1.1 support!

@adamjstewart
Copy link
Copy Markdown
Member

In that case I'll merge for now and we can backport any changes if they are needed later. Thanks for reviewing @MichaelLaufer!

@adamjstewart adamjstewart merged commit 42008e5 into spack:develop Nov 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants