Unwanted duplicate packages for Intel unified-dev environment on Orion #1477
Description
Describe the bug
The intel unified-dev environment for the Intel compiler set is producing unwanted duplicates in the concretize step. Here is the output of show_duplicate_packages.py
[ue-intel-test] orion-login-2[110] herbener$ ../../util/show_duplicate_packages.py -d log.concretize
ph345on [email protected]%[email protected]~ipo+python+shared+utils build_system=cmake build_type=Release generator=make test_files=none arch=linux-rocky9-skylake_avx512
6f26fpg [email protected]%[email protected]~ipo+python+shared+utils build_system=cmake build_type=Release generator=make test_files=none arch=linux-rocky9-skylake
qe467cs [email protected]%[email protected]~ipo+python build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
rcuf3e7 [email protected]%[email protected]~ipo+python build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
zohtrou [email protected]%[email protected]+fix~ipo build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
veonfpk [email protected]%[email protected]+fix~ipo build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
ujod65x [email protected]%[email protected]+fix~ipo build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake
hhcb3ee [email protected]%[email protected] cxxflags='-fp-model precise' fflags='-fp-model precise' ~debug~external-lapack+external-parallelio+mpi+netcdf~pnetcdf+python+shared~xerces build_system=makefile esmf_comm=auto esmf_os=auto esmf_pio=auto patches=f63d405 snapshot=none arch=linux-rocky9-skylake_avx512
ahyggrp [email protected]%[email protected] cxxflags='-fp-model precise' fflags='-fp-model precise' ~debug~external-lapack+external-parallelio+mpi+netcdf~pnetcdf+python+shared~xerces build_system=makefile esmf_comm=auto esmf_os=auto esmf_pio=auto patches=f63d405 snapshot=none arch=linux-rocky9-skylake
i3mibbe [email protected]%[email protected] cxxflags='-fp-model precise' fflags='-fp-model precise' ~debug~external-lapack+external-parallelio+mpi+netcdf~pnetcdf+python+shared~xerces build_system=makefile esmf_comm=auto esmf_os=auto esmf_pio=auto patches=f63d405 snapshot=none arch=linux-rocky9-skylake_avx512
khhxhzv [email protected]%[email protected]+bufrquery+fftw+hdf4 build_system=bundle arch=linux-rocky9-skylake_avx512
jbruuvv [email protected]%[email protected]+bufrquery+fftw+hdf4 build_system=bundle arch=linux-rocky9-skylake_avx512
rpyt5dx [email protected]%[email protected]~debug+extdata2g~f2py+fargparse~ipo+pflogger~pfunit~shared build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
x2srcuy [email protected]%[email protected]~debug+extdata2g~f2py+fargparse~ipo+pflogger~pfunit~shared build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake
5yxxf5n [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
cgi4wtw [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake
7ttejsm [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
heksufs [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
mitt2pp [email protected]%[email protected]~mpi build_system=python_pip arch=linux-rocky9-skylake_avx512
ws6vge6 [email protected]%[email protected]~mpi build_system=python_pip arch=linux-rocky9-skylake_avx512
4gm5a3p [email protected]%[email protected]+mpi build_system=python_pip patches=255b5ae arch=linux-rocky9-skylake
6nywkag [email protected]%[email protected]+mpi build_system=python_pip patches=255b5ae arch=linux-rocky9-skylake_avx512
65kaf2d [email protected]%[email protected] build_system=python_pip patches=873745d arch=linux-rocky9-skylake
hcroitu [email protected]%[email protected] build_system=python_pip patches=873745d arch=linux-rocky9-skylake_avx512
jtxqrzt [email protected]%[email protected]~excel~performance build_system=python_pip arch=linux-rocky9-skylake_avx512
p2iufak [email protected]%[email protected]~excel~performance build_system=python_pip arch=linux-rocky9-skylake
fjlbga4 [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
7wjmfoe [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
ytctukt [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
a4cn5kv [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
ifw2owm [email protected]%[email protected] build_system=python_pip patches=3720932 arch=linux-rocky9-skylake_avx512
pxikksb [email protected]%[email protected] build_system=python_pip patches=3720932 arch=linux-rocky9-skylake_avx512
pr3dihn [email protected]%[email protected]~io~parallel~viz build_system=python_pip arch=linux-rocky9-skylake_avx512
fblduwi [email protected]%[email protected]~io~parallel~viz build_system=python_pip arch=linux-rocky9-skylake
===
Duplicates found!
[ue-intel-test] orion-login-2[111] herbener$
I'm getting this from the feature branches for the libirc PR #1435. I'm also seeing similar behavior from the Intel build the @RatkoVasic-NOAA recently did:
[ue-intel-test] orion-login-2[112] herbener$ ../../util/show_duplicate_packages.py -d /work/noaa/epic/role-epic/spack-stack/orion/spack-stack-1.9.0-dom2/envs/ue-intel/log.concretize
ph345on [email protected]%[email protected]~ipo+python+shared+utils build_system=cmake build_type=Release generator=make test_files=none arch=linux-rocky9-skylake_avx512
6f26fpg [email protected]%[email protected]~ipo+python+shared+utils build_system=cmake build_type=Release generator=make test_files=none arch=linux-rocky9-skylake
qe467cs [email protected]%[email protected]~ipo+python build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
rcuf3e7 [email protected]%[email protected]~ipo+python build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
veonfpk [email protected]%[email protected]+fix~ipo build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
ujod65x [email protected]%[email protected]+fix~ipo build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake
zohtrou [email protected]%[email protected]+fix~ipo build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
i3mibbe [email protected]%[email protected] cxxflags='-fp-model precise' fflags='-fp-model precise' ~debug~external-lapack+external-parallelio+mpi+netcdf~pnetcdf+python+shared~xerces build_system=makefile esmf_comm=auto esmf_os=auto esmf_pio=auto patches=f63d405 snapshot=none arch=linux-rocky9-skylake_avx512
ahyggrp [email protected]%[email protected] cxxflags='-fp-model precise' fflags='-fp-model precise' ~debug~external-lapack+external-parallelio+mpi+netcdf~pnetcdf+python+shared~xerces build_system=makefile esmf_comm=auto esmf_os=auto esmf_pio=auto patches=f63d405 snapshot=none arch=linux-rocky9-skylake
hhcb3ee [email protected]%[email protected] cxxflags='-fp-model precise' fflags='-fp-model precise' ~debug~external-lapack+external-parallelio+mpi+netcdf~pnetcdf+python+shared~xerces build_system=makefile esmf_comm=auto esmf_os=auto esmf_pio=auto patches=f63d405 snapshot=none arch=linux-rocky9-skylake_avx512
khhxhzv [email protected]%[email protected]+bufrquery+fftw+hdf4 build_system=bundle arch=linux-rocky9-skylake_avx512
jbruuvv [email protected]%[email protected]+bufrquery+fftw+hdf4 build_system=bundle arch=linux-rocky9-skylake_avx512
4j634ov [email protected]%[email protected]~debug+extdata2g~f2py+fargparse~ipo+pflogger~pfunit~shared build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake
w4o4wmz [email protected]%[email protected]~debug+extdata2g~f2py+fargparse~ipo+pflogger~pfunit~shared build_system=cmake build_type=Release generator=make arch=linux-rocky9-skylake_avx512
cgi4wtw [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake
5yxxf5n [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
7ttejsm [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
heksufs [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
ws6vge6 [email protected]%[email protected]~mpi build_system=python_pip arch=linux-rocky9-skylake_avx512
mitt2pp [email protected]%[email protected]~mpi build_system=python_pip arch=linux-rocky9-skylake_avx512
4gm5a3p [email protected]%[email protected]+mpi build_system=python_pip patches=255b5ae arch=linux-rocky9-skylake
6nywkag [email protected]%[email protected]+mpi build_system=python_pip patches=255b5ae arch=linux-rocky9-skylake_avx512
hcroitu [email protected]%[email protected] build_system=python_pip patches=873745d arch=linux-rocky9-skylake_avx512
65kaf2d [email protected]%[email protected] build_system=python_pip patches=873745d arch=linux-rocky9-skylake
jtxqrzt [email protected]%[email protected]~excel~performance build_system=python_pip arch=linux-rocky9-skylake_avx512
p2iufak [email protected]%[email protected]~excel~performance build_system=python_pip arch=linux-rocky9-skylake
7wjmfoe [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
fjlbga4 [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
ytctukt [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
a4cn5kv [email protected]%[email protected] build_system=python_pip arch=linux-rocky9-skylake_avx512
pxikksb [email protected]%[email protected] build_system=python_pip patches=3720932 arch=linux-rocky9-skylake_avx512
ifw2owm [email protected]%[email protected] build_system=python_pip patches=3720932 arch=linux-rocky9-skylake_avx512
pr3dihn [email protected]%[email protected]~io~parallel~viz build_system=python_pip arch=linux-rocky9-skylake_avx512
fblduwi [email protected]%[email protected]~io~parallel~viz build_system=python_pip arch=linux-rocky9-skylake
===
Duplicates found!
[ue-intel-test] orion-login-2[113] herbener$
There seems to be an issue with skylake vs skylake-avx512 architecture.
It's not clear if the PR #1435 introduced this behavior. I suspect not and this behavior has likely been around for a while. I don't think this issue should hold up PR #1435.
I think this is a specific Orion/Intel configuration issue meaning that we should not hold up the 1.9.0 installation and testing on other platforms.
To Reproduce
Follow the instructions for building a local environment here: https://spack-stack.readthedocs.io/en/latest/PreConfiguredSites.html#create-local-environment, and select orion, unified-dev, and intel compiler.
Use the feature branches from #1435, but I suspect you can use the 1.9.0 release branches or the develop braches as well.
Then run spack concretize or spack concretize --fresh.
Expected behavior
The concretize step should only produce the expected duplicates (esmf, crtm)
System:
What system(s) are you running the code on?
Orion, Intel unified-dev environment
Additional context
Add any other context about the problem here.