superlu-dist: add 8.1.1, 8.1.0 and 8.0.0 versions by balos1 · Pull Request #32558 · spack/spack

balos1 · 2022-09-07T19:43:17Z

No description provided.

spackbot-app · 2022-09-07T19:43:44Z

@gchavez2 @xiaoye can you review this PR?

This PR modifies the following package(s), for which you are listed as a maintainer:

superlu-dist

balos1 · 2022-09-07T20:54:33Z

@liuyangzhuan When trying to build [email protected] with CUDA, I am getting some errors:

[balos1@tux419 superludist]$ spack install [email protected]~int64+cuda cuda_arch=60
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/ncurses-6.2-wckv5lplcakrbnsmghw6ki3ezwcjvcwp
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/zlib-1.2.11-7xsa4oqvgg2255vgsiohjlx2xbtaexld
[+] /usr/local/cuda-11.4 (external cuda-11.4.120-ndnaqtuxkenm2edjhnid67h74v7quycd)
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/metis-5.1.0-7elj2bi46vwmxp6f3bduypj3rzienuiz
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/openblas-0.3.20-kc5yedqdmlkb2d4btzpp2yubn43huvxp
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/libpciaccess-0.16-pwjtuntfqoew7ng5ak2janzfoovs64zv
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/libiconv-1.16-l73a7iauma35rgttv5qvbhfky2rshzxe
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/xz-5.2.5-36o3jyfm4gyp5amsebemtdsrlyqhchtd
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/numactl-2.0.14-r7tgccy2u76c2ox5vi4i3r4mhwvckbux
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/openssl-1.1.1h-yobyrdd76pr76ajm32mz5elofzey7yjy
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/libxml2-2.9.10-qt25lktodjovkza2ankai3u7icn2qos4
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/cmake-3.18.4-fz4jyiye35znpicc6lzd42qu67dp27r3
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/hwloc-1.11.11-jzclfal3lun53ksxsmjqf7belww6lmqc
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/openmpi-3.1.6-alqklubcznnik6zplspsukfyzwbertnk
[+] /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/parmetis-4.0.3-e5hskobjyskdeedcab7nd2wcobivs3ql
==> Installing superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3
==> No binary for superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3 found: installing from source
==> Using cached archive: /home/balos1/spack/var/spack/cache/_source-cache/archive/93/9308844b99a7e762d5704934f7e9f79daf158b0bfc582994303c2e0b31518b34.tar.gz
==> No patches needed for superlu-dist
==> superlu-dist: Executing phase: 'cmake'
==> superlu-dist: Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
    'make' '-j12'

16 errors found in build log:
     999     
     1000    /tmp/balos1/spack-stage/spack-stage-superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3/spack-src/SRC/zsuperlu_gpu.cu(709): warning: function "printDevProp" was declared but never referenced
     1001    
     1002    [ 70%] Linking CUDA device code CMakeFiles/superlu_dist.dir/cmake_device_link.o
     1003    cd /tmp/balos1/spack-stage/spack-stage-superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3/spack-build-ctophhu/SRC && /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/cmake-3.18.4-fz4jyiye35znpicc6lzd42qu67dp27r3/bin/cmake -E cmake_link_scrip
             t CMakeFiles/superlu_dist.dir/dlink.txt --verbose=1
     1004    /usr/local/cuda-11.4/bin/nvcc -forward-unknown-to-host-compiler -ccbin=/home/balos1/spack/opt/spack/linux-rhel7-haswell/gcc-4.8.5/gcc-9.3.0-glfiwwbhh4lzrir4boyokqyiio6fguzx/bin/g++ -DUSE_VENDOR_BLAS -arch=sm_60 -O2 -g -DNDEBUG --generate-code=arch=compute_60,
             code=[compute_60,sm_60] -Xcompiler=-Wl,-rpath,/home/balos1/spack/opt/spack/linux-rhel7-haswell/gcc-4.8.5/gcc-9.3.0-glfiwwbhh4lzrir4boyokqyiio6fguzx/lib/gcc/x86_64-pc-linux-gnu/9.3.0,-Wl,-rpath,/home/balos1/spack/opt/spack/linux-rhel7-haswell/gcc-4.8.5/gcc-9.3
             .0-glfiwwbhh4lzrir4boyokqyiio6fguzx/lib64,-Wl,-rpath,-Wl,/home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/hwloc-1.11.11-jzclfal3lun53ksxsmjqf7belww6lmqc/lib,-Wl,-rpath,-Wl,/home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/zlib
             -1.2.11-7xsa4oqvgg2255vgsiohjlx2xbtaexld/lib,-Wl,-rpath,-Wl,/home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/openmpi-3.1.6-alqklubcznnik6zplspsukfyzwbertnk/lib,-L/home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/hwloc-1.11.11-
             jzclfal3lun53ksxsmjqf7belww6lmqc/lib,-L/home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/zlib-1.2.11-7xsa4oqvgg2255vgsiohjlx2xbtaexld/lib,-pthread -Xcompiler=-fPIC -Wno-deprecated-gpu-targets -shared -dlink CMakeFiles/superlu_dist.dir/sp_ienv.
             c.o CMakeFiles/superlu_dist.dir/etree.c.o CMakeFiles/superlu_dist.dir/sp_colorder.c.o CMakeFiles/superlu_dist.dir/get_perm_c.c.o CMakeFiles/superlu_dist.dir/mmd.c.o CMakeFiles/superlu_dist.dir/comm.c.o CMakeFiles/superlu_dist.dir/memory.c.o CMakeFiles/superlu
             _dist.dir/util.c.o CMakeFiles/superlu_dist.dir/gpu_api_utils.c.o CMakeFiles/superlu_dist.dir/superlu_grid.c.o CMakeFiles/superlu_dist.dir/pxerr_dist.c.o CMakeFiles/superlu_dist.dir/superlu_timer.c.o CMakeFiles/superlu_dist.dir/symbfact.c.o CMakeFiles/superlu_
             dist.dir/psymbfact.c.o CMakeFiles/superlu_dist.dir/psymbfact_util.c.o CMakeFiles/superlu_dist.dir/get_perm_c_parmetis.c.o CMakeFiles/superlu_dist.dir/mc64ad_dist.c.o CMakeFiles/superlu_dist.dir/xerr_dist.c.o CMakeFiles/superlu_dist.dir/smach_dist.c.o CMakeFil
             es/superlu_dist.dir/dmach_dist.c.o CMakeFiles/superlu_dist.dir/colamd.c.o CMakeFiles/superlu_dist.dir/superlu_dist_version.c.o CMakeFiles/superlu_dist.dir/comm_tree.c.o CMakeFiles/superlu_dist.dir/superlu_grid3d.c.o CMakeFiles/superlu_dist.dir/supernodal_etre
             e.c.o CMakeFiles/superlu_dist.dir/supernodalForest.c.o CMakeFiles/superlu_dist.dir/trfAux.c.o CMakeFiles/superlu_dist.dir/communication_aux.c.o CMakeFiles/superlu_dist.dir/treeFactorization.c.o CMakeFiles/superlu_dist.dir/sec_structs.c.o CMakeFiles/superlu_di
             st.dir/dlangs_dist.c.o CMakeFiles/superlu_dist.dir/dgsequ_dist.c.o CMakeFiles/superlu_dist.dir/dlaqgs_dist.c.o CMakeFiles/superlu_dist.dir/dutil_dist.c.o CMakeFiles/superlu_dist.dir/dmemory_dist.c.o CMakeFiles/superlu_dist.dir/dmyblas2_dist.c.o CMakeFiles/sup
             erlu_dist.dir/dsp_blas2_dist.c.o CMakeFiles/superlu_dist.dir/dsp_blas3_dist.c.o CMakeFiles/superlu_dist.dir/pdgssvx.c.o CMakeFiles/superlu_dist.dir/pdgssvx_ABglobal.c.o CMakeFiles/superlu_dist.dir/dreadhb.c.o CMakeFiles/superlu_dist.dir/dreadrb.c.o CMakeFiles
             /superlu_dist.dir/dreadtriple.c.o CMakeFiles/superlu_dist.dir/dreadtriple_noheader.c.o CMakeFiles/superlu_dist.dir/dbinary_io.c.o CMakeFiles/superlu_dist.dir/dreadMM.c.o CMakeFiles/superlu_dist.dir/pdgsequ.c.o CMakeFiles/superlu_dist.dir/pdlaqgs.c.o CMakeFile
             s/superlu_dist.dir/dldperm_dist.c.o CMakeFiles/superlu_dist.dir/pdlangs.c.o CMakeFiles/superlu_dist.dir/pdutil.c.o CMakeFiles/superlu_dist.dir/pdsymbfact_distdata.c.o CMakeFiles/superlu_dist.dir/ddistribute.c.o CMakeFiles/superlu_dist.dir/pddistribute.c.o CMa
             keFiles/superlu_dist.dir/pdgstrf.c.o CMakeFiles/superlu_dist.dir/dstatic_schedule.c.o CMakeFiles/superlu_dist.dir/pdgstrf2.c.o CMakeFiles/superlu_dist.dir/pdgstrs.c.o CMakeFiles/superlu_dist.dir/pdgstrs1.c.o CMakeFiles/superlu_dist.dir/pdgstrs_lsum.c.o CMakeF
             iles/superlu_dist.dir/pdgstrs_Bglobal.c.o CMakeFiles/superlu_dist.dir/pdgsrfs.c.o CMakeFiles/superlu_dist.dir/pdgsmv.c.o CMakeFiles/superlu_dist.dir/pdgsrfs_ABXglobal.c.o CMakeFiles/superlu_dist.dir/pdgsmv_AXglobal.c.o CMakeFiles/superlu_dist.dir/pdGetDiagU.c
             .o CMakeFiles/superlu_dist.dir/pdgssvx3d.c.o CMakeFiles/superlu_dist.dir/dnrformat_loc3d.c.o CMakeFiles/superlu_dist.dir/pdgstrf3d.c.o CMakeFiles/superlu_dist.dir/dtreeFactorization.c.o CMakeFiles/superlu_dist.dir/dtreeFactorizationGPU.c.o CMakeFiles/superlu_
             dist.dir/dgather.c.o CMakeFiles/superlu_dist.dir/dscatter3d.c.o CMakeFiles/superlu_dist.dir/pd3dcomm.c.o CMakeFiles/superlu_dist.dir/dtrfAux.c.o CMakeFiles/superlu_dist.dir/dcommunication_aux.c.o CMakeFiles/superlu_dist.dir/dtrfCommWrapper.c.o CMakeFiles/supe
             rlu_dist.dir/dsuperlu_blas.c.o CMakeFiles/superlu_dist.dir/pdgstrs_lsum_cuda.cu.o CMakeFiles/superlu_dist.dir/superlu_gpu_utils.cu.o CMakeFiles/superlu_dist.dir/dsuperlu_gpu.cu.o CMakeFiles/superlu_dist.dir/slangs_dist.c.o CMakeFiles/superlu_dist.dir/sgsequ_d
             ist.c.o CMakeFiles/superlu_dist.dir/slaqgs_dist.c.o CMakeFiles/superlu_dist.dir/sutil_dist.c.o CMakeFiles/superlu_dist.dir/smemory_dist.c.o CMakeFiles/superlu_dist.dir/smyblas2_dist.c.o CMakeFiles/superlu_dist.dir/ssp_blas2_dist.c.o CMakeFiles/superlu_dist.di
             r/ssp_blas3_dist.c.o CMakeFiles/superlu_dist.dir/psgssvx.c.o CMakeFiles/superlu_dist.dir/psgssvx_d2.c.o CMakeFiles/superlu_dist.dir/psgssvx_ABglobal.c.o CMakeFiles/superlu_dist.dir/sreadhb.c.o CMakeFiles/superlu_dist.dir/sreadrb.c.o CMakeFiles/superlu_dist.di
             r/sreadtriple.c.o CMakeFiles/superlu_dist.dir/sreadtriple_noheader.c.o CMakeFiles/superlu_dist.dir/sbinary_io.c.o CMakeFiles/superlu_dist.dir/sreadMM.c.o CMakeFiles/superlu_dist.dir/psgsequ.c.o CMakeFiles/superlu_dist.dir/pslaqgs.c.o CMakeFiles/superlu_dist.d
             ir/sldperm_dist.c.o CMakeFiles/superlu_dist.dir/pslangs.c.o CMakeFiles/superlu_dist.dir/psutil.c.o CMakeFiles/superlu_dist.dir/pssymbfact_distdata.c.o CMakeFiles/superlu_dist.dir/sdistribute.c.o CMakeFiles/superlu_dist.dir/psdistribute.c.o CMakeFiles/superlu_
             dist.dir/psgstrf.c.o CMakeFiles/superlu_dist.dir/sstatic_schedule.c.o CMakeFiles/superlu_dist.dir/psgstrf2.c.o CMakeFiles/superlu_dist.dir/psgstrs.c.o CMakeFiles/superlu_dist.dir/psgstrs1.c.o CMakeFiles/superlu_dist.dir/psgstrs_lsum.c.o CMakeFiles/superlu_dis
             t.dir/psgstrs_Bglobal.c.o CMakeFiles/superlu_dist.dir/psgsrfs.c.o CMakeFiles/superlu_dist.dir/psgsrfs_d2.c.o CMakeFiles/superlu_dist.dir/psgsmv.c.o CMakeFiles/superlu_dist.dir/psgsrfs_ABXglobal.c.o CMakeFiles/superlu_dist.dir/psgsmv_AXglobal.c.o CMakeFiles/su
             perlu_dist.dir/psGetDiagU.c.o CMakeFiles/superlu_dist.dir/psgssvx3d.c.o CMakeFiles/superlu_dist.dir/snrformat_loc3d.c.o CMakeFiles/superlu_dist.dir/psgstrf3d.c.o CMakeFiles/superlu_dist.dir/streeFactorization.c.o CMakeFiles/superlu_dist.dir/streeFactorization
             GPU.c.o CMakeFiles/superlu_dist.dir/sgather.c.o CMakeFiles/superlu_dist.dir/sscatter3d.c.o CMakeFiles/superlu_dist.dir/ps3dcomm.c.o CMakeFiles/superlu_dist.dir/strfAux.c.o CMakeFiles/superlu_dist.dir/scommunication_aux.c.o CMakeFiles/superlu_dist.dir/strfComm
             Wrapper.c.o CMakeFiles/superlu_dist.dir/ssuperlu_blas.c.o CMakeFiles/superlu_dist.dir/psgsmv_d2.c.o CMakeFiles/superlu_dist.dir/psgsequb.c.o CMakeFiles/superlu_dist.dir/ssuperlu_gpu.cu.o CMakeFiles/superlu_dist.dir/dcomplex_dist.c.o CMakeFiles/superlu_dist.di
             r/zlangs_dist.c.o CMakeFiles/superlu_dist.dir/zgsequ_dist.c.o CMakeFiles/superlu_dist.dir/zlaqgs_dist.c.o CMakeFiles/superlu_dist.dir/zutil_dist.c.o CMakeFiles/superlu_dist.dir/zmemory_dist.c.o CMakeFiles/superlu_dist.dir/zmyblas2_dist.c.o CMakeFiles/superlu_
             dist.dir/zsp_blas2_dist.c.o CMakeFiles/superlu_dist.dir/zsp_blas3_dist.c.o CMakeFiles/superlu_dist.dir/pzgssvx.c.o CMakeFiles/superlu_dist.dir/pzgssvx_ABglobal.c.o CMakeFiles/superlu_dist.dir/zreadhb.c.o CMakeFiles/superlu_dist.dir/zreadrb.c.o CMakeFiles/supe
             rlu_dist.dir/zreadtriple.c.o CMakeFiles/superlu_dist.dir/zreadtriple_noheader.c.o CMakeFiles/superlu_dist.dir/zbinary_io.c.o CMakeFiles/superlu_dist.dir/zreadMM.c.o CMakeFiles/superlu_dist.dir/pzgsequ.c.o CMakeFiles/superlu_dist.dir/pzlaqgs.c.o CMakeFiles/sup
             erlu_dist.dir/zldperm_dist.c.o CMakeFiles/superlu_dist.dir/pzlangs.c.o CMakeFiles/superlu_dist.dir/pzutil.c.o CMakeFiles/superlu_dist.dir/pzsymbfact_distdata.c.o CMakeFiles/superlu_dist.dir/zdistribute.c.o CMakeFiles/superlu_dist.dir/pzdistribute.c.o CMakeFil
             es/superlu_dist.dir/pzgstrf.c.o CMakeFiles/superlu_dist.dir/zstatic_schedule.c.o CMakeFiles/superlu_dist.dir/pzgstrf2.c.o CMakeFiles/superlu_dist.dir/pzgstrs.c.o CMakeFiles/superlu_dist.dir/pzgstrs1.c.o CMakeFiles/superlu_dist.dir/pzgstrs_lsum.c.o CMakeFiles/
             superlu_dist.dir/pzgstrs_Bglobal.c.o CMakeFiles/superlu_dist.dir/pzgsrfs.c.o CMakeFiles/superlu_dist.dir/pzgsmv.c.o CMakeFiles/superlu_dist.dir/pzgsrfs_ABXglobal.c.o CMakeFiles/superlu_dist.dir/pzgsmv_AXglobal.c.o CMakeFiles/superlu_dist.dir/pzGetDiagU.c.o CM
             akeFiles/superlu_dist.dir/pzgssvx3d.c.o CMakeFiles/superlu_dist.dir/znrformat_loc3d.c.o CMakeFiles/superlu_dist.dir/pzgstrf3d.c.o CMakeFiles/superlu_dist.dir/ztreeFactorization.c.o CMakeFiles/superlu_dist.dir/ztreeFactorizationGPU.c.o CMakeFiles/superlu_dist.
             dir/zscatter3d.c.o CMakeFiles/superlu_dist.dir/zgather.c.o CMakeFiles/superlu_dist.dir/pz3dcomm.c.o CMakeFiles/superlu_dist.dir/ztrfAux.c.o CMakeFiles/superlu_dist.dir/zcommunication_aux.c.o CMakeFiles/superlu_dist.dir/ztrfCommWrapper.c.o CMakeFiles/superlu_d
             ist.dir/zsuperlu_blas.c.o CMakeFiles/superlu_dist.dir/zsuperlu_gpu.cu.o -o CMakeFiles/superlu_dist.dir/cmake_device_link.o   -L/home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/openmpi-3.1.6-alqklubcznnik6zplspsukfyzwbertnk/lib   -L/home/balos
             1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/parmetis-4.0.3-e5hskobjyskdeedcab7nd2wcobivs3ql/lib -lparmetis -L/home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/metis-5.1.0-7elj2bi46vwmxp6f3bduypj3rzienuiz/lib -lmetis -lm -lcudadevrt 
             -lcudart_static -lrt -lpthread -ldl -lmpi
  >> 1005    g++: error: unrecognized command line option '-Wl'; did you mean '-W'?
  >> 1006    g++: error: unrecognized command line option '-rpath'
  >> 1007    g++: error: unrecognized command line option '-Wl'; did you mean '-W'?
  >> 1008    g++: error: unrecognized command line option '-rpath'
  >> 1009    g++: error: unrecognized command line option '-Wl'; did you mean '-W'?
  >> 1010    g++: error: unrecognized command line option '-rpath'
  >> 1011    g++: error: unrecognized command line option '-Wl'; did you mean '-W'?
  >> 1012    g++: error: unrecognized command line option '-Wl'; did you mean '-W'?
  >> 1013    g++: error: unrecognized command line option '-rpath'
  >> 1014    g++: error: unrecognized command line option '-Wl'; did you mean '-W'?
  >> 1015    g++: error: unrecognized command line option '-Wl'; did you mean '-W'?
  >> 1016    g++: error: unrecognized command line option '-rpath'
  >> 1017    g++: error: unrecognized command line option '-Wl'; did you mean '-W'?
  >> 1018    make[2]: *** [SRC/CMakeFiles/superlu_dist.dir/cmake_device_link.o] Error 1
     1019    make[2]: Leaving directory `/tmp/balos1/spack-stage/spack-stage-superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3/spack-build-ctophhu'
  >> 1020    make[1]: *** [SRC/CMakeFiles/superlu_dist.dir/all] Error 2
     1021    make[1]: *** Waiting for unfinished jobs....
     1022    [ 70%] Linking CUDA static library libsuperlu_dist.a
     1023    cd /tmp/balos1/spack-stage/spack-stage-superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3/spack-build-ctophhu/SRC && /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/cmake-3.18.4-fz4jyiye35znpicc6lzd42qu67dp27r3/bin/cmake -P CMakeFiles/super
             lu_dist-static.dir/cmake_clean_target.cmake
     1024    cd /tmp/balos1/spack-stage/spack-stage-superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3/spack-build-ctophhu/SRC && /home/balos1/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.3.0/cmake-3.18.4-fz4jyiye35znpicc6lzd42qu67dp27r3/bin/cmake -E cmake_link_scrip
             t CMakeFiles/superlu_dist-static.dir/link.txt --verbose=1
     1025    /usr/bin/ar qc libsuperlu_dist.a CMakeFiles/superlu_dist-static.dir/sp_ienv.c.o CMakeFiles/superlu_dist-static.dir/etree.c.o CMakeFiles/superlu_dist-static.dir/sp_colorder.c.o CMakeFiles/superlu_dist-static.dir/get_perm_c.c.o CMakeFiles/superlu_dist-static.di
             r/mmd.c.o CMakeFiles/superlu_dist-static.dir/comm.c.o CMakeFiles/superlu_dist-static.dir/memory.c.o CMakeFiles/superlu_dist-static.dir/util.c.o CMakeFiles/superlu_dist-static.dir/gpu_api_utils.c.o CMakeFiles/superlu_dist-static.dir/superlu_grid.c.o CMakeFiles
             /superlu_dist-static.dir/pxerr_dist.c.o CMakeFiles/superlu_dist-static.dir/superlu_timer.c.o CMakeFiles/superlu_dist-static.dir/symbfact.c.o CMakeFiles/superlu_dist-static.dir/psymbfact.c.o CMakeFiles/superlu_dist-static.dir/psymbfact_util.c.o CMakeFiles/supe
             rlu_dist-static.dir/get_perm_c_parmetis.c.o CMakeFiles/superlu_dist-static.dir/mc64ad_dist.c.o CMakeFiles/superlu_dist-static.dir/xerr_dist.c.o CMakeFiles/superlu_dist-static.dir/smach_dist.c.o CMakeFiles/superlu_dist-static.dir/dmach_dist.c.o CMakeFiles/supe
             rlu_dist-static.dir/colamd.c.o CMakeFiles/superlu_dist-static.dir/superlu_dist_version.c.o CMakeFiles/superlu_dist-static.dir/comm_tree.c.o CMakeFiles/superlu_dist-static.dir/superlu_grid3d.c.o CMakeFiles/superlu_dist-static.dir/supernodal_etree.c.o CMakeFile
             s/superlu_dist-static.dir/supernodalForest.c.o CMakeFiles/superlu_dist-static.dir/trfAux.c.o CMakeFiles/superlu_dist-static.dir/communication_aux.c.o CMakeFiles/superlu_dist-static.dir/treeFactorization.c.o CMakeFiles/superlu_dist-static.dir/sec_structs.c.o C
             MakeFiles/superlu_dist-static.dir/dlangs_dist.c.o CMakeFiles/superlu_dist-static.dir/dgsequ_dist.c.o CMakeFiles/superlu_dist-static.dir/dlaqgs_dist.c.o CMakeFiles/superlu_dist-static.dir/dutil_dist.c.o CMakeFiles/superlu_dist-static.dir/dmemory_dist.c.o CMake
             Files/superlu_dist-static.dir/dmyblas2_dist.c.o CMakeFiles/superlu_dist-static.dir/dsp_blas2_dist.c.o CMakeFiles/superlu_dist-static.dir/dsp_blas3_dist.c.o CMakeFiles/superlu_dist-static.dir/pdgssvx.c.o CMakeFiles/superlu_dist-static.dir/pdgssvx_ABglobal.c.o 
             CMakeFiles/superlu_dist-static.dir/dreadhb.c.o CMakeFiles/superlu_dist-static.dir/dreadrb.c.o CMakeFiles/superlu_dist-static.dir/dreadtriple.c.o CMakeFiles/superlu_dist-static.dir/dreadtriple_noheader.c.o CMakeFiles/superlu_dist-static.dir/dbinary_io.c.o CMak
             eFiles/superlu_dist-static.dir/dreadMM.c.o CMakeFiles/superlu_dist-static.dir/pdgsequ.c.o CMakeFiles/superlu_dist-static.dir/pdlaqgs.c.o CMakeFiles/superlu_dist-static.dir/dldperm_dist.c.o CMakeFiles/superlu_dist-static.dir/pdlangs.c.o CMakeFiles/superlu_dist
             -static.dir/pdutil.c.o CMakeFiles/superlu_dist-static.dir/pdsymbfact_distdata.c.o CMakeFiles/superlu_dist-static.dir/ddistribute.c.o CMakeFiles/superlu_dist-static.dir/pddistribute.c.o CMakeFiles/superlu_dist-static.dir/pdgstrf.c.o CMakeFiles/superlu_dist-sta
             tic.dir/dstatic_schedule.c.o CMakeFiles/superlu_dist-static.dir/pdgstrf2.c.o CMakeFiles/superlu_dist-static.dir/pdgstrs.c.o CMakeFiles/superlu_dist-static.dir/pdgstrs1.c.o CMakeFiles/superlu_dist-static.dir/pdgstrs_lsum.c.o CMakeFiles/superlu_dist-static.dir/
             pdgstrs_Bglobal.c.o CMakeFiles/superlu_dist-static.dir/pdgsrfs.c.o CMakeFiles/superlu_dist-static.dir/pdgsmv.c.o CMakeFiles/superlu_dist-static.dir/pdgsrfs_ABXglobal.c.o CMakeFiles/superlu_dist-static.dir/pdgsmv_AXglobal.c.o CMakeFiles/superlu_dist-static.dir
             /pdGetDiagU.c.o CMakeFiles/superlu_dist-static.dir/pdgssvx3d.c.o CMakeFiles/superlu_dist-static.dir/dnrformat_loc3d.c.o CMakeFiles/superlu_dist-static.dir/pdgstrf3d.c.o CMakeFiles/superlu_dist-static.dir/dtreeFactorization.c.o CMakeFiles/superlu_dist-static.d
             ir/dtreeFactorizationGPU.c.o CMakeFiles/superlu_dist-static.dir/dgather.c.o CMakeFiles/superlu_dist-static.dir/dscatter3d.c.o CMakeFiles/superlu_dist-static.dir/pd3dcomm.c.o CMakeFiles/superlu_dist-static.dir/dtrfAux.c.o CMakeFiles/superlu_dist-static.dir/dco
             mmunication_aux.c.o CMakeFiles/superlu_dist-static.dir/dtrfCommWrapper.c.o CMakeFiles/superlu_dist-static.dir/dsuperlu_blas.c.o CMakeFiles/superlu_dist-static.dir/pdgstrs_lsum_cuda.cu.o CMakeFiles/superlu_dist-static.dir/superlu_gpu_utils.cu.o CMakeFiles/supe
             rlu_dist-static.dir/dsuperlu_gpu.cu.o CMakeFiles/superlu_dist-static.dir/slangs_dist.c.o CMakeFiles/superlu_dist-static.dir/sgsequ_dist.c.o CMakeFiles/superlu_dist-static.dir/slaqgs_dist.c.o CMakeFiles/superlu_dist-static.dir/sutil_dist.c.o CMakeFiles/superlu
             _dist-static.dir/smemory_dist.c.o CMakeFiles/superlu_dist-static.dir/smyblas2_dist.c.o CMakeFiles/superlu_dist-static.dir/ssp_blas2_dist.c.o CMakeFiles/superlu_dist-static.dir/ssp_blas3_dist.c.o CMakeFiles/superlu_dist-static.dir/psgssvx.c.o CMakeFiles/superl
             u_dist-static.dir/psgssvx_d2.c.o CMakeFiles/superlu_dist-static.dir/psgssvx_ABglobal.c.o CMakeFiles/superlu_dist-static.dir/sreadhb.c.o CMakeFiles/superlu_dist-static.dir/sreadrb.c.o CMakeFiles/superlu_dist-static.dir/sreadtriple.c.o CMakeFiles/superlu_dist-s
             tatic.dir/sreadtriple_noheader.c.o CMakeFiles/superlu_dist-static.dir/sbinary_io.c.o CMakeFiles/superlu_dist-static.dir/sreadMM.c.o CMakeFiles/superlu_dist-static.dir/psgsequ.c.o CMakeFiles/superlu_dist-static.dir/pslaqgs.c.o CMakeFiles/superlu_dist-static.di
             r/sldperm_dist.c.o CMakeFiles/superlu_dist-static.dir/pslangs.c.o CMakeFiles/superlu_dist-static.dir/psutil.c.o CMakeFiles/superlu_dist-static.dir/pssymbfact_distdata.c.o CMakeFiles/superlu_dist-static.dir/sdistribute.c.o CMakeFiles/superlu_dist-static.dir/ps
             distribute.c.o CMakeFiles/superlu_dist-static.dir/psgstrf.c.o CMakeFiles/superlu_dist-static.dir/sstatic_schedule.c.o CMakeFiles/superlu_dist-static.dir/psgstrf2.c.o CMakeFiles/superlu_dist-static.dir/psgstrs.c.o CMakeFiles/superlu_dist-static.dir/psgstrs1.c.
             o CMakeFiles/superlu_dist-static.dir/psgstrs_lsum.c.o CMakeFiles/superlu_dist-static.dir/psgstrs_Bglobal.c.o CMakeFiles/superlu_dist-static.dir/psgsrfs.c.o CMakeFiles/superlu_dist-static.dir/psgsrfs_d2.c.o CMakeFiles/superlu_dist-static.dir/psgsmv.c.o CMakeFi
             les/superlu_dist-static.dir/psgsrfs_ABXglobal.c.o CMakeFiles/superlu_dist-static.dir/psgsmv_AXglobal.c.o CMakeFiles/superlu_dist-static.dir/psGetDiagU.c.o CMakeFiles/superlu_dist-static.dir/psgssvx3d.c.o CMakeFiles/superlu_dist-static.dir/snrformat_loc3d.c.o 
             CMakeFiles/superlu_dist-static.dir/psgstrf3d.c.o CMakeFiles/superlu_dist-static.dir/streeFactorization.c.o CMakeFiles/superlu_dist-static.dir/streeFactorizationGPU.c.o CMakeFiles/superlu_dist-static.dir/sgather.c.o CMakeFiles/superlu_dist-static.dir/sscatter3
             d.c.o CMakeFiles/superlu_dist-static.dir/ps3dcomm.c.o CMakeFiles/superlu_dist-static.dir/strfAux.c.o CMakeFiles/superlu_dist-static.dir/scommunication_aux.c.o CMakeFiles/superlu_dist-static.dir/strfCommWrapper.c.o CMakeFiles/superlu_dist-static.dir/ssuperlu_b
             las.c.o CMakeFiles/superlu_dist-static.dir/psgsmv_d2.c.o CMakeFiles/superlu_dist-static.dir/psgsequb.c.o CMakeFiles/superlu_dist-static.dir/ssuperlu_gpu.cu.o CMakeFiles/superlu_dist-static.dir/dcomplex_dist.c.o CMakeFiles/superlu_dist-static.dir/zlangs_dist.c
             .o CMakeFiles/superlu_dist-static.dir/zgsequ_dist.c.o CMakeFiles/superlu_dist-static.dir/zlaqgs_dist.c.o CMakeFiles/superlu_dist-static.dir/zutil_dist.c.o CMakeFiles/superlu_dist-static.dir/zmemory_dist.c.o CMakeFiles/superlu_dist-static.dir/zmyblas2_dist.c.o
              CMakeFiles/superlu_dist-static.dir/zsp_blas2_dist.c.o CMakeFiles/superlu_dist-static.dir/zsp_blas3_dist.c.o CMakeFiles/superlu_dist-static.dir/pzgssvx.c.o CMakeFiles/superlu_dist-static.dir/pzgssvx_ABglobal.c.o CMakeFiles/superlu_dist-static.dir/zreadhb.c.o 
             CMakeFiles/superlu_dist-static.dir/zreadrb.c.o CMakeFiles/superlu_dist-static.dir/zreadtriple.c.o CMakeFiles/superlu_dist-static.dir/zreadtriple_noheader.c.o CMakeFiles/superlu_dist-static.dir/zbinary_io.c.o CMakeFiles/superlu_dist-static.dir/zreadMM.c.o CMak
             eFiles/superlu_dist-static.dir/pzgsequ.c.o CMakeFiles/superlu_dist-static.dir/pzlaqgs.c.o CMakeFiles/superlu_dist-static.dir/zldperm_dist.c.o CMakeFiles/superlu_dist-static.dir/pzlangs.c.o CMakeFiles/superlu_dist-static.dir/pzutil.c.o CMakeFiles/superlu_dist-
             static.dir/pzsymbfact_distdata.c.o CMakeFiles/superlu_dist-static.dir/zdistribute.c.o CMakeFiles/superlu_dist-static.dir/pzdistribute.c.o CMakeFiles/superlu_dist-static.dir/pzgstrf.c.o CMakeFiles/superlu_dist-static.dir/zstatic_schedule.c.o CMakeFiles/superlu
             _dist-static.dir/pzgstrf2.c.o CMakeFiles/superlu_dist-static.dir/pzgstrs.c.o CMakeFiles/superlu_dist-static.dir/pzgstrs1.c.o CMakeFiles/superlu_dist-static.dir/pzgstrs_lsum.c.o CMakeFiles/superlu_dist-static.dir/pzgstrs_Bglobal.c.o CMakeFiles/superlu_dist-sta
             tic.dir/pzgsrfs.c.o CMakeFiles/superlu_dist-static.dir/pzgsmv.c.o CMakeFiles/superlu_dist-static.dir/pzgsrfs_ABXglobal.c.o CMakeFiles/superlu_dist-static.dir/pzgsmv_AXglobal.c.o CMakeFiles/superlu_dist-static.dir/pzGetDiagU.c.o CMakeFiles/superlu_dist-static.
             dir/pzgssvx3d.c.o CMakeFiles/superlu_dist-static.dir/znrformat_loc3d.c.o CMakeFiles/superlu_dist-static.dir/pzgstrf3d.c.o CMakeFiles/superlu_dist-static.dir/ztreeFactorization.c.o CMakeFiles/superlu_dist-static.dir/ztreeFactorizationGPU.c.o CMakeFiles/superlu
             _dist-static.dir/zscatter3d.c.o CMakeFiles/superlu_dist-static.dir/zgather.c.o CMakeFiles/superlu_dist-static.dir/pz3dcomm.c.o CMakeFiles/superlu_dist-static.dir/ztrfAux.c.o CMakeFiles/superlu_dist-static.dir/zcommunication_aux.c.o CMakeFiles/superlu_dist-sta
             tic.dir/ztrfCommWrapper.c.o CMakeFiles/superlu_dist-static.dir/zsuperlu_blas.c.o CMakeFiles/superlu_dist-static.dir/zsuperlu_gpu.cu.o
     1026    /usr/bin/ranlib libsuperlu_dist.a
     1027    make[2]: Leaving directory `/tmp/balos1/spack-stage/spack-stage-superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3/spack-build-ctophhu'
     1028    [ 70%] Built target superlu_dist-static
     1029    make[1]: Leaving directory `/tmp/balos1/spack-stage/spack-stage-superlu-dist-8.1.0-ctophhudysl2utfu6layiytwet5fc6t3/spack-build-ctophhu'
  >> 1030    make: *** [all] Error 2

spack spec:

[balos1@tux419 superludist]$ spack spec [email protected]~int64+cuda cuda_arch=60
Input spec
--------------------------------
[email protected]+cuda~int64 cuda_arch=60

Concretized
--------------------------------
[email protected]%[email protected]+cuda~int64~ipo~openmp~rocm+shared build_type=RelWithDebInfo cuda_arch=60 arch=linux-rhel7-skylake_avx512
    ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt patches=bf695e3 arch=linux-rhel7-skylake_avx512
        ^[email protected]%[email protected]~symlinks+termlib arch=linux-rhel7-skylake_avx512
        ^[email protected]%[email protected]+systemcerts arch=linux-rhel7-skylake_avx512
            ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-skylake_avx512
    ^[email protected]%[email protected]~dev arch=linux-rhel7-skylake_avx512
    ^[email protected]%[email protected]~gdb~int64~real64+shared build_type=Release patches=4991da9,b1225da arch=linux-rhel7-skylake_avx512
    ^[email protected]%[email protected]~bignuma~consistent_fpcsr~ilp64+locking+pic+shared symbol_suffix=none threads=none arch=linux-rhel7-skylake_avx512
    ^[email protected]%[email protected]~atomics~cuda~cxx~cxx_exceptions+gpfs~java~legacylaunchers~lustre~memchecker~pmi~singularity~sqlite3+static~thread_multiple+vt+wrapper-rpath fabrics=none schedulers=none arch=linux-rhel7-skylake_avx512
        ^[email protected]%[email protected]~cairo~cuda~gl~libudev+libxml2~netloc~nvml+pci+shared arch=linux-rhel7-skylake_avx512
            ^[email protected]%[email protected] arch=linux-rhel7-skylake_avx512
            ^[email protected]%[email protected]~python arch=linux-rhel7-skylake_avx512
                ^[email protected]%[email protected] arch=linux-rhel7-skylake_avx512
                ^[email protected]%[email protected]~pic arch=linux-rhel7-skylake_avx512
            ^[email protected]%[email protected] patches=4e1d78c arch=linux-rhel7-skylake_avx512
    ^[email protected]%[email protected]~gdb~int64~ipo+shared build_type=RelWithDebInfo patches=4f89253,50ed208,704b84f arch=linux-rhel7-skylake_avx512

spack debug report:

* **Spack:** 0.19.0.dev0 (03723d669dc154e59b7f5da764094068d412d8f2)
* **Python:** 3.8.5
* **Platform:** linux-rhel7-skylake_avx512
* **Concretizer:** clingo

spack-build-out.txt

liuyangzhuan · 2022-09-08T05:32:16Z

@balos1 the following works for me
spack install [email protected]~int64+cuda cuda_arch=60
I'm not sure why this doesn't work for you. I think somehow you are mixing gcc 4.8.5 and gcc 9.3.0, the error indicates gcc version is too low. See https://groups.google.com/g/turbulenz-engine-users/c/Mk7MrwvIkZ0?pli=1

tldahlgren

Confirmed new sha256.

balos1 · 2022-09-16T23:44:48Z

@balos1 the following works for me spack install [email protected]~int64+cuda cuda_arch=60 I'm not sure why this doesn't work for you. I think somehow you are mixing gcc 4.8.5 and gcc 9.3.0, the error indicates gcc version is too low. See https://groups.google.com/g/turbulenz-engine-users/c/Mk7MrwvIkZ0?pli=1

@liuyangzhuan I am running into the same error on LLNL's Lassen with [email protected]. I don't see the gcc versions being mixed anywhere in the build logs. I wonder if it possibly related to the error seen in #32505?

balos1 · 2022-09-23T17:39:17Z

@liuyangzhuan With the rebase the CUDA build is working for me now. I am not sure what the problem was.

balos1 · 2022-09-26T16:01:15Z

@tldahlgren Can this be merged even though gitlab-ci is failing? It looks like the failure is from e4s, and specifically Trilinos. The Trilinos versions being built in the pipeline are incompatible with SuperLU_DIST 8.x.x (see trilinos/Trilinos#10673).

tldahlgren · 2022-09-26T17:12:10Z

@tldahlgren Can this be merged even though gitlab-ci is failing? It looks like the failure is from e4s, and specifically Trilinos. The Trilinos versions being built in the pipeline are incompatible with SuperLU_DIST 8.x.x (see trilinos/Trilinos#10673).

The CI pipeline checks are required and I cannot override them.

@sethrj @eugeneswalker Looks like the trilinos package needs to be updated and or the E4S stack needs to be tweaked until the fix is in place. Which do you think is better at this point?

sethrj · 2022-09-26T19:10:33Z

I don't think there are any further trilinos updates available; @jwillenbring could comment perhaps? It sounds as though that there needs to at least be some version restrictions for the superlu compatibility when +cuda.

tldahlgren · 2022-09-26T19:59:03Z

I don't think there are any further trilinos updates available; @jwillenbring could comment perhaps? It sounds as though that there needs to at least be some version restrictions for the superlu compatibility when +cuda.

🤦 Even better!

balos1 · 2022-09-26T20:08:33Z

I don't think there are any further trilinos updates available; @jwillenbring could comment perhaps? It sounds as though that there needs to at least be some version restrictions for the superlu compatibility when +cuda.

I think the correct thing to do from a Spack standpoint would be to change https://github.com/spack/spack/blob/develop/var/spack/repos/builtin/packages/trilinos/package.py#L423 to

depends_on("[email protected]:7.99.99", when="@13.0.1:13.99.99 +superlu-dist")

maybe (also, perhaps the spack version syntax I used could be cleaner)? I believe Trilinos 14 will work with superlu-dist 8.x.x but @jwillenbring and @keitat should be the official word on this.

balos1 · 2022-10-03T19:29:08Z

Should be good now that #32889 was merged. I also added 8.1.1 into this as well since it was released after I opened the PR.

tldahlgren

Re-confirmed the new sha56. Other changes seem reasonable to me.

tldahlgren · 2022-10-03T19:42:46Z

@liuyangzhuan Do you want to revisit this PR before it gets merged?

balos1 added new-version xSDK labels Sep 7, 2022

spackbot-app bot added the update-package label Sep 7, 2022

spackbot-app bot requested review from balay, liuyangzhuan and pghysels September 7, 2022 19:43

balos1 added the e4s label Sep 7, 2022

liuyangzhuan previously approved these changes Sep 7, 2022

View reviewed changes

alalazo force-pushed the develop branch from 03723d6 to eaf1f5e Compare September 12, 2022 09:33

alalazo dismissed liuyangzhuan’s stale review via eaf1f5e September 12, 2022 09:38

alalazo enabled auto-merge (squash) September 12, 2022 10:31

tldahlgren assigned liuyangzhuan Sep 12, 2022

tldahlgren previously approved these changes Sep 12, 2022

View reviewed changes

tldahlgren self-assigned this Sep 12, 2022

balos1 dismissed tldahlgren’s stale review via 17634a7 September 23, 2022 17:38

balos1 force-pushed the develop branch from 3439c98 to 17634a7 Compare September 23, 2022 17:38

spackbot-app bot added the dependencies label Sep 23, 2022

tldahlgren mentioned this pull request Sep 26, 2022

Temporarily pin superlu-dist version to 7.2.0 #32825

Closed

balos1 mentioned this pull request Sep 28, 2022

trilinos: constrain superlu-dist version #32889

Merged

superlu-dist: add 8.1.0 and 8.0.0 versions

e440c25

balos1 added 3 commits October 3, 2022 12:26

require correct index choice for parmetis/metis

8252f9f

set cuda arch via CMAKE_CUDA_ARCHITECTURES; remove unused CMake variable

6e5c545

superlu-dist: add v8.1.1

78b242a

balos1 force-pushed the develop branch from 2647d94 to 78b242a Compare October 3, 2022 19:28

balos1 changed the title ~~superlu-dist: add 8.1.0 and 8.0.0 versions~~ superlu-dist: add 8.1.1, 8.1.0 and 8.0.0 versions Oct 3, 2022

balos1 requested review from liuyangzhuan and tldahlgren October 3, 2022 19:30

tldahlgren approved these changes Oct 3, 2022

View reviewed changes

alalazo merged commit c03979c into spack:develop Oct 4, 2022

Conversation

balos1 commented Sep 7, 2022

Uh oh!

spackbot-app bot commented Sep 7, 2022

Uh oh!

balos1 commented Sep 7, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

liuyangzhuan commented Sep 8, 2022

Uh oh!

tldahlgren left a comment

Choose a reason for hiding this comment

Uh oh!

balos1 commented Sep 16, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

balos1 commented Sep 23, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

balos1 commented Sep 26, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

tldahlgren commented Sep 26, 2022

Uh oh!

sethrj commented Sep 26, 2022

Uh oh!

tldahlgren commented Sep 26, 2022

Uh oh!

balos1 commented Sep 26, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

balos1 commented Oct 3, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

tldahlgren left a comment

Choose a reason for hiding this comment

Uh oh!

tldahlgren commented Oct 3, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

balos1 commented Sep 7, 2022 •

edited

Loading

balos1 commented Sep 16, 2022 •

edited

Loading

balos1 commented Sep 23, 2022 •

edited

Loading

balos1 commented Sep 26, 2022 •

edited

Loading

balos1 commented Sep 26, 2022 •

edited

Loading

balos1 commented Oct 3, 2022 •

edited

Loading