ascent@0.9.1 (and @0.9.2) +cuda fails on ARM, POWER, and AMD64: runtimes/expressions/ascent_execution_policies.hpp(135): error: namespace "RAJA" has no member "cuda_exec"

### Steps to reproduce the issue

`asccent@0.9.1 +cuda` build fails on ARM and PPC64LE using:
* `spack@develop` (9ee2d79de172de14477a78e5d407548a63eea33a from `Tue May 16 13:32:26 2023 -0500`)
* Ubuntu 20.04, ARM64, PPC64LE
* GCC 11.1.0
* CUDA 11.8

<details><summary>Concretization</summary>
<pre>
 -   ascent@0.9.1%gcc@11.1.0~adios2~babelflow+blt_find_mpi~caliper+cuda~doc~dray~fides+fortran~ipo~mfem+mpi+openmp~python+raja+serial+shared+test+umpire~vtkh build_system=cmake build_type=Release cuda_arch=75 generator=make arch=linux-ubuntu20.04-aarch64
[+]      ^cmake@3.26.3%gcc@11.1.0~doc+ncurses+ownlibs~qt build_system=generic build_type=Release arch=linux-ubuntu20.04-aarch64
[+]          ^ncurses@6.3%gcc@11.1.0~symlinks+termlib abi=none build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]          ^openssl@1.1.1t%gcc@11.1.0~docs~shared build_system=generic certs=mozilla arch=linux-ubuntu20.04-aarch64
[+]              ^ca-certificates-mozilla@2023-01-10%gcc@11.1.0 build_system=generic arch=linux-ubuntu20.04-aarch64
[+]              ^perl@5.36.0%gcc@11.1.0+cpanm+open+shared+threads build_system=generic arch=linux-ubuntu20.04-aarch64
[+]                  ^berkeley-db@18.1.40%gcc@11.1.0+cxx~docs+stl build_system=autotools patches=26090f4,b231fcc arch=linux-ubuntu20.04-aarch64
[+]                  ^bzip2@1.0.8%gcc@11.1.0~debug~pic+shared build_system=generic arch=linux-ubuntu20.04-aarch64
[+]                  ^gdbm@1.23%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]              ^zlib@1.2.13%gcc@11.1.0+optimize+pic+shared build_system=makefile arch=linux-ubuntu20.04-aarch64
[+]      ^conduit@0.8.7%gcc@11.1.0~adios+blt_find_mpi~caliper~doc~doxygen+examples+fortran+hdf5+hdf5_compat~ipo+mpi+parmetis~python+shared~silo+test+utilities~zfp build_system=cmake build_type=Release generator=make arch=linux-ubuntu20.04-aarch64
[+]          ^hdf5@1.8.21%gcc@11.1.0~cxx+fortran+hl~ipo+mpi+shared~szip~threadsafe+tools api=default build_system=cmake build_type=Release generator=make patches=0e20187,b61e2f0 arch=linux-ubuntu20.04-aarch64
[+]          ^metis@5.1.0%gcc@11.1.0~gdb~int64~ipo~real64+shared build_system=cmake build_type=Release generator=make patches=4991da9,93a7903,b1225da arch=linux-ubuntu20.04-aarch64
[+]          ^parmetis@4.0.3%gcc@11.1.0~gdb~int64~ipo+shared build_system=cmake build_type=Release generator=make patches=4f89253,50ed208,704b84f arch=linux-ubuntu20.04-aarch64
[+]      ^cuda@11.8.0%gcc@11.1.0~allow-unsupported-compilers~dev build_system=generic arch=linux-ubuntu20.04-aarch64
[+]          ^libxml2@2.10.3%gcc@11.1.0~python build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]              ^libiconv@1.17%gcc@11.1.0 build_system=autotools libs=shared,static arch=linux-ubuntu20.04-aarch64
[+]              ^xz@5.4.1%gcc@11.1.0+pic build_system=autotools libs=shared,static arch=linux-ubuntu20.04-aarch64
[+]      ^gmake@4.4.1%gcc@11.1.0~guile build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]          ^gnuconfig@2022-09-17%gcc@11.1.0 build_system=generic arch=linux-ubuntu20.04-aarch64
[+]      ^mpich@4.1.1%gcc@11.1.0~argobots~cuda+fortran~hwloc+hydra+libxml2+pci~rocm+romio~slurm~two_level_namespace~vci~verbs~wrapperrpath build_system=autotools datatype-engine=auto device=ch4 netmod=ofi pmi=pmi arch=linux-ubuntu20.04-aarch64
[+]          ^findutils@4.9.0%gcc@11.1.0 build_system=autotools patches=440b954 arch=linux-ubuntu20.04-aarch64
[+]          ^libfabric@1.18.0%gcc@11.1.0~debug~kdreg build_system=autotools fabrics=rxm,sockets,tcp,udp arch=linux-ubuntu20.04-aarch64
[+]          ^libpciaccess@0.17%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]              ^libtool@2.4.7%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]              ^util-macros@1.19.3%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]          ^pkgconf@1.9.5%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]          ^yaksa@0.2%gcc@11.1.0~cuda~rocm build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]              ^autoconf@2.69%gcc@11.1.0 build_system=autotools patches=35c4492,7793209,a49dd5b arch=linux-ubuntu20.04-aarch64
[+]              ^automake@1.16.5%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]              ^m4@1.4.19%gcc@11.1.0+sigsegv build_system=autotools patches=9dc5fbd,bfdffa7 arch=linux-ubuntu20.04-aarch64
[+]                  ^diffutils@3.9%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]                  ^libsigsegv@2.14%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]              ^python@3.7.15%gcc@11.1.0+bz2+crypt+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tkinter+uuid+zlib build_system=generic patches=0d98e93,f2fd060 arch=linux-ubuntu20.04-aarch64
[+]                  ^expat@2.5.0%gcc@11.1.0+libbsd build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]                      ^libbsd@0.11.7%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]                          ^libmd@1.0.4%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]                  ^gettext@0.21.1%gcc@11.1.0+bzip2+curses+git~libunistring+libxml2+tar+xz build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]                      ^tar@1.34%gcc@11.1.0 build_system=autotools zip=pigz arch=linux-ubuntu20.04-aarch64
[+]                          ^pigz@2.7%gcc@11.1.0 build_system=makefile arch=linux-ubuntu20.04-aarch64
[+]                          ^zstd@1.5.5%gcc@11.1.0+programs build_system=makefile compression=none libs=shared,static arch=linux-ubuntu20.04-aarch64
[+]                  ^libffi@3.4.4%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]                  ^libxcrypt@4.4.33%gcc@11.1.0~obsolete_api build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]                  ^readline@8.2%gcc@11.1.0 build_system=autotools patches=bbf97f1 arch=linux-ubuntu20.04-aarch64
[+]                  ^sqlite@3.40.1%gcc@11.1.0+column_metadata+dynamic_extensions+fts~functions+rtree build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]                  ^util-linux-uuid@2.38.1%gcc@11.1.0 build_system=autotools arch=linux-ubuntu20.04-aarch64
[+]      ^raja@2022.10.4%gcc@11.1.0~cuda+examples+exercises~ipo+openmp~rocm+shared~tests build_system=cmake build_type=Release generator=make arch=linux-ubuntu20.04-aarch64
[+]          ^blt@0.5.2%gcc@11.1.0 build_system=generic arch=linux-ubuntu20.04-aarch64
[+]          ^camp@2022.10.1%gcc@11.1.0~cuda~ipo+openmp~rocm~tests build_system=cmake build_type=Release generator=make arch=linux-ubuntu20.04-aarch64
[+]      ^umpire@2022.03.1%gcc@11.1.0+c~cuda+device_alloc~deviceconst+examples~fortran~ipo~numa~openmp~rocm+shared build_system=cmake build_type=Release generator=make tests=none arch=linux-ubuntu20.04-aarch64
</pre></details>

Error:
```
==> Installing ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh
==> No binary for ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh found: installing from source
==> Using cached archive: /spack/var/spack/cache/_source-cache/git//Alpine-DAV/ascent.git/v0.9.1.tar.gz
==> No patches needed for ascent
==> Warning: Fetching from mirror without a checksum!
  This package is normally checked out from a version control system, but it has been archived on a spack mirror.  This means we cannot know a checksum for the tarball in advance. Be sure that your connection to this mirror is secure!
==> ascent: Executing phase: 'cmake'
==> ascent: Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
'<abbreviated>/linux-ubuntu20.04-aarch64/gcc-11.1.0/gmake-4.4.1-vrtzue4kj63kpno5orvem33e63lnzo7f/bin/make' '-j16'
...
  >> 609     /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-src/src/libs/ascent/runtimes/expressions/ascent_execution_policies.hpp(135): error: namespace
              "RAJA" has no member "cuda_exec"
     610     
  >> 611     /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-src/src/libs/ascent/runtimes/expressions/ascent_execution_policies.hpp(135): error: expected 
             a ";"
     612     
  >> 613     /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-src/src/libs/ascent/runtimes/expressions/ascent_execution_policies.hpp(136): error: namespace
              "RAJA" has no member "cuda_reduce"
     614     
  >> 615     /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-src/src/libs/ascent/runtimes/expressions/ascent_execution_policies.hpp(137): error: namespace
              "RAJA" has no member "cuda_atomic"
     616     
  >> 617     /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-src/src/libs/ascent/runtimes/expressions/ascent_execution_policies.hpp(181): error: namespace
              "RAJA" has no member "cuda_reduce"
     618     
  >> 619     /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-src/src/libs/ascent/runtimes/expressions/ascent_execution_policies.hpp(193): error: namespace
              "RAJA" has no member "cuda_exec"
...
  >> 667     /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-src/src/libs/ascent/runtimes/expressions/ascent_conduit_reductions.cpp(414): error: incomplet
             e type is not allowed
     668               detected during:
     669                 instantiation of "conduit::Node ascent::runtime::expressions::detail::MaxFunctor::operator()(ascent::MemoryAccessor<T>, const Exec &) const [with T=float, Exec=ascent:
             :SerialExec]"
     670     (128): here
     671                 instantiation of "conduit::Node ascent::runtime::expressions::detail::dispatch_memory(const conduit::Node &, std::string, const Function &, const Exec &) [with Functio
             n=ascent::runtime::expressions::detail::MaxFunctor, Exec=ascent::SerialExec]"
     672     (167): here
     673                 instantiation of "conduit::Node ascent::runtime::expressions::detail::exec_dispatch(const conduit::Node &, std::string, const Function &) [with Function=ascent::runtim
             e::expressions::detail::MaxFunctor]"
     674     (652): here
     675     
  >> 676     /spack/opt/spack/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/
             __spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholde/linux-ubuntu20.04-aarch64/gcc-11.1.0/raja-2022.10.4-5wch4k4ykppclseiojrfmgmbotva7vf4/include/RAJA/pat
             tern/forall.hpp(537): error: no instance of overloaded function "RAJA::wrap::forall" matches the argument list
     677                 argument types are: (camp::resources::v1::Host, ascent::SerialExec::for_policy, RAJA::RangeSegment, <error-type>, RAJA::expt::ForallParamPack<>)
     678               detected during:
     679                 instantiation of "camp::concepts::enable_if_t<camp::resources::v1::EventProxy<Res>, camp::concepts::negate<RAJA::type_traits::is_indexset_policy<ExecutionPolicy>>, cam
             p::concepts::negate<RAJA::type_traits::is_multi_policy<ExecutionPolicy>>, camp::type_traits::is_range<Container>> RAJA::policy_by_value_interface::forall(ExecutionPolicy &&, Res, 
             Container &&, Params &&...) [with ExecutionPolicy=ascent::SerialExec::for_policy, Res=camp::resources::v1::Host, Container=RAJA::RangeSegment, Params=<lambda [](ascent::index_t)->
             void>]"
     680     (579): here
     681                 instantiation of "camp::resources::v1::EventProxy<Res> RAJA::forall<ExecutionPolicy,Args...,Res>(Args &&...) [with ExecutionPolicy=ascent::SerialExec::for_policy, Args
             =<RAJA::RangeSegment, lambda [](ascent::index_t)->void>, Res=camp::resources::v1::Host]"
     682     /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-src/src/libs/ascent/runtimes/expressions/ascent_execution_policies.hpp(238): here
...
  >> 1986    make[2]: *** [libs/ascent/CMakeFiles/ascent.dir/build.make:249: libs/ascent/CMakeFiles/ascent.dir/runtimes/expressions/ascent_conduit_reductions.cpp.o] Error 1
     1987    [ 20%] Linking CXX shared library ../../../../lib/libgtest.so
     1988    cd /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-build-ly3uzxg/blt/thirdparty_builtin/googletest-master-2020-01-07/googletest && /spack/opt
             /spack/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_pa
             th_placeholder__/__spack_path_placeholder__/__spack_path_placeholde/linux-ubuntu20.04-aarch64/gcc-11.1.0/cmake-3.26.3-7fcfio7un2wrsto7dn7mj4tof7jkea44/bin/cmake -E cmake_link_scri
             pt CMakeFiles/gtest.dir/link.txt --verbose=1
     1989    /usr/bin/g++ -fPIC -O3 -DNDEBUG -shared -Wl,-soname,libgtest.so -o ../../../../lib/libgtest.so "CMakeFiles/gtest.dir/src/gtest-all.cc.o"  -lpthread
     1990    make[2]: Leaving directory '/tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-build-ly3uzxg'
     1991    [ 20%] Built target gtest
     1992    /spack/opt/spack/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/
             __spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholde/linux-ubuntu20.04-aarch64/gcc-11.1.0/gmake-4.4.1-vrtzue4kj63kpno5orvem33e63lnzo7f/bin/make  -f blt/th
             irdparty_builtin/googletest-master-2020-01-07/googletest/CMakeFiles/gtest_main.dir/build.make blt/thirdparty_builtin/googletest-master-2020-01-07/googletest/CMakeFiles/gtest_main.
             dir/depend

     ...

     2037    [ 23%] Linking CXX executable ../../../tests/blt_gtest_smoke
     2038    cd /tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-build-ly3uzxg/blt/tests/smoke && /spack/opt/spack/__spack_path_placeholder__/__spack_path_
             placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__spack_path_placeholder__/__s
             pack_path_placeholde/linux-ubuntu20.04-aarch64/gcc-11.1.0/cmake-3.26.3-7fcfio7un2wrsto7dn7mj4tof7jkea44/bin/cmake -E cmake_link_script CMakeFiles/blt_gtest_smoke.dir/link.txt --ve
             rbose=1
     2039    /usr/bin/g++ -O3 -DNDEBUG CMakeFiles/blt_gtest_smoke.dir/blt_gtest_smoke.cpp.o -o ../../../tests/blt_gtest_smoke  -Wl,-rpath,/tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxg
             nijn5kmpd2qnwbhpkohdpn7fh/spack-build-ly3uzxg/lib ../../../lib/libgtest_main.so ../../../lib/libgtest.so -lpthread -lpthread
     2040    make[2]: Leaving directory '/tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-build-ly3uzxg'
     2041    [ 23%] Built target blt_gtest_smoke
     2042    make[2]: Leaving directory '/tmp/root/spack-stage/spack-stage-ascent-0.9.1-ly3uzxgnijn5kmpd2qnwbhpkohdpn7fh/spack-build-ly3uzxg'
  >> 2043    make[1]: *** [CMakeFiles/Makefile2:1314: libs/
```





### Error message

<details><summary>Error message</summary>
<pre>
...  see above
</pre></details>


### Information on your system

* **Spack:** 0.20.0.dev0 (0dc6c421561a59e2b00b1daf634c1216f843daa0)
* **Python:** 3.8.10
* **Platform:** linux-ubuntu20.04-neoverse_n1
* **Concretizer:** clingo

### Additional information

[spack-build-env.txt](https://github.com/spack/spack/files/11625883/spack-build-env.txt)
[spack-build-out.txt](https://github.com/spack/spack/files/11625884/spack-build-out.txt)

@cyrush @kwryankrattiger @wspear @nchaimov 

### General information

- [X] I have run `spack debug report` and reported the version of Spack/Python/Platform
- [X] I have run `spack maintainers <name-of-the-package>` and **@mentioned** any maintainers
- [X] I have uploaded the build log and environment files
- [X] I have searched the issues of this repo and believe this is not a duplicate

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[email protected] (and @0.9.2) +cuda fails on ARM, POWER, and AMD64: runtimes/expressions/ascent_execution_policies.hpp(135): error: namespace "RAJA" has no member "cuda_exec" #38045

Steps to reproduce the issue

Error message

Information on your system

Additional information

General information

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

[email protected] (and @0.9.2) +cuda fails on ARM, POWER, and AMD64: runtimes/expressions/ascent_execution_policies.hpp(135): error: namespace "RAJA" has no member "cuda_exec" #38045

Description

Steps to reproduce the issue

Error message

Information on your system

Additional information

General information

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions