Installation issue: rust 1.81 (and rust only) from binary cache #48971
Description
Steps to reproduce the issue
Installing from binary cache fails for rust and rust only, all other packages can be installed just fine from the cache (I updated the build cache index several times, also removed all rust packages etc and rebuild the binary cache, no success). I don't know if the message certs: relative path not allowed: $SSL_CERT_FILE has anything to do with it. It's also worth noting that spack spec lists [email protected] and [email protected] as dependencies but doesn't try to install them when I run the install command below.
$ spack spec -I <spec>
- t64bjvf [email protected]%[email protected]~dev~docs+src build_system=generic arch=linux-ubuntu22.04-zen2
[e] tsl2lp7 ^[email protected]%[email protected]~doc+ncurses+ownlibs~qtgui build_system=generic build_type=Release patches=dbc3892 arch=linux-ubuntu22.04-zen2
[+] j3lnhae ^[email protected]%[email protected]~gssapi~ldap~libidn2~librtmp~libssh~libssh2+nghttp2 build_system=autotools libs=shared,static tls=openssl arch=linux-ubuntu22.04-zen2
[+] gv6jzvo ^[email protected]%[email protected]~guile build_system=generic patches=ca60bd9,fe5b60d arch=linux-ubuntu22.04-zen2
[+] f5u76gk ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu22.04-zen2
[e] urnjd7s ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu22.04-zen2
[+] qplddts ^[email protected]%[email protected] build_system=generic arch=linux-ubuntu22.04-zen2
[e] wi7r2t4 ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu22.04-zen2
[+] nfejhdl ^[email protected]%[email protected]~curl~ipo+mmap+ssh build_system=cmake build_type=Release generator=make https=system arch=linux-ubuntu22.04-zen2
[+] 2vr7yhg ^[email protected]%[email protected]~jit+multibyte+pic+shared+static+utf build_system=autotools arch=linux-ubuntu22.04-zen2
[+] nu3xwjl ^[email protected]%[email protected]+shared build_system=autotools crypto=openssl arch=linux-ubuntu22.04-zen2
[+] gbxluur ^[email protected]%[email protected]~pic build_system=autotools libs=shared,static arch=linux-ubuntu22.04-zen2
[e] bb5jgdm ^[email protected]%[email protected]+re2c build_system=generic arch=linux-ubuntu22.04-zen2
[+] m5ztnwo ^[email protected]%[email protected]~docs+shared build_system=generic certs=mozilla arch=linux-ubuntu22.04-zen2
[+] pcuj5an ^ca-certificates-mozilla@2023-05-30%[email protected] build_system=generic arch=linux-ubuntu22.04-zen2
[e] ae7vzcj ^[email protected]%[email protected]~cpanm+opcode+open+shared+threads build_system=generic arch=linux-ubuntu22.04-zen2
[+] zjtzdj7 ^[email protected]%[email protected]+internal_glib build_system=autotools arch=linux-ubuntu22.04-zen2
- ggdal65 ^[email protected]%[email protected]+bz2+crypt+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tkinter+uuid+zlib build_system=generic patches=13fa8bf,b0615b2,ebdca64,f2fd060 arch=linux-ubuntu22.04-zen2
[+] qy354ec ^[email protected]%[email protected]~debug~pic+shared build_system=generic arch=linux-ubuntu22.04-zen2
- wivexrz ^[email protected]%[email protected]+libbsd build_system=autotools arch=linux-ubuntu22.04-zen2
[+] qykcetf ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu22.04-zen2
[+] hwy5qy2 ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu22.04-zen2
[+] ykb3uio ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu22.04-zen2
[e] ytwjqae ^[email protected]%[email protected]+bzip2+curses+git~libunistring+libxml2+pic+shared+tar+xz build_system=autotools arch=linux-ubuntu22.04-zen2
[+] urd3gpk ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu22.04-zen2
- gougj3s ^[email protected]%[email protected]~obsolete_api build_system=autotools patches=4885da3 arch=linux-ubuntu22.04-zen2
[+] ltulkzl ^[email protected]%[email protected]~symlinks+termlib abi=none build_system=autotools patches=7a351bc arch=linux-ubuntu22.04-zen2
[+] uumvqko ^[email protected]%[email protected] build_system=autotools patches=bbf97f1 arch=linux-ubuntu22.04-zen2
[+] 7n6hhbb ^[email protected]%[email protected]+column_metadata+dynamic_extensions+fts~functions+rtree build_system=autotools arch=linux-ubuntu22.04-zen2
[+] s7icxnv ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu22.04-zen2
[+] 2dviraj ^[email protected]%[email protected] build_system=generic arch=linux-ubuntu22.04-zen2
[+] phvvlkp ^[email protected]%[email protected]+compat+new_strategies+opt+pic+shared build_system=autotools arch=linux-ubuntu22.04-zen2Error message
$ spack -ddd install --verbose --no-check-signature rust
...
==> [2025-02-10-15:42:14.029186, 1665614] Reading config from file /home/ubuntu/spack-stack/manual-testing/spst-arch/spack/etc/spack/defaults/mirrors.yaml
==> [2025-02-10-15:42:14.030669, 1665614] Skipping nonexistent config path /home/ubuntu/spack-stack/manual-testing/spst-arch/spack/etc/spack/defaults/linux/mirrors.yaml
==> [2025-02-10-15:42:14.030716, 1665614] Skipping nonexistent config path /etc/spack/mirrors.yaml
==> [2025-02-10-15:42:14.030750, 1665614] Skipping nonexistent config path /etc/spack/linux/mirrors.yaml
==> [2025-02-10-15:42:14.030779, 1665614] Skipping nonexistent config path /home/ubuntu/spack-stack/manual-testing/spst-arch/spack/etc/spack/mirrors.yaml
==> [2025-02-10-15:42:14.030808, 1665614] Skipping nonexistent config path /home/ubuntu/spack-stack/manual-testing/spst-arch/spack/etc/spack/linux/mirrors.yaml
==> [2025-02-10-15:42:14.030837, 1665614] Skipping nonexistent config path /home/ubuntu/.spack/mirrors.yaml
==> [2025-02-10-15:42:14.030867, 1665614] Skipping nonexistent config path /home/ubuntu/.spack/linux/mirrors.yaml
==> [2025-02-10-15:42:14.030897, 1665614] Skipping nonexistent config path /home/ubuntu/spack-stack/manual-testing/spst-arch/envs/ce-gcc-11.4.0-buildcache/common/mirrors.yaml
==> [2025-02-10-15:42:14.030927, 1665614] Skipping nonexistent config path /home/ubuntu/spack-stack/manual-testing/spst-arch/envs/ce-gcc-11.4.0-buildcache/site/mirrors.yaml
==> [2025-02-10-15:42:14.031081, 1665614] Searching for binary cache of rust-1.81.0-bxeqi7aaim3us6hq4v7he2nglv5htm6h
==> [2025-02-10-15:42:14.032392, 1665614] certs: relative path not allowed: $SSL_CERT_FILE
==> [2025-02-10-15:43:13.633995, 1665614] Relocating package from
/home/ubuntu/spack-stack/CI/actions-runner-2/_work/spack-stack/spack-stack/envs/ce-gcc-11.4.0-buildcache/install/[padded-to-193-chars]/__spac to /home/ubuntu/spack-stack/manual-testing/spst-arch/envs/ce-gcc-11.4.0-buildcache/install/[padded-to-195-chars]/__sp.
==> [2025-02-10-15:43:20.492776, 1665614] Flagging rust-1.81.0-bxeqi7aaim3us6hq4v7he2nglv5htm6h as failed: [Errno 22] Invalid argument
...
==> [2025-02-10-15:42:14.029109, 1665614] 1665614: Installing rust-1.81.0-bxeqi7aaim3us6hq4v7he2nglv5htm6h [25/25]
==> [2025-02-10-15:42:14.038024, 1665614] Fetching file:///home/ubuntu/spack-stack/build-cache/build_cache/linux-ubuntu22.04-zen2-gcc-11.4.0-rust-1.81.0-bxeqi7aaim3us6hq4v7he2nglv5htm6h.spec.json
==> [2025-02-10-15:42:14.039680, 1665614] Fetching file:///home/ubuntu/spack-stack/build-cache/build_cache/linux-ubuntu22.04-zen2/gcc-11.4.0/rust-1.81.0/linux-ubuntu22.04-zen2-gcc-11.4.0-rust-1.81.0-bxeqi7aaim3us6hq4v7he2nglv5htm6h.spack
==> [2025-02-10-15:42:14.700632, 1665614] Extracting rust-1.81.0-bxeqi7aaim3us6hq4v7he2nglv5htm6h from binary cache
Traceback (most recent call last):
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/bin/spack", line 52, in <module>
sys.exit(main())
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack_installable/main.py", line 42, in main
sys.exit(spack.main.main(argv))
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/main.py", line 1013, in main
return _main(argv)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/main.py", line 966, in _main
return finish_parse_and_run(parser, cmd_name, args, env_format_error)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/main.py", line 996, in finish_parse_and_run
return _invoke_command(command, parser, args, unknown)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/main.py", line 592, in _invoke_command
return_val = command(parser, args)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/cmd/install.py", line 349, in install
install_with_active_env(env, args, install_kwargs, reporter_factory)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/cmd/install.py", line 420, in install_with_active_env
env.install_specs(specs_to_install, **install_kwargs)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/environment/environment.py", line 1911, in install_specs
PackageInstaller([spec.package for spec in specs], **install_args).install()
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/installer.py", line 2160, in install
self._install_task(task, install_status)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/installer.py", line 1758, in _install_task
rc = task.execute(install_status)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/installer.py", line 1156, in execute
if _install_from_cache(pkg, self.explicit, unsigned):
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/installer.py", line 371, in _install_from_cache
installed_from_cache = _try_install_from_binary_cache(
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/installer.py", line 501, in _try_install_from_binary_cache
return _process_binary_cache_tarball(
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/installer.py", line 462, in _process_binary_cache_tarball
binary_distribution.extract_tarball(pkg.spec, download_result, force=False, timer=timer)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/binary_distribution.py", line 2505, in extract_tarball
raise e
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/binary_distribution.py", line 2502, in extract_tarball
relocate_package(spec)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/binary_distribution.py", line 2306, in relocate_package
relocate.new_relocate_elf_binaries(files_to_relocate, prefix_to_prefix_bin)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/relocate.py", line 474, in new_relocate_elf_binaries
elf.substitute_rpath_and_pt_interp_in_place_or_raise(path, prefix_to_prefix)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/util/elf.py", line 615, in substitute_rpath_and_pt_interp_in_place_or_raise
elf = parse_elf(f, interpreter=True, dynamic_section=True)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/util/elf.py", line 452, in parse_elf
return _do_parse_elf(f, interpreter, dynamic_section, only_header)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/util/elf.py", line 430, in _do_parse_elf
parse_program_headers(f, elf)
File "/home/ubuntu/spack-stack/manual-testing/spst-arch/spack/lib/spack/spack/util/elf.py", line 199, in parse_program_headers
f.seek(elf.elf_hdr.e_phoff)
OSError: [Errno 22] Invalid argument
Information on your system
* **Spack:** 0.23.0 (bb8b392bfb0e1022f3ec07774981670de7024698)
* **Python:** 3.10.12
* **Platform:** linux-ubuntu22.04-zen2
Additional information
There are no such files, since I am trying to install from the build cache.
$ spack buildcache list -l | grep rust
xp2efkc [email protected]
wrjbhny [email protected]
ns4kgsx [email protected]
urby3nq [email protected]
pxao6v7 [email protected]
ncg36x6 [email protected]
cabtjg4 [email protected]
u7dyq4m [email protected]
6tyz6gf [email protected]
fhxpkj6 [email protected]
t64bjvf [email protected]
7y4tenx [email protected]
tguy3mt [email protected]
bxeqi7a [email protected]
me5273o [email protected]
2dviraj [email protected]
qjz3pmu [email protected]
vbzaz7o [email protected]
aqixy46 [email protected]
f27zmgx [email protected]
oda6vot [email protected]
imojpdy [email protected]
dhmswb2 [email protected]
olow3np [email protected]
uaghkrc [email protected]
4x7ufom [email protected]
atdiwui [email protected]
yauycxr [email protected]
pz6uiyr [email protected]
General information
- I have run
spack debug reportand reported the version of Spack/Python/Platform - I have run
spack maintainers <name-of-the-package>and @mentioned any maintainers - I have uploaded the build log and environment files
- I have searched the issues of this repo and believe this is not a duplicate