RecursionError: maximum recursion depth exceeded while pickling an object #23892
Description
I encountered a build error on macOS that only seems to happen with Python 3. I'm guessing this is one of those Python 3.7+ macOS multiprocessing bugs we've encountered in the past.
Steps to reproduce the issue
I'm trying to install the same environment as #23891.
Error Message
==> [2021-05-25-12:10:42.975111, 54459] 54459: Installing py-torch-1.8.1-lb6hngapkdw4k6jvb6skwtaxeay2exfw
==> [2021-05-25-12:10:42.975262, 54459] Searching for binary cache of py-torch-1.8.1-lb6hngapkdw4k6jvb6skwtaxeay2exfw
==> [2021-05-25-12:10:42.975652, 54459] Reading config file /Users/Adam/spack/etc/spack/defaults/mirrors.yaml
==> [2021-05-25-12:10:43.314505, 54459] Did not find darwin-catalina-x86_64-apple-clang-12.0.0-py-torch-1.8.1-lb6hngapkdw4k6jvb6skwtaxeay2exfw.spec.yaml on https://spack-llnl-mirror.s3-us-west-2.amazonaws.com/build_cache/darwin-catalina-x86_64-apple-clang-12.0.0-py-torch-1.8.1-lb6hngapkdw4k6jvb6skwtaxeay2exfw.spec.yaml
Download failed: HTTP Error 404: Not Found
==> [2021-05-25-12:10:43.319141, 54459] No binary for py-torch-1.8.1-lb6hngapkdw4k6jvb6skwtaxeay2exfw found: installing from source
==> [2021-05-25-12:10:43.321732, 54459] Reading config file /Users/Adam/spack/etc/spack/defaults/packages.yaml
==> [2021-05-25-12:10:43.367691, 54459] Reading config file /Users/Adam/spack/etc/spack/defaults/darwin/packages.yaml
==> [2021-05-25-12:10:43.383541, 54459] Reading config file /Users/Adam/.spack/packages.yaml
==> [2021-05-25-12:10:43.572503, 54459] Warning: Missing a source id for [email protected]
==> [2021-05-25-12:10:43.895044, 54459] '/usr/bin/git' 'describe' '--tags' '--match' 'v*'
==> [2021-05-25-12:10:44.001211, 54459] Flagging py-torch-1.8.1-lb6hngapkdw4k6jvb6skwtaxeay2exfw as failed: maximum recursion depth exceeded while pickling an object
==> [2021-05-25-12:10:44.012687, 54459] Warning: Skipping build of py-torchvision-0.9.1-2w3ky2qzjz5lverygxah2raqclk2jqvz since py-torch-1.8.1-lb6hngapkdw4k6jvb6skwtaxeay2exfw failed
==> [2021-05-25-12:10:44.012788, 54459] Flagging py-torchvision-0.9.1-2w3ky2qzjz5lverygxah2raqclk2jqvz as failed
==> [2021-05-25-12:10:44.023099, 54459] Error: Failed to install py-torch due to RecursionError: maximum recursion depth exceeded while pickling an object
Information on your system
- Spack: 0.16.1-2888-a284edb852
- Python: 3.8.10
- Platform: darwin-catalina-ivybridge
- Concretizer: clingo
Additional information
- I have run
spack debug reportand reported the version of Spack/Python/Platform - I have searched the issues of this repo and believe this is not a duplicate
- I have run the failing commands in debug mode and reported the output