Repository navigation
[BUG] Compiler-cache creation not multi-process safe #7985
Description
Describe the bug
This is a related issue to the one in #7983 (observed as part of the same set of CI changes), but hopefully easier to solve.
When constructing a cache, the cache directory creation can race, because two processes can observe that the cache does not exist, and then both try and make it.
Line 96 in 7ad0fff
Code to reproduce the behaviour:
No response
Expected behaviour
This should probably work. I think just passing exist_ok=True to os.makedirs should do the trick
OS
No response
Python version
No response
Cython version
No response
Additional context
No response
Activity
fix: Make Cache directory creation multi-process safe
Revert "Cache Cython generated sources in wheel builds (#23998)" (#24132
fix: Make Cache directory creation multi-process safe (GH-7986)
Simplify a few code places that aim to safely create directories.