-
Notifications
You must be signed in to change notification settings - Fork 300
Closed
Description
📰 Custom Issue
A bad interaction between Iris, Dask and NetCDF4 is causing segfaults when loading. This is apparently fixed if Dask is set to single-threaded mode - see Unidata/netcdf4-python#1192 (comment)
This workaround removes a large part of the benefit of using Dask in Iris, so we need to find out if we can instead fix via changes to the Iris loading code.
Before the next release (v3.4), 1 of the below needs to happen:
- Permanent fix - change Iris' loading code to avoid the segfaults
- Temporary workaround - pin NetCDF4
<=1.6.0 - Temporary workaround, with big performance regressions - set Dask to single-threaded within Iris
bjlittle and dennissergeev
Metadata
Metadata
Assignees
Type
Projects
Status
✅ Done