Skip to content

Investigate segfaults with NetCDF4 >1.6.0 #5016

@trexfeathers

Description

@trexfeathers

📰 Custom Issue

A bad interaction between Iris, Dask and NetCDF4 is causing segfaults when loading. This is apparently fixed if Dask is set to single-threaded mode - see Unidata/netcdf4-python#1192 (comment)

This workaround removes a large part of the benefit of using Dask in Iris, so we need to find out if we can instead fix via changes to the Iris loading code.

Before the next release (v3.4), 1 of the below needs to happen:

  • Permanent fix - change Iris' loading code to avoid the segfaults
  • Temporary workaround - pin NetCDF4 <=1.6.0
  • Temporary workaround, with big performance regressions - set Dask to single-threaded within Iris

Metadata

Metadata

Assignees

Type

No type

Projects

Status

✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions