Skip to content

rasterio.open: accept fsspec OpenFile instances as argument #2905

@sgillies

Description

@sgillies

An OpenFile carries an fsspec filesystem and path. On receiving such an argument we can dispatch to /vsipyopener/.

Usage example:

of = fsspec.open("dask::s3://bucket/key", s3={"anon": True})
with rasterio.open(of) as dataset:
    print(dataset.profile)

This works well with GDAL's VSI plugin callbacks because of, the fsspec OpenFile, doesn't have a file descriptor or socket or anything like that yet, not until we enter its context. It's so designed so that it can be serialized and passed between processes. Thus GDAL can open/activate it as many times as needed.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions