Skip to content

unlistable stores #294

@rabernat

Description

@rabernat

What would it take to get zarr to work with a store that did not support any list operations? I'm not talking about implementing listdir...I mean stores that don't even support list(store.keys()).

For a given zarr group, once you know the names of the arrays, in principle you don't need to list the objects in the store at all. You just go get the .zattrs and .zarray data for each array, which tells you where the chunks should be.

I'm thinking about this in the context of cloud storage (#290), where operations can be expensive and complicated to implement.

One way to implement this would be to update the spec to allow .zgroup to contain a list of arrays contained in the group. If present, the step to list the store contents could be bypassed.

Just an idea I had that I wanted to write down before I forgot.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions