Skip to content

Add ObjectStore::put_multipart_opts #5435

@tustvold

Description

@tustvold

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Following #4984 added ObjectStore::put_opts taking a PutOptions containing a PutMode. #4999 extended this to support specifying a TagSet. apache/arrow-rs-object-store#94 proposes extending this to support broader categories of metadata.

Whilst PutMode does not apply to put_multipart, as no stores AFAIK support conditional multipart uploads, but TagSet and Attributes would be applicable to multipart uploads, as pointed out by @Xuanwo on #5431 (comment)

Describe the solution you'd like

I would propose introducing a new PutMultipartOptions and a corresponding ObjectStore::put_multipart_opts, with a default implementation of ObjectStore::put_multipart calling through with PutMultipartOptions::default().

Describe alternatives you've considered

We could not do this, however, this would create an unfortunate bifurcation in functionality between multipart and non-multipart uploads.

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    development-processRelated to development process of arrow-rsenhancementAny new improvement worthy of a entry in the changelog

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions