Skip to content

Procedure for adding files to a Table #2068

@RussellSpitzer

Description

@RussellSpitzer

Internally we have a command "Import Data" which allows a user to associate a directory of files with a given Iceberg table. This is generally used when someone wants to add a number of files directly to an Iceberg table without rewriting all the data, they just want the existing files (usually from a a Hive table or another format) to just be added to the existing table.

I was thinking of adding a similar procedure to Iceberg if that would be of value to other users?

This is also in the vain of exposing more Iceberg internal functionality like "addFile" directly to Spark SQL ...

cc @aokolnychyi

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions