Skip to content

Cannot add data files to target table because that table is partitioned and contains non-identity partition transforms which will not be compatible #8095

@ElsayedAwdElsayed

Description

@ElsayedAwdElsayed

Apache Iceberg version

1.3.0 (latest release)

Query engine

Spark

Please describe the bug 🐞

I am integrating iceberg with Apache spark , I tried to create the table test partitioned by hour(EndTime) ,

create table local.db.test (
MSISDN string,
START_TIME timestamp,
END_TIME timestamp
)
USING iceberg PARTITIONED BY (hours(END_TIME)); 

then I tried to call a procedure to import the data from parquet files ,

CALL local.system.add_files(
  table => 'local.db.test',
  source_table => '`parquet`.`path/to/parquet/files`'
);

it supposed to work as in the documentation , but got this exception ,

java.lang.IllegalArgumentException: Cannot add data files to target table local.db.test because that table is partitioned and contains non-identitypartition transforms which will not be compatible. Found non-identity fields [1000: END_TIME_hour: hour(3)]

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions