Skip to content

[FEATURE]: Write upgraded_to properties to HMS table may not work due to permission issue #939

@qziyuan

Description

@qziyuan

Is there an existing issue for this?

  • I have searched the existing issues

Problem statement

SYNC command will write table properties upgraded_to to HMS table, in this case the UC authentication will not be used and the instance profile or SPN used by the cluster running SYNC must have write permission on the table location, if delta table, because the property needs to be written to delta log.

Proposed Solution

  • Option 1: Give write permission to the uber principal.
  • Option 2: Set spark.databricks.sync.command.disableSourceTableWrites true so SYNC will not write upgraded_to to HMS table. And we let UCX to write upgraded_to to the UC table.

Additional Context

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions