-
Notifications
You must be signed in to change notification settings - Fork 101
[FEATURE]: Write upgraded_to properties to HMS table may not work due to permission issue #939
Copy link
Copy link
Closed
Labels
cloud/awsIssues related to AWSIssues related to AWScloud/azureissues related to Azureissues related to Azuremigrate/access-controlAccess Control to thingsAccess Control to thingsmigrate/externalgo/uc/upgrade SYNC EXTERNAL TABLES stepgo/uc/upgrade SYNC EXTERNAL TABLES steptech debtchores and design flawschores and design flaws
Description
Is there an existing issue for this?
- I have searched the existing issues
Problem statement
SYNC command will write table properties upgraded_to to HMS table, in this case the UC authentication will not be used and the instance profile or SPN used by the cluster running SYNC must have write permission on the table location, if delta table, because the property needs to be written to delta log.
Proposed Solution
- Option 1: Give write permission to the uber principal.
- Option 2: Set
spark.databricks.sync.command.disableSourceTableWrites trueso SYNC will not writeupgraded_toto HMS table. And we let UCX to writeupgraded_toto the UC table.
Additional Context
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
cloud/awsIssues related to AWSIssues related to AWScloud/azureissues related to Azureissues related to Azuremigrate/access-controlAccess Control to thingsAccess Control to thingsmigrate/externalgo/uc/upgrade SYNC EXTERNAL TABLES stepgo/uc/upgrade SYNC EXTERNAL TABLES steptech debtchores and design flawschores and design flaws
Type
Projects
Status
No status