-
Notifications
You must be signed in to change notification settings - Fork 101
[EPIC] Migrate EXTERNAL tables from cloud storage accounts #333
Copy link
Copy link
Closed
Labels
CUJcritial user journeycritial user journeyfeat/workflowtriggered as a Databricks Job managed by UCXtriggered as a Databricks Job managed by UCXmigrate/externalgo/uc/upgrade SYNC EXTERNAL TABLES stepgo/uc/upgrade SYNC EXTERNAL TABLES step
Description
Related issues:
- [FEATURE]: Update documentation to manually override azure auth_type for principal_prefix_access #1430 by @FastLee
- Add
databricks labs ucx migrate-tablesand a related workflow #670 by @qziyuan - [FEATURE]: Create/Amend mapping between storage prefixes and cloud principals #910 by @FastLee
- Create end-to-end documentation for table migration #1488 by @FastLee
- [FEATURE]: Write
upgraded_toproperties to HMS table may not work due to permission issue #939 by @nkvuong - Given an HMS table name and database, get the new full name of table in UC #323 by @JCZuurmond
- [FEATURE]: Create External Location ACL for Principals based on Interactive cluster permission using SPN #1192 by @HariGS-DB
- [FEATURE]: Create/Amend mapping between storage prefixes and cloud principals #910
- [FEATURE]: Identify mounts as ADLS gen1 or blob for Azure Databricks as part of UCX assesment to speed up analysis and storage upgrade #1391
- [FEATURE]: Use UCX created access connector in storage credentials #1384
- [FEATURE]: Migrate external tables not supported by the "sync" command #889 by @qziyuan
- Automatically assign a UC Metastore to a workspace #341 by @nkvuong
- [FEATURE]: Create UC External Location, Schema, and Table Grants based on workspace-wide Azure SPN mount points #94 by @pritishpai
- [CUJ]: Target catalogs creation #900
- CLI command to mark table/schema for skipping in the table migration process. #680
- Create EXTERNAL LOCATIONs to map to External Tables (Azure) #100
- [FEATURE]: Store
workspace_idinupgraded_fromtable property when doing table migration #899 - [FEATURE]: Create UC Schema and Table Grants based on Legacy Table ACLs #340
- [FEATURE]: Create UC Storage Credential, Schema, and Table Grants based on AWS IAM role access #887
- [FEATURE]: Create UC Storage Credential, Schema, and Table Grants based on Azure SPN access #907
- Verify that we have the external locations for these tables
- Use
SYNCto upgrade these tables "in place". Use the default or override catalog.database destination. Update the source table with "upgraded_to" property.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
CUJcritial user journeycritial user journeyfeat/workflowtriggered as a Databricks Job managed by UCXtriggered as a Databricks Job managed by UCXmigrate/externalgo/uc/upgrade SYNC EXTERNAL TABLES stepgo/uc/upgrade SYNC EXTERNAL TABLES step
Type
Projects
Status
No status