Skip to content

Add databricks labs ucx migrate-tables and a related workflow #670

@nfx

Description

@nfx

databricks labs ucx migrate-tables to apply table mapping from CSV file with the following columns: src_workspace_name,dst_catalog,src_schema,dst_schema,src_table,dst_table . Consider the following stages:

Initial assessment
We scan all tables, generate an inventory, get all perms, etc.
We provide a mapping file the customer can customize, but seed the UC table name with something like the workspace name or ID as the catalog.
Customer can choose to modify the mapping or not

Initial migration
We use the mapping file to sync tables, apply perms, and persist the mapping data in inventory

Repeated migration - this is probably a job that runs on schedule and the user should be instructed to configure accordingly
We use the mapping data in inventory to re-sync any tables, but not re-apply permissions as these probably changed.

Fine-grained:

Upstream dependencies:

Next quarter:

Metadata

Metadata

Labels

feat/migration-indexmapping of databases to catalog or potentially other databasesmigrate/externalgo/uc/upgrade SYNC EXTERNAL TABLES stepmigrate/managedgo/uc/upgrade Upgrade Managed Tables and Jobs

Type

No type

Projects

Status

No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions