Test failure: test_table_migration_job_cluster_override #1245
Description
❌ test_table_migration_job_cluster_override: TimeoutError: timed out after 0:20:00: (21m9.441s)
TimeoutError: timed out after 0:20:00:
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
15:47 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_vspix: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_vspix
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_vspix', metastore_id=None, name='migrate_vspix', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:47 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_vspix.ucx_tz0ou: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_vspix/ucx_tz0ou
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_vspix.ucx_tz0ou', metastore_id=None, name='ucx_tz0ou', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_vspix', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_vspix/ucx_tz0ou', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/B3KC
15:47 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_vspix.ucx_tykbk: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_vspix/ucx_tykbk
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_vspix.ucx_tykbk', metastore_id=None, name='ucx_tykbk', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_vspix', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/B3KC', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712159229690, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ct3jp', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ct3jp', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712159229690, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:47 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ct3jp.migrate_vspix: https://DATABRICKS_HOST/explore/data/ucx_ct3jp/migrate_vspix
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ct3jp', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ct3jp.migrate_vspix', metastore_id=None, name='migrate_vspix', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:47 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/config.yml) doesn't exist.
15:47 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
15:47 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
15:47 INFO [databricks.labs.ucx.install] Fetching installations...
15:47 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
15:47 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2020240403154713
15:47 INFO [databricks.labs.ucx.install] Creating dashboards...
15:47 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
15:47 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Estimates)...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
15:47 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Main)...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
15:47 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Azure)...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
15:47 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Interactive)...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=099-destroy-schema
15:48 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:48 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
15:48 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/README for the next steps.
15:48 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/122010249563624
15:47 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_vspix: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_vspix
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_vspix', metastore_id=None, name='migrate_vspix', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:47 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_vspix.ucx_tz0ou: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_vspix/ucx_tz0ou
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_vspix.ucx_tz0ou', metastore_id=None, name='ucx_tz0ou', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_vspix', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_vspix/ucx_tz0ou', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/B3KC
15:47 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_vspix.ucx_tykbk: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_vspix/ucx_tykbk
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_vspix.ucx_tykbk', metastore_id=None, name='ucx_tykbk', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_vspix', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/B3KC', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712159229690, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ct3jp', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ct3jp', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712159229690, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
15:47 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ct3jp.migrate_vspix: https://DATABRICKS_HOST/explore/data/ucx_ct3jp/migrate_vspix
15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ct3jp', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ct3jp.migrate_vspix', metastore_id=None, name='migrate_vspix', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
15:47 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/config.yml) doesn't exist.
15:47 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
15:47 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
15:47 INFO [databricks.labs.ucx.install] Fetching installations...
15:47 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
15:47 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2020240403154713
15:47 INFO [databricks.labs.ucx.install] Creating dashboards...
15:47 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
15:47 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Estimates)...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
15:47 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Main)...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
15:47 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Azure)...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
15:47 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Interactive)...
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget
15:47 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=099-destroy-schema
15:48 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:48 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
15:48 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
15:48 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/README for the next steps.
15:48 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/122010249563624
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/B3KC
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_vspix.ucx_tz0ou', metastore_id=None, name='ucx_tz0ou', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_vspix', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_vspix/ucx_tz0ou', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_vspix.ucx_tykbk', metastore_id=None, name='ucx_tykbk', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_vspix', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/B3KC', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_vspix', metastore_id=None, name='migrate_vspix', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ct3jp', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ct3jp.migrate_vspix', metastore_id=None, name='migrate_vspix', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures
16:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712159229690, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ct3jp', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ct3jp', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712159229690, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
16:08 INFO [databricks.labs.ucx.install] Deleting UCX v0.21.1+2020240403160809 from https://DATABRICKS_HOST
16:08 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_SiYMV_migrate_inventory
16:08 INFO [databricks.labs.ucx.install] Deleting jobs
16:08 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=551262438657257.
16:08 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=1122641965915785.
16:08 INFO [databricks.labs.ucx.install] Deleting 099-destroy-schema job_id=471514083883187.
16:08 INFO [databricks.labs.ucx.install] Deleting assessment job_id=314015191100437.
16:08 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=974481331103360.
16:08 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=502636985543618.
16:08 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=122010249563624.
16:08 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=53951839364609.
16:08 INFO [databricks.labs.ucx.install] Deleting cluster policy
16:08 INFO [databricks.labs.ucx.install] Deleting secret scope
16:08 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
Running from nightly #12