Skip to content

Inject _TASKS via constructor to WorkflowsDeployment instead of a global variable#1247

Merged
nfx merged 1 commit intomainfrom
fix/workflows-tasks
Apr 3, 2024
Merged

Inject _TASKS via constructor to WorkflowsDeployment instead of a global variable#1247
nfx merged 1 commit intomainfrom
fix/workflows-tasks

Conversation

@nfx
Copy link
Copy Markdown
Collaborator

@nfx nfx commented Apr 3, 2024

Refactoring required for #1209

@nfx nfx requested review from a team and william-conti April 3, 2024 18:27
@nfx nfx merged commit 8dc0f2b into main Apr 3, 2024
@nfx nfx deleted the fix/workflows-tasks branch April 3, 2024 18:29
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 3, 2024

❌ 135/138 passed, 3 failed, 20 skipped, 2h7m3s total

❌ test_migrate_managed_tables_with_principal_acl_CLOUD_ENV: TimeoutError: Timed out after 0:03:00 (4m0.2s) 
TimeoutError: Timed out after 0:03:00
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxfz9: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxfz9
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxfz9', metastore_id=None, name='ucx_sxfz9', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa280f2fc40>
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_sxfz9
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szvms: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szvms
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szvms', metastore_id=None, name='ucx_szvms', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szvms.ucx_tiovf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szvms/ucx_tiovf
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szvms.ucx_tiovf', metastore_id=None, name='ucx_tiovf', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szvms', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_sxfz9', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712169307208, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c5fpx', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c5fpx', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712169307208, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c5fpx.ucx_szvms: https://DATABRICKS_HOST/explore/data/ucx_c5fpx/ucx_szvms
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c5fpx', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c5fpx.ucx_szvms', metastore_id=None, name='ucx_szvms', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
18:35 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxfz9: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxfz9
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxfz9', metastore_id=None, name='ucx_sxfz9', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa280f2fc40>
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_sxfz9
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szvms: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szvms
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szvms', metastore_id=None, name='ucx_szvms', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szvms.ucx_tiovf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szvms/ucx_tiovf
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szvms.ucx_tiovf', metastore_id=None, name='ucx_tiovf', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szvms', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_sxfz9', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712169307208, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c5fpx', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c5fpx', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712169307208, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c5fpx.ucx_szvms: https://DATABRICKS_HOST/explore/data/ucx_c5fpx/ucx_szvms
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c5fpx', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c5fpx.ucx_szvms', metastore_id=None, name='ucx_szvms', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
18:35 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='3271876205345293', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] crawling new batch for groups
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 32 WorkspaceGroup
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 250 account groups
18:35 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-b8xi group
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for regular_group_UcElRMERZGXJSDnW group
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] found 30 new records for groups
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='1320634816489095', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4149078816054960', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7790500925370763', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6044399849376990', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='2820610171269704', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='643465450247786', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5917479725984588', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='750510588218144', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7555805099323672', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6050480426131754', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxfz9: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxfz9
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxfz9', metastore_id=None, name='ucx_sxfz9', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa280f2fc40>
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_sxfz9
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szvms: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szvms
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szvms', metastore_id=None, name='ucx_szvms', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szvms.ucx_tiovf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szvms/ucx_tiovf
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szvms.ucx_tiovf', metastore_id=None, name='ucx_tiovf', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szvms', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_sxfz9', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712169307208, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c5fpx', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c5fpx', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712169307208, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c5fpx.ucx_szvms: https://DATABRICKS_HOST/explore/data/ucx_c5fpx/ucx_szvms
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c5fpx', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c5fpx.ucx_szvms', metastore_id=None, name='ucx_szvms', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
18:35 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='3271876205345293', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] crawling new batch for groups
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 32 WorkspaceGroup
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 250 account groups
18:35 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-b8xi group
18:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for regular_group_UcElRMERZGXJSDnW group
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] found 30 new records for groups
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='1320634816489095', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4149078816054960', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7790500925370763', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6044399849376990', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='2820610171269704', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='643465450247786', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5917479725984588', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='750510588218144', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7555805099323672', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6050480426131754', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxfz9.groups] fetching groups inventory
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 11 cluster permissions fixtures
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0403-183503-ayp3mvgh [group_name admins CAN_MANAGE] -> [user_name [email protected] CAN_ATTACH_TO]
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster fixtures
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: <databricks.sdk.service._internal.Wait object at 0x7fa280f2fc40>
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712169307208, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c5fpx', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c5fpx', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712169307208, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szvms.ucx_tiovf', metastore_id=None, name='ucx_tiovf', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szvms', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_sxfz9', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ucx_sxfz9
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxfz9', metastore_id=None, name='ucx_sxfz9', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szvms', metastore_id=None, name='ucx_szvms', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c5fpx', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c5fpx.ucx_szvms', metastore_id=None, name='ucx_szvms', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 11 workspace user fixtures
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='3271876205345293', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='1320634816489095', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4149078816054960', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7790500925370763', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6044399849376990', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='2820610171269704', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='643465450247786', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5917479725984588', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='750510588218144', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7555805099323672', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6050480426131754', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_table_migration_job_cluster_override: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task migrate_dbfs_root_delta_tables failed with message: Workload failed, see run output for details. This caused all downstream tasks to get skipped. (10m6.568s) 
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task migrate_dbfs_root_delta_tables failed with message: Workload failed, see run output for details. This caused all downstream tasks to get skipped.
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_xd1mf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_xd1mf
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_xd1mf', metastore_id=None, name='migrate_xd1mf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_xd1mf.ucx_tuggv: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_xd1mf/ucx_tuggv
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_xd1mf.ucx_tuggv', metastore_id=None, name='ucx_tuggv', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_xd1mf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_xd1mf/ucx_tuggv', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ocdi
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_xd1mf.ucx_twso1: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_xd1mf/ucx_twso1
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_xd1mf.ucx_twso1', metastore_id=None, name='ucx_twso1', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_xd1mf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ocdi', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712169349726, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdmqv', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdmqv', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712169349726, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cdmqv.migrate_xd1mf: https://DATABRICKS_HOST/explore/data/ucx_cdmqv/migrate_xd1mf
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdmqv', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdmqv.migrate_xd1mf', metastore_id=None, name='migrate_xd1mf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 INFO [databricks.labs.ucx.install] UCX v0.21.1+2620240403183551 is already installed on this workspace
18:35 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2620240403183552
18:35 INFO [databricks.labs.ucx.install] Creating dashboards...
18:35 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:35 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
18:35 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
18:35 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
18:35 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX  Assessment (Estimates)...
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
18:36 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX  Assessment (Main)...
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
18:36 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX  Assessment (Azure)...
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
18:36 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX  Assessment (Interactive)...
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=885410113229991
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=099-destroy-schema job_id=597559818155916
18:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=635206684711673
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=196639462204964
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=585005493764359
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=494103726479352
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=1061145533667176
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=118993114318838
18:36 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/README for the next steps.
18:36 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/585005493764359
18:36 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/585005493764359
18:36 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_xd1mf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_xd1mf
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_xd1mf', metastore_id=None, name='migrate_xd1mf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_xd1mf.ucx_tuggv: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_xd1mf/ucx_tuggv
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_xd1mf.ucx_tuggv', metastore_id=None, name='ucx_tuggv', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_xd1mf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_xd1mf/ucx_tuggv', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ocdi
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_xd1mf.ucx_twso1: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_xd1mf/ucx_twso1
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_xd1mf.ucx_twso1', metastore_id=None, name='ucx_twso1', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_xd1mf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ocdi', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712169349726, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdmqv', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdmqv', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712169349726, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
18:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cdmqv.migrate_xd1mf: https://DATABRICKS_HOST/explore/data/ucx_cdmqv/migrate_xd1mf
18:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdmqv', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdmqv.migrate_xd1mf', metastore_id=None, name='migrate_xd1mf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:35 INFO [databricks.labs.ucx.install] UCX v0.21.1+2620240403183551 is already installed on this workspace
18:35 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2620240403183552
18:35 INFO [databricks.labs.ucx.install] Creating dashboards...
18:35 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:35 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
18:35 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
18:35 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
18:35 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX  Assessment (Estimates)...
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
18:36 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX  Assessment (Main)...
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
18:36 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX  Assessment (Azure)...
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
18:36 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX  Assessment (Interactive)...
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget
18:36 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=885410113229991
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=099-destroy-schema job_id=597559818155916
18:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=635206684711673
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=196639462204964
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=585005493764359
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=494103726479352
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=1061145533667176
18:36 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=118993114318838
18:36 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/README for the next steps.
18:36 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/585005493764359
18:36 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/585005493764359
18:36 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ocdi
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_xd1mf.ucx_tuggv', metastore_id=None, name='ucx_tuggv', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_xd1mf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_xd1mf/ucx_tuggv', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.CSV: 'CSV'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_xd1mf.ucx_twso1', metastore_id=None, name='ucx_twso1', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_xd1mf', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ocdi', table_constraints=None, table_id=None, table_type=<TableType.EXTERNAL: 'EXTERNAL'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_xd1mf', metastore_id=None, name='migrate_xd1mf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdmqv', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdmqv.migrate_xd1mf', metastore_id=None, name='migrate_xd1mf', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures
18:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1712169349726, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdmqv', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdmqv', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712169349726, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
18:45 INFO [databricks.labs.ucx.install] Deleting UCX v0.21.1+2620240403184547 from https://DATABRICKS_HOST
18:45 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_S24M0_migrate_inventory
18:45 INFO [databricks.labs.ucx.install] Deleting jobs
18:45 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=118993114318838.
18:45 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1061145533667176.
18:45 INFO [databricks.labs.ucx.install] Deleting assessment job_id=635206684711673.
18:45 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=196639462204964.
18:45 INFO [databricks.labs.ucx.install] Deleting 099-destroy-schema job_id=597559818155916.
18:45 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=885410113229991.
18:45 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=494103726479352.
18:45 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=585005493764359.
18:45 INFO [databricks.labs.ucx.install] Deleting cluster policy
18:45 INFO [databricks.labs.ucx.install] Deleting secret scope
18:45 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_running_real_assessment_job: TimeoutError: Timed out after 0:05:00 (21m6.256s) 
TimeoutError: Timed out after 0:05:00
[gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4830100548232564', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:38 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_XoZS: https://DATABRICKS_HOST#setting/accounts/groups/600306507938555
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_XoZS', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='600306507938555', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4830100548232564', type=None, value='4830100548232564')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
18:38 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_XoZS: https://accounts.CLOUD_ENVdatabricks.net/users/groups/174765959941205/members
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_XoZS', entitlements=[], external_id=None, groups=[], id='174765959941205', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4830100548232564', type=None, value='4830100548232564')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
18:38 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00024DB0C2B08465
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00024DB0C2B08465')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00024DB0C2B08465 [group_name admins CAN_USE] -> [group_name ucx_XoZS CAN_USE]
18:38 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.rwFj/config.yml) doesn't exist.
18:38 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
18:38 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
18:38 INFO [databricks.labs.ucx.install] Fetching installations...
18:38 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
18:38 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2620240403183810
18:38 INFO [databricks.labs.ucx.install] Creating dashboards...
18:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
18:38 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [RWFJ] UCX  Assessment (Estimates)...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
18:38 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [RWFJ] UCX  Assessment (Main)...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
18:38 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [RWFJ] UCX  Assessment (Azure)...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
18:38 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [RWFJ] UCX  Assessment (Interactive)...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
18:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=099-destroy-schema
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
18:39 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.rwFj/README for the next steps.
18:39 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/524269081053306
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4830100548232564', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:38 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_XoZS: https://DATABRICKS_HOST#setting/accounts/groups/600306507938555
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_XoZS', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='600306507938555', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4830100548232564', type=None, value='4830100548232564')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
18:38 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_XoZS: https://accounts.CLOUD_ENVdatabricks.net/users/groups/174765959941205/members
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_XoZS', entitlements=[], external_id=None, groups=[], id='174765959941205', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4830100548232564', type=None, value='4830100548232564')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
18:38 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00024DB0C2B08465
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00024DB0C2B08465')
18:38 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00024DB0C2B08465 [group_name admins CAN_USE] -> [group_name ucx_XoZS CAN_USE]
18:38 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.rwFj/config.yml) doesn't exist.
18:38 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
18:38 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
18:38 INFO [databricks.labs.ucx.install] Fetching installations...
18:38 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
18:38 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2620240403183810
18:38 INFO [databricks.labs.ucx.install] Creating dashboards...
18:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
18:38 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [RWFJ] UCX  Assessment (Estimates)...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
18:38 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [RWFJ] UCX  Assessment (Main)...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
18:38 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [RWFJ] UCX  Assessment (Azure)...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
18:38 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [RWFJ] UCX  Assessment (Interactive)...
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget
18:38 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
18:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:38 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=099-destroy-schema
18:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
18:39 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.rwFj/README for the next steps.
18:39 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/524269081053306
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 00024DB0C2B08465 [group_name admins CAN_USE] -> [group_name ucx_XoZS CAN_USE]
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='00024DB0C2B08465')
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='4830100548232564', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_XoZS', entitlements=[], external_id=None, groups=[], id='174765959941205', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4830100548232564', type=None, value='4830100548232564')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures
18:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_XoZS', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='600306507938555', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/4830100548232564', type=None, value='4830100548232564')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
18:59 INFO [databricks.labs.ucx.install] Deleting UCX v0.21.1+2620240403185905 from https://DATABRICKS_HOST
18:59 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_Sbh3r
18:59 INFO [databricks.labs.ucx.install] Deleting jobs
18:59 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=768913813353793.
18:59 INFO [databricks.labs.ucx.install] Deleting assessment job_id=524269081053306.
18:59 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=481619047945941.
18:59 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=762960880842375.
18:59 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=382240377705143.
18:59 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=1108929264314334.
18:59 INFO [databricks.labs.ucx.install] Deleting 099-destroy-schema job_id=791569221903155.
18:59 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=916056981106128.
18:59 INFO [databricks.labs.ucx.install] Deleting cluster policy
18:59 INFO [databricks.labs.ucx.install] Deleting secret scope
18:59 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from acceptance #1986

ericvergnaud added a commit to ericvergnaud/ucx that referenced this pull request Apr 5, 2024
@ericvergnaud
Merge branch 'main' into notebook-dependency-graph
2aaedf8 
* main:
  remove `isort` (databrickslabs#1280)
  Addressed Issue with Disabled Feature in certain regions (databrickslabs#1275)
  Improve documentation (databrickslabs#1162)
  Add roadmap workflows and tasks to Table Migration Workflow document (databrickslabs#1274)
  Fix integration test with new DeployedWorkflows (databrickslabs#1250)
  Document troubleshooting guide (databrickslabs#1226)
  Split `DeployedWorkflows` out of `WorkflowsDeployment` (databrickslabs#1248)
  Inject `_TASKS` via constructor to `WorkflowsDeployment` instead of a global variable (databrickslabs#1247)
  Decouple `InstallState` from `WorkspaceDeployment` constructor
  Add document for table migration workflow (databrickslabs#1229)
  Decouple `InstallState` from `WorkflowsDeployment` constructor (databrickslabs#1246)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@william-conti william-conti Awaiting requested review from william-conti

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@nfx