Skip to content

Test failure: test_migrate_managed_tables_with_acl #1549

@github-actions

Description

@github-actions
❌ test_migrate_managed_tables_with_acl: TimeoutError: Timed out after 0:02:00 (2m30.607s)
TimeoutError: Timed out after 0:02:00
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_saokd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saokd
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_saokd.ucx_tinrp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saokd/ucx_tinrp
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_saokd.ucx_tinrp', metastore_id=None, name='ucx_tinrp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_saokd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_saokd/ucx_tinrp', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8364390299979051', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003124556, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cddyz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003124556, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cddyz.ucx_saokd: https://DATABRICKS_HOST/explore/data/ucx_cddyz/ucx_saokd
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cddyz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cddyz, managed_table=hive_metastore.ucx_saokd.ucx_tinrp
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ssjpo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ssjpo
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ssjpo', metastore_id=None, name='ucx_ssjpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] crawling new batch for grants
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] crawling new batch for tables
23:58 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_saokd] listing tables
23:58 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_saokd.ucx_tinrp] fetching table metadata
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] found 1 new records for tables
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] fetching udfs inventory
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] crawling new batch for udfs
23:59 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_saokd] listing udfs
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] found 0 new records for udfs
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] found 5 new records for grants
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] crawling new batch for groups
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Found 3 WorkspaceGroup
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Found 887 account groups
23:59 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for regular_group_JjAJwxvhUYpAOpgY group
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] found 2 new records for groups
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:59 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sggza: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sggza
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:59 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sggza.ucx_t5qht: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sggza/ucx_t5qht
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sggza.ucx_t5qht', metastore_id=None, name='ucx_t5qht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sggza', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sggza/ucx_t5qht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7755857317147628', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003201245, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cliqw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003201245, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cliqw.ucx_sggza: https://DATABRICKS_HOST/explore/data/ucx_cliqw/ucx_sggza
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cliqw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cliqw, managed_table=hive_metastore.ucx_sggza.ucx_t5qht
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szyug: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szyug
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szyug.ucx_tdp0a: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szyug/ucx_tdp0a
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szyug.ucx_tdp0a', metastore_id=None, name='ucx_tdp0a', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szyug', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_szyug/ucx_tdp0a', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8475873263288680', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003211058, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cvhfh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003211058, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cvhfh.ucx_szyug: https://DATABRICKS_HOST/explore/data/ucx_cvhfh/ucx_szyug
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cvhfh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cvhfh, managed_table=hive_metastore.ucx_szyug.ucx_tdp0a
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_supmw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_supmw
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_supmw.ucx_txc8j: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_supmw/ucx_txc8j
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_supmw.ucx_txc8j', metastore_id=None, name='ucx_txc8j', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_supmw', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_supmw/ucx_txc8j', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5532870947498700', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003234355, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdaba', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003234355, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cdaba.ucx_supmw: https://DATABRICKS_HOST/explore/data/ucx_cdaba/ucx_supmw
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdaba', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cdaba, managed_table=hive_metastore.ucx_supmw.ucx_txc8j
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_saokd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saokd
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_saokd.ucx_tinrp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saokd/ucx_tinrp
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_saokd.ucx_tinrp', metastore_id=None, name='ucx_tinrp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_saokd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_saokd/ucx_tinrp', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8364390299979051', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003124556, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cddyz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003124556, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cddyz.ucx_saokd: https://DATABRICKS_HOST/explore/data/ucx_cddyz/ucx_saokd
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cddyz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cddyz, managed_table=hive_metastore.ucx_saokd.ucx_tinrp
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ssjpo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ssjpo
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ssjpo', metastore_id=None, name='ucx_ssjpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] crawling new batch for grants
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] crawling new batch for tables
23:58 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_saokd] listing tables
23:58 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_saokd.ucx_tinrp] fetching table metadata
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] found 1 new records for tables
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] fetching udfs inventory
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] crawling new batch for udfs
23:59 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_saokd] listing udfs
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] found 0 new records for udfs
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] found 5 new records for grants
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] crawling new batch for groups
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Found 3 WorkspaceGroup
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Found 887 account groups
23:59 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for regular_group_JjAJwxvhUYpAOpgY group
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] found 2 new records for groups
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:59 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sggza: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sggza
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:59 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sggza.ucx_t5qht: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sggza/ucx_t5qht
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sggza.ucx_t5qht', metastore_id=None, name='ucx_t5qht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sggza', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sggza/ucx_t5qht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7755857317147628', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003201245, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cliqw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003201245, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cliqw.ucx_sggza: https://DATABRICKS_HOST/explore/data/ucx_cliqw/ucx_sggza
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cliqw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cliqw, managed_table=hive_metastore.ucx_sggza.ucx_t5qht
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szyug: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szyug
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szyug.ucx_tdp0a: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szyug/ucx_tdp0a
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szyug.ucx_tdp0a', metastore_id=None, name='ucx_tdp0a', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szyug', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_szyug/ucx_tdp0a', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8475873263288680', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003211058, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cvhfh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003211058, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cvhfh.ucx_szyug: https://DATABRICKS_HOST/explore/data/ucx_cvhfh/ucx_szyug
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cvhfh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cvhfh, managed_table=hive_metastore.ucx_szyug.ucx_tdp0a
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_supmw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_supmw
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_supmw.ucx_txc8j: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_supmw/ucx_txc8j
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_supmw.ucx_txc8j', metastore_id=None, name='ucx_txc8j', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_supmw', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_supmw/ucx_txc8j', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5532870947498700', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003234355, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdaba', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003234355, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cdaba.ucx_supmw: https://DATABRICKS_HOST/explore/data/ucx_cdaba/ucx_supmw
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdaba', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cdaba, managed_table=hive_metastore.ucx_supmw.ucx_txc8j
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 workspace user fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8364390299979051', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7755857317147628', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8475873263288680', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5532870947498700', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 catalog fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003124556, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cddyz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003124556, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003201245, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cliqw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003201245, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003211058, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cvhfh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003211058, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003234355, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdaba', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003234355, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 table fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_saokd.ucx_tinrp', metastore_id=None, name='ucx_tinrp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_saokd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_saokd/ucx_tinrp', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sggza.ucx_t5qht', metastore_id=None, name='ucx_t5qht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sggza', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sggza/ucx_t5qht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szyug.ucx_tdp0a', metastore_id=None, name='ucx_tdp0a', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szyug', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_szyug/ucx_tdp0a', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_supmw.ucx_txc8j', metastore_id=None, name='ucx_txc8j', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_supmw', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_supmw/ucx_txc8j', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 9 schema fixtures
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cddyz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ssjpo', metastore_id=None, name='ucx_ssjpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cliqw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cvhfh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdaba', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #39

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions