-
Notifications
You must be signed in to change notification settings - Fork 101
Test failure: test_migrate_managed_tables_with_acl #1549
Copy link
Copy link
Closed
Description
❌ test_migrate_managed_tables_with_acl: TimeoutError: Timed out after 0:02:00 (2m30.607s)
TimeoutError: Timed out after 0:02:00
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_saokd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saokd
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_saokd.ucx_tinrp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saokd/ucx_tinrp
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_saokd.ucx_tinrp', metastore_id=None, name='ucx_tinrp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_saokd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_saokd/ucx_tinrp', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8364390299979051', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003124556, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cddyz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003124556, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cddyz.ucx_saokd: https://DATABRICKS_HOST/explore/data/ucx_cddyz/ucx_saokd
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cddyz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cddyz, managed_table=hive_metastore.ucx_saokd.ucx_tinrp
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ssjpo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ssjpo
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ssjpo', metastore_id=None, name='ucx_ssjpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] crawling new batch for grants
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] crawling new batch for tables
23:58 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_saokd] listing tables
23:58 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_saokd.ucx_tinrp] fetching table metadata
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] found 1 new records for tables
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] fetching udfs inventory
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] crawling new batch for udfs
23:59 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_saokd] listing udfs
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] found 0 new records for udfs
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] found 5 new records for grants
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] crawling new batch for groups
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Found 3 WorkspaceGroup
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Found 887 account groups
23:59 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for regular_group_JjAJwxvhUYpAOpgY group
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] found 2 new records for groups
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:59 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sggza: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sggza
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:59 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sggza.ucx_t5qht: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sggza/ucx_t5qht
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sggza.ucx_t5qht', metastore_id=None, name='ucx_t5qht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sggza', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sggza/ucx_t5qht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7755857317147628', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003201245, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cliqw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003201245, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cliqw.ucx_sggza: https://DATABRICKS_HOST/explore/data/ucx_cliqw/ucx_sggza
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cliqw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cliqw, managed_table=hive_metastore.ucx_sggza.ucx_t5qht
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szyug: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szyug
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szyug.ucx_tdp0a: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szyug/ucx_tdp0a
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szyug.ucx_tdp0a', metastore_id=None, name='ucx_tdp0a', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szyug', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_szyug/ucx_tdp0a', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8475873263288680', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003211058, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cvhfh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003211058, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cvhfh.ucx_szyug: https://DATABRICKS_HOST/explore/data/ucx_cvhfh/ucx_szyug
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cvhfh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cvhfh, managed_table=hive_metastore.ucx_szyug.ucx_tdp0a
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_supmw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_supmw
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_supmw.ucx_txc8j: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_supmw/ucx_txc8j
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_supmw.ucx_txc8j', metastore_id=None, name='ucx_txc8j', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_supmw', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_supmw/ucx_txc8j', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5532870947498700', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003234355, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdaba', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003234355, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cdaba.ucx_supmw: https://DATABRICKS_HOST/explore/data/ucx_cdaba/ucx_supmw
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdaba', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cdaba, managed_table=hive_metastore.ucx_supmw.ucx_txc8j
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_saokd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saokd
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_saokd.ucx_tinrp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saokd/ucx_tinrp
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_saokd.ucx_tinrp', metastore_id=None, name='ucx_tinrp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_saokd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_saokd/ucx_tinrp', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8364390299979051', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003124556, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cddyz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003124556, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cddyz.ucx_saokd: https://DATABRICKS_HOST/explore/data/ucx_cddyz/ucx_saokd
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cddyz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cddyz, managed_table=hive_metastore.ucx_saokd.ucx_tinrp
23:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ssjpo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ssjpo
23:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ssjpo', metastore_id=None, name='ucx_ssjpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:58 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext.
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] crawling new batch for grants
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] crawling new batch for tables
23:58 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_saokd] listing tables
23:58 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_saokd.ucx_tinrp] fetching table metadata
23:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] found 1 new records for tables
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] fetching udfs inventory
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] crawling new batch for udfs
23:59 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_saokd] listing udfs
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.udfs] found 0 new records for udfs
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] found 5 new records for grants
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] crawling new batch for groups
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Found 3 WorkspaceGroup
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Found 887 account groups
23:59 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated
23:59 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for regular_group_JjAJwxvhUYpAOpgY group
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] found 2 new records for groups
23:59 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
23:59 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sggza: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sggza
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
23:59 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sggza.ucx_t5qht: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sggza/ucx_t5qht
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sggza.ucx_t5qht', metastore_id=None, name='ucx_t5qht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sggza', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sggza/ucx_t5qht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
23:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7755857317147628', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003201245, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cliqw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003201245, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cliqw.ucx_sggza: https://DATABRICKS_HOST/explore/data/ucx_cliqw/ucx_sggza
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cliqw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cliqw, managed_table=hive_metastore.ucx_sggza.ucx_t5qht
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szyug: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szyug
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szyug.ucx_tdp0a: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szyug/ucx_tdp0a
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szyug.ucx_tdp0a', metastore_id=None, name='ucx_tdp0a', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szyug', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_szyug/ucx_tdp0a', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8475873263288680', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003211058, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cvhfh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003211058, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cvhfh.ucx_szyug: https://DATABRICKS_HOST/explore/data/ucx_cvhfh/ucx_szyug
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cvhfh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cvhfh, managed_table=hive_metastore.ucx_szyug.ucx_tdp0a
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_supmw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_supmw
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_supmw.ucx_txc8j: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_supmw/ucx_txc8j
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_supmw.ucx_txc8j', metastore_id=None, name='ucx_txc8j', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_supmw', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_supmw/ucx_txc8j', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5532870947498700', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003234355, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdaba', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003234355, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cdaba.ucx_supmw: https://DATABRICKS_HOST/explore/data/ucx_cdaba/ucx_supmw
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdaba', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:00 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_cdaba, managed_table=hive_metastore.ucx_supmw.ucx_txc8j
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.grants] fetching grants inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.groups] fetching groups inventory
00:00 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_ssjpo.tables] fetching tables inventory
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 workspace user fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8364390299979051', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7755857317147628', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8475873263288680', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='5532870947498700', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 catalog fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003124556, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cddyz', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003124556, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003201245, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cliqw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003201245, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003211058, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cvhfh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003211058, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=<CatalogType.MANAGED_CATALOG: 'MANAGED_CATALOG'>, comment='', connection_name=None, created_at=1714003234355, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba', isolation_mode=<IsolationMode.OPEN: 'OPEN'>, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cdaba', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=<CatalogInfoSecurableKind.CATALOG_STANDARD: 'CATALOG_STANDARD'>, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1714003234355, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d')
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 table fixtures
00:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_saokd.ucx_tinrp', metastore_id=None, name='ucx_tinrp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_saokd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_saokd/ucx_tinrp', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sggza.ucx_t5qht', metastore_id=None, name='ucx_t5qht', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sggza', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sggza/ucx_t5qht', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szyug.ucx_tdp0a', metastore_id=None, name='ucx_tdp0a', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_szyug', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_szyug/ucx_tdp0a', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_supmw.ucx_txc8j', metastore_id=None, name='ucx_txc8j', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_supmw', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_supmw/ucx_txc8j', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 9 schema fixtures
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cddyz', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cddyz.ucx_saokd', metastore_id=None, name='ucx_saokd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ssjpo', metastore_id=None, name='ucx_ssjpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cliqw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cliqw.ucx_sggza', metastore_id=None, name='ucx_sggza', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cvhfh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cvhfh.ucx_szyug', metastore_id=None, name='ucx_szyug', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
00:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cdaba', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cdaba.ucx_supmw', metastore_id=None, name='ucx_supmw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
Running from nightly #39
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels