Fix assessment.md table of contents for the 300 series findings by dmoore247 · Pull Request #1162 · databrickslabs/ucx

dmoore247 · 2024-03-28T22:23:48Z

Changes

Fix assessment.md table of contents for the 300 series findings

Linked issues

Resolves #..

Functionality

added relevant user documentation
added new CLI command
modified existing command: databricks labs ucx ...
added a new workflow
modified existing workflow: ...
added a new table
modified existing table: ...

Tests

manually tested
added unit tests
added integration tests
verified on staging environment (screenshot attached)

Tested in github browser.

codecov · 2024-03-28T22:27:01Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 89.80%. Comparing base (b4b3b52) to head (75dbc11).
Report is 49 commits behind head on main.

❗ Current head 75dbc11 differs from pull request most recent head 4e0150a. Consider uploading reports for the commit 4e0150a to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1162      +/-   ##
==========================================
+ Coverage   89.75%   89.80%   +0.04%     
==========================================
  Files          60       61       +1     
  Lines        7235     7246      +11     
  Branches     1299     1299              
==========================================
+ Hits         6494     6507      +13     
+ Misses        477      475       -2     
  Partials      264      264

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

github-actions · 2024-03-28T23:19:15Z

❌ 136/138 passed, 2 failed, 20 skipped, 2h15m4s total

❌ test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only: Failed: DID NOT RAISE (22.95s)

Failed: DID NOT RAISE <class 'databricks.sdk.errors.platform.NotFound'>
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s4tbr: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s4tbr
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s4tbr', metastore_id=None, name='ucx_s4tbr', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s4tbr: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s4tbr
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s4tbr', metastore_id=None, name='ucx_s4tbr', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6688335313056842', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_4HdI: https://DATABRICKS_HOST#setting/accounts/groups/123581707173510
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_4HdI', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='123581707173510', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6688335313056842', type=None, value='6688335313056842')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_4HdI: https://accounts.CLOUD_ENVdatabricks.net/users/groups/209433901339231/members
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_4HdI', entitlements=[], external_id=None, groups=[], id='209433901339231', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6688335313056842', type=None, value='6688335313056842')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 48 Group
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] fetching groups inventory
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] crawling new batch for groups
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 288 account groups
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] found 1 new records for groups
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Renaming: ucx_4HdI -> ucx-temp-ucx_4HdI
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 288 account groups
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 49 Group
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] fetching groups inventory
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 49 Group
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] fetching groups inventory
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Skipping ucx_4HdI: no longer in workspace
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s4tbr: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s4tbr
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s4tbr', metastore_id=None, name='ucx_s4tbr', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6688335313056842', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_4HdI: https://DATABRICKS_HOST#setting/accounts/groups/123581707173510
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_4HdI', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='123581707173510', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6688335313056842', type=None, value='6688335313056842')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_4HdI: https://accounts.CLOUD_ENVdatabricks.net/users/groups/209433901339231/members
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_4HdI', entitlements=[], external_id=None, groups=[], id='209433901339231', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6688335313056842', type=None, value='6688335313056842')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 48 Group
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] fetching groups inventory
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] crawling new batch for groups
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 288 account groups
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] found 1 new records for groups
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Renaming: ucx_4HdI -> ucx-temp-ucx_4HdI
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 288 account groups
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 49 Group
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] fetching groups inventory
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Found 49 Group
21:08 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_s4tbr.groups] fetching groups inventory
21:08 INFO [databricks.labs.ucx.workspace_access.groups] Skipping ucx_4HdI: no longer in workspace
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s4tbr', metastore_id=None, name='ucx_s4tbr', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='6688335313056842', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_4HdI', entitlements=[], external_id=None, groups=[], id='209433901339231', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6688335313056842', type=None, value='6688335313056842')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_4HdI', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='123581707173510', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/6688335313056842', type=None, value='6688335313056842')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

❌ test_replace_workspace_groups_with_account_groups: TimeoutError: Timed out after 0:03:00 (3m52.489s)

TimeoutError: Timed out after 0:03:00
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqztt: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqztt
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqztt', metastore_id=None, name='ucx_sqztt', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqztt: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqztt
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqztt', metastore_id=None, name='ucx_sqztt', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8001778678978328', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_kWNx: https://DATABRICKS_HOST#setting/accounts/groups/377420390417712
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_kWNx', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='377420390417712', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8001778678978328', type=None, value='8001778678978328')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_kWNx: https://accounts.CLOUD_ENVdatabricks.net/users/groups/432164346061533/members
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_kWNx', entitlements=[], external_id=None, groups=[], id='432164346061533', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8001778678978328', type=None, value='8001778678978328')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001C2E556D72A300
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001C2E556D72A300')
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001C2E556D72A300 [group_name admins CAN_USE] -> [group_name ucx_kWNx CAN_USE]
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1gnr: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1gnr
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1gnr', metastore_id=None, name='ucx_s1gnr', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s1gnr.ucx_tgxbh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1gnr/ucx_tgxbh
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1gnr.ucx_tgxbh', metastore_id=None, name='ucx_tgxbh', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1gnr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1gnr/ucx_tgxbh', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:09 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
21:09 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.035564
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] fetching grants inventory
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] crawling new batch for grants
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] found 15 new records for grants
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 25
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 25
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.permissions] found 25 new records for permissions
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Saved 25 to hive_metastore.ucx_sqztt.permissions
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] fetching groups inventory
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] crawling new batch for groups
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 288 account groups
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] found 1 new records for groups
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 51 Group
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 12 WorkspaceGroup
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] fetching groups inventory
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Renaming: ucx_kWNx -> ucx-temp-ucx_kWNx
21:09 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 287 account groups
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 50 Group
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] fetching groups inventory
21:09 INFO [tests.integration.workspace_access.test_groups] check_permissions_after_replace()
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Applying the permissions to account groups. Total groups to apply permissions: 1. Total permissions found: 25
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Total tasks for TABLE: 1
21:09 DEBUG [databricks.labs.ucx.workspace_access.generic] Skipping AccessControlResponse(all_permissions=[Permission(inherited=True, inherited_from_object=['/cluster-policies/cluster-policies'], permission_level=<PermissionLevel.CAN_USE: 'CAN_USE'>)], display_name=None, group_name='admins', service_principal_name=None, user_name=None) for cluster-policy//cluster-policies/001C2E556D72A300 because it is not in scope
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Total tasks for cluster-policies: 1
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Starting to apply permissions on account groups. Total tasks: 2
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Permissions were applied
21:09 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_account_group()
21:09 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_account_group()
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 12 WorkspaceGroup
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 50 Group
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] fetching groups inventory
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Skipping ucx_kWNx: no longer in workspace
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:10 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:10 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:10 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:10 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='358599907746021', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_6Ald: https://DATABRICKS_HOST#setting/accounts/groups/60294938055606
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_6Ald', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='60294938055606', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/358599907746021', type=None, value='358599907746021')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_6Ald: https://accounts.CLOUD_ENVdatabricks.net/users/groups/678311140485731/members
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_6Ald', entitlements=[], external_id=None, groups=[], id='678311140485731', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/358599907746021', type=None, value='358599907746021')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000584D64F9C7C87
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000584D64F9C7C87')
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000584D64F9C7C87 [group_name admins CAN_USE] -> [group_name ucx_6Ald CAN_USE]
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spezz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spezz
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spezz', metastore_id=None, name='ucx_spezz', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_spezz.ucx_tymva: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spezz/ucx_tymva
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_spezz.ucx_tymva', metastore_id=None, name='ucx_tymva', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_spezz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_spezz/ucx_tymva', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:11 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
21:11 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.036035
21:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] fetching grants inventory
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 23
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 23
21:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.permissions] found 23 new records for permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Saved 23 to hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7897718118081743', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_lHID: https://DATABRICKS_HOST#setting/accounts/groups/973784746124113
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_lHID', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='973784746124113', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/7897718118081743', type=None, value='7897718118081743')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_lHID: https://accounts.CLOUD_ENVdatabricks.net/users/groups/57553425910726/members
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_lHID', entitlements=[], external_id=None, groups=[], id='57553425910726', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/7897718118081743', type=None, value='7897718118081743')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00019E7BD1E35D45
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00019E7BD1E35D45')
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00019E7BD1E35D45 [group_name admins CAN_USE] -> [group_name ucx_lHID CAN_USE]
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfv8a: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfv8a
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfv8a', metastore_id=None, name='ucx_sfv8a', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sfv8a.ucx_tflei: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfv8a/ucx_tflei
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sfv8a.ucx_tflei', metastore_id=None, name='ucx_tflei', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sfv8a', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sfv8a/ucx_tflei', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:11 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
21:11 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.033289
21:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] fetching grants inventory
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 24
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 24
21:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.permissions] found 24 new records for permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Saved 24 to hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqztt: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqztt
21:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqztt', metastore_id=None, name='ucx_sqztt', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8001778678978328', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_kWNx: https://DATABRICKS_HOST#setting/accounts/groups/377420390417712
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_kWNx', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='377420390417712', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8001778678978328', type=None, value='8001778678978328')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_kWNx: https://accounts.CLOUD_ENVdatabricks.net/users/groups/432164346061533/members
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_kWNx', entitlements=[], external_id=None, groups=[], id='432164346061533', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8001778678978328', type=None, value='8001778678978328')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001C2E556D72A300
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001C2E556D72A300')
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001C2E556D72A300 [group_name admins CAN_USE] -> [group_name ucx_kWNx CAN_USE]
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1gnr: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1gnr
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1gnr', metastore_id=None, name='ucx_s1gnr', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:09 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s1gnr.ucx_tgxbh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1gnr/ucx_tgxbh
21:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1gnr.ucx_tgxbh', metastore_id=None, name='ucx_tgxbh', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1gnr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1gnr/ucx_tgxbh', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:09 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
21:09 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.035564
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] fetching grants inventory
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] crawling new batch for grants
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] found 15 new records for grants
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 25
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 25
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.permissions] found 25 new records for permissions
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Saved 25 to hive_metastore.ucx_sqztt.permissions
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] fetching groups inventory
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] crawling new batch for groups
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 288 account groups
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] found 1 new records for groups
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 51 Group
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 12 WorkspaceGroup
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] fetching groups inventory
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Renaming: ucx_kWNx -> ucx-temp-ucx_kWNx
21:09 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_backup_group()
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 287 account groups
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 50 Group
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] fetching groups inventory
21:09 INFO [tests.integration.workspace_access.test_groups] check_permissions_after_replace()
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Applying the permissions to account groups. Total groups to apply permissions: 1. Total permissions found: 25
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Total tasks for TABLE: 1
21:09 DEBUG [databricks.labs.ucx.workspace_access.generic] Skipping AccessControlResponse(all_permissions=[Permission(inherited=True, inherited_from_object=['/cluster-policies/cluster-policies'], permission_level=<PermissionLevel.CAN_USE: 'CAN_USE'>)], display_name=None, group_name='admins', service_principal_name=None, user_name=None) for cluster-policy//cluster-policies/001C2E556D72A300 because it is not in scope
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Total tasks for cluster-policies: 1
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Starting to apply permissions on account groups. Total tasks: 2
21:09 INFO [databricks.labs.ucx.workspace_access.manager] Permissions were applied
21:09 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_account_group()
21:09 INFO [tests.integration.workspace_access.test_groups] check_permissions_for_account_group()
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 12 WorkspaceGroup
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta...
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Found 50 Group
21:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.groups] fetching groups inventory
21:09 INFO [databricks.labs.ucx.workspace_access.groups] Skipping ucx_kWNx: no longer in workspace
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:09 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:10 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:10 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:10 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:10 INFO [tests.integration.workspace_access.test_groups] check_table_permissions_after_backup_delete()
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='358599907746021', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_6Ald: https://DATABRICKS_HOST#setting/accounts/groups/60294938055606
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_6Ald', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='60294938055606', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/358599907746021', type=None, value='358599907746021')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_6Ald: https://accounts.CLOUD_ENVdatabricks.net/users/groups/678311140485731/members
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_6Ald', entitlements=[], external_id=None, groups=[], id='678311140485731', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/358599907746021', type=None, value='358599907746021')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000584D64F9C7C87
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000584D64F9C7C87')
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000584D64F9C7C87 [group_name admins CAN_USE] -> [group_name ucx_6Ald CAN_USE]
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spezz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spezz
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spezz', metastore_id=None, name='ucx_spezz', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_spezz.ucx_tymva: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spezz/ucx_tymva
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_spezz.ucx_tymva', metastore_id=None, name='ucx_tymva', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_spezz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_spezz/ucx_tymva', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:11 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
21:11 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.036035
21:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] fetching grants inventory
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 23
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 23
21:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.permissions] found 23 new records for permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Saved 23 to hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7897718118081743', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_lHID: https://DATABRICKS_HOST#setting/accounts/groups/973784746124113
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_lHID', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='973784746124113', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/7897718118081743', type=None, value='7897718118081743')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_lHID: https://accounts.CLOUD_ENVdatabricks.net/users/groups/57553425910726/members
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_lHID', entitlements=[], external_id=None, groups=[], id='57553425910726', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/7897718118081743', type=None, value='7897718118081743')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00019E7BD1E35D45
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00019E7BD1E35D45')
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00019E7BD1E35D45 [group_name admins CAN_USE] -> [group_name ucx_lHID CAN_USE]
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfv8a: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfv8a
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfv8a', metastore_id=None, name='ucx_sfv8a', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sfv8a.ucx_tflei: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfv8a/ucx_tflei
21:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sfv8a.ucx_tflei', metastore_id=None, name='ucx_tflei', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sfv8a', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sfv8a/ucx_tflei', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:11 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
21:11 INFO [databricks.labs.ucx.workspace_access.generic] Listed cluster-policies in 0:00:00.033289
21:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.grants] fetching grants inventory
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 24
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 24
21:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sqztt.permissions] found 24 new records for permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Saved 24 to hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:11 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 INFO [databricks.labs.ucx.workspace_access.manager] Loading inventory table hive_metastore.ucx_sqztt.permissions
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1gnr.ucx_tgxbh', metastore_id=None, name='ucx_tgxbh', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_s1gnr', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1gnr/ucx_tgxbh', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_spezz.ucx_tymva', metastore_id=None, name='ucx_tymva', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_spezz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_spezz/ucx_tymva', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sfv8a.ucx_tflei', metastore_id=None, name='ucx_tflei', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sfv8a', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sfv8a/ucx_tflei', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 cluster_policy permissions fixtures
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 001C2E556D72A300 [group_name admins CAN_USE] -> [group_name ucx_kWNx CAN_USE]
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 000584D64F9C7C87 [group_name admins CAN_USE] -> [group_name ucx_6Ald CAN_USE]
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 00019E7BD1E35D45 [group_name admins CAN_USE] -> [group_name ucx_lHID CAN_USE]
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 cluster policy fixtures
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='001C2E556D72A300')
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='000584D64F9C7C87')
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='00019E7BD1E35D45')
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 workspace user fixtures
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='8001778678978328', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='358599907746021', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='[email protected]', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='[email protected]')], entitlements=[], external_id=None, groups=[], id='7897718118081743', name=Name(family_name=None, given_name='[email protected]'), roles=[], schemas=[<UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_USER: 'urn:ietf:params:scim:schemas:core:2.0:User'>, <UserSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_EXTENSION_WORKSPACE_2_0_USER: 'urn:ietf:params:scim:schemas:extension:workspace:2.0:User'>], user_name='[email protected]')
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 account group fixtures
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_kWNx', entitlements=[], external_id=None, groups=[], id='432164346061533', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8001778678978328', type=None, value='8001778678978328')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_6Ald', entitlements=[], external_id=None, groups=[], id='678311140485731', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/358599907746021', type=None, value='358599907746021')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_lHID', entitlements=[], external_id=None, groups=[], id='57553425910726', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/7897718118081743', type=None, value='7897718118081743')], meta=None, roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 workspace group fixtures
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_kWNx', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='377420390417712', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/8001778678978328', type=None, value='8001778678978328')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_6Ald', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='60294938055606', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/358599907746021', type=None, value='358599907746021')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_lHID', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='973784746124113', members=[ComplexValue(display='[email protected]', primary=None, ref='Users/7897718118081743', type=None, value='7897718118081743')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 4 schema fixtures
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqztt', metastore_id=None, name='ucx_sqztt', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1gnr', metastore_id=None, name='ucx_s1gnr', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spezz', metastore_id=None, name='ucx_spezz', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
21:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfv8a', metastore_id=None, name='ucx_sfv8a', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from acceptance #2008}

nfx · 2024-03-29T08:20:52Z

docs/assessment.md

+    - [AF301.1 - spark.catalog.x](#af3011---sparkcatalogx)
+    - [AF301.2 - spark.catalog.x](#af3012---sparkcatalogx)
+  - [AF302.x - Arbitrary Java](#af302x---arbitrary-java)
+    - [AF302.1 - Arbitrary Java](#af3021---arbitrary-java)


Duplicate heading names make no sense for the user. Rewrite all headings to be unique and don't look like a copy-paste

…ttern found

nfx

lgtm

* main: remove `isort` (databrickslabs#1280) Addressed Issue with Disabled Feature in certain regions (databrickslabs#1275) Improve documentation (databrickslabs#1162) Add roadmap workflows and tasks to Table Migration Workflow document (databrickslabs#1274) Fix integration test with new DeployedWorkflows (databrickslabs#1250) Document troubleshooting guide (databrickslabs#1226) Split `DeployedWorkflows` out of `WorkflowsDeployment` (databrickslabs#1248) Inject `_TASKS` via constructor to `WorkflowsDeployment` instead of a global variable (databrickslabs#1247) Decouple `InstallState` from `WorkspaceDeployment` constructor Add document for table migration workflow (databrickslabs#1229) Decouple `InstallState` from `WorkflowsDeployment` constructor (databrickslabs#1246)

dmoore247 added 2 commits March 28, 2024 18:17

Update TOC for the 300 series assessment findings

877bcd6

Change streaming header numbering

75dbc11

dmoore247 requested review from a team and larsgeorge-db March 28, 2024 22:23

dmoore247 had a problem deploying to account-admin March 28, 2024 22:37 — with GitHub Actions Failure

nfx requested changes Mar 29, 2024

View reviewed changes

Convert TOC to '*', Enrich the AF300 series headers to include the pa…

f733078

…ttern found

dmoore247 had a problem deploying to account-admin April 4, 2024 20:58 — with GitHub Actions Failure

dmoore247 added 2 commits April 4, 2024 17:00

Update 1 TOC item

41dd388

Update TOC item with patterns found

4e0150a

nfx approved these changes Apr 4, 2024

View reviewed changes

nfx merged commit d1c6071 into main Apr 4, 2024

nfx deleted the fix/assessment_toc branch April 4, 2024 22:00

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix assessment.md table of contents for the 300 series findings#1162

Fix assessment.md table of contents for the 300 series findings#1162
nfx merged 5 commits intomainfrom
fix/assessment_toc

dmoore247 commented Mar 28, 2024

Uh oh!

codecov bot commented Mar 28, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Mar 28, 2024 •

edited

Loading

Uh oh!

nfx Mar 29, 2024

Uh oh!

nfx left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

dmoore247 commented Mar 28, 2024

Changes

Linked issues

Functionality

Tests

Uh oh!

codecov bot commented Mar 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

github-actions bot commented Mar 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nfx Mar 29, 2024

Choose a reason for hiding this comment

Uh oh!

nfx left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

codecov bot commented Mar 28, 2024 •

edited

Loading

github-actions bot commented Mar 28, 2024 •

edited

Loading