Skip to content

Test failure: test_running_real_workflow_linter_job #1952

@github-actions

Description

@github-actions
❌ test_running_real_workflow_linter_job: TimeoutError: timed out after 0:20:00: (31m38.45s)
TimeoutError: timed out after 0:20:00:
[gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb
07:06 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1081193719786485
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1081193719786485)
07:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_se9xo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_se9xo
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/config.yml) doesn't exist.
07:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:06 INFO [databricks.labs.ucx.install] Fetching installations...
07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:17 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:17 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240629071728
07:17 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:18 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/README for the next steps.
07:18 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/273125314324787
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb
07:06 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1081193719786485
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1081193719786485)
07:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_se9xo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_se9xo
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/config.yml) doesn't exist.
07:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:06 INFO [databricks.labs.ucx.install] Fetching installations...
07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:17 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:17 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240629071728
07:17 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:18 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/README for the next steps.
07:18 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/273125314324787
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=1081193719786485)
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb) doesn't exist.
07:38 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+1320240629071728 from https://DATABRICKS_HOST
07:38 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_se9xo
07:38 INFO [databricks.labs.ucx.install] Deleting jobs
07:38 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=562576206739489.
07:38 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=273125314324787.
07:38 INFO [databricks.labs.ucx.install] Deleting assessment job_id=1081780995405996.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=106273495421654.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=211422940656698.
07:38 INFO [databricks.labs.ucx.install] Deleting failing job_id=371306464674789.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=1045066516992903.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=195479479034033.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=1084653344650123.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=779758060703818.
07:38 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=603144883747037.
07:38 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=114439341189572.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=399576895064750.
07:38 INFO [databricks.labs.ucx.install] Deleting cluster policy
07:38 INFO [databricks.labs.ucx.install] Deleting secret scope
07:38 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #106

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions