Skip to content

Fix failing test test_job_task_linter_library_not_installed_cluster#2867

Merged
nfx merged 2 commits intomainfrom
fix-test_job_task_linter_library_not_installed_cluster
Oct 9, 2024
Merged

Fix failing test test_job_task_linter_library_not_installed_cluster#2867
nfx merged 2 commits intomainfrom
fix-test_job_task_linter_library_not_installed_cluster

Conversation

@ericvergnaud
Copy link
Copy Markdown
Contributor

Changes

Use genuinely unknown library

Linked issues

None

Functionality

None

Tests

  • [ x] updated integration tests

@ericvergnaud ericvergnaud requested a review from a team as a code owner October 8, 2024 13:48
@github-actions
Copy link
Copy Markdown

github-actions bot commented Oct 8, 2024

❌ 41/42 passed, 1 failed, 27m51s total

❌ test_job_dlt_task_linter_unhappy_path: assert 0 == 1 (12.776s)
assert 0 == 1
 +  where 0 = len([])
[gw8] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
13:55 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.iYDi/config.yml) doesn't exist.
13:55 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
13:55 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
13:55 INFO [databricks.labs.ucx.install] Fetching installations...
13:55 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
13:55 DEBUG [tests.integration.conftest] Waiting for clusters to start...
13:56 DEBUG [tests.integration.conftest] Waiting for clusters to start...
13:56 INFO [databricks.labs.ucx.source_code.jobs] Linting rWcv dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-vR5b-ra78a553cf/notebook.py>
13:55 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.iYDi/config.yml) doesn't exist.
13:55 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
13:55 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
13:55 INFO [databricks.labs.ucx.install] Fetching installations...
13:55 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
13:55 DEBUG [tests.integration.conftest] Waiting for clusters to start...
13:56 DEBUG [tests.integration.conftest] Waiting for clusters to start...
13:56 INFO [databricks.labs.ucx.source_code.jobs] Linting rWcv dependency: Dependency</Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-vR5b-ra78a553cf/notebook.py>
13:56 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+1620241008135602 from https://DATABRICKS_HOST
13:56 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_shdxz
13:56 INFO [databricks.labs.ucx.install] Deleting cluster policy
13:56 INFO [databricks.labs.ucx.install] Deleting secret scope
13:56 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw8] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from acceptance #6495

Copy link
Copy Markdown
Collaborator

@nfx nfx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@nfx nfx merged commit 0ffd50f into main Oct 9, 2024
@nfx nfx deleted the fix-test_job_task_linter_library_not_installed_cluster branch October 9, 2024 08:18
@nfx nfx added the internal this pull request won't appear in release notes label Oct 9, 2024
nfx pushed a commit that referenced this pull request Oct 9, 2024
…2853)

## Changes

This PR updates some linting related integration tests that weren't
testing what they expected:

- The tests were intending to verify linting of notebooks, and set up a
notebook with code to trigger a linting record.
- The linting code was failing prematurely due to the notebook
extension, not due to the problem in source.

Some usage of `greenlet` has also been replaced: it was previously
unknown to the linter and various integration tests assumed this. Since
#2830 these tests have no longer been working correctly.

### Related Issues

Overlaps with #2852.
Overlaps with #2867.
Overlaps with #2868.
Resolves #2843.
Resolves #2844.
Resolves #2845.
Resolves #2846.

### Tests

- [X] updated integration tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

internal this pull request won't appear in release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants