Skip to content

Fix integration tests flakiness#1441

Merged
nfx merged 6 commits intomainfrom
fix/integration-tests
Apr 18, 2024
Merged

Fix integration tests flakiness#1441
nfx merged 6 commits intomainfrom
fix/integration-tests

Conversation

@nkvuong
Copy link
Copy Markdown
Contributor

@nkvuong nkvuong commented Apr 18, 2024

Changes

  • Fix TypeError: 'tuple' object is not callable for test_migrate_external_table
  • Fix tests that migrate external tables failed due to UC blocking tables with overlapping paths
  • Fix assessment tests that failed due to expected error messages in parse_logs, by skipping over these error messages if ucx version is testing

Linked issues

Resolves #1436, #1424

Tests

  • manually tested
  • verified on staging environment (screenshot attached)

@nkvuong nkvuong requested review from a team and dumitrac April 18, 2024 09:28
src_schema = runtime_ctx.make_schema(catalog_name="hive_metastore")
# make a copy of src data to a new location to avoid overlapping UC table path that will fail other
# external table migration tests
existing_mounted_location, new_mounted_location = make_mounted_location()
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nkvuong : Maybe this fixture should be renamed as nothing is "maken", it returns a tuple with the mounted locations

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just refactored it :)

@nkvuong nkvuong changed the title fix test_migrate_external_table Fix integration tests flakiness Apr 18, 2024
@nkvuong nkvuong requested a review from nfx April 18, 2024 16:42
Copy link
Copy Markdown
Contributor

@JCZuurmond JCZuurmond left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, request to clarify with comment only

Copy link
Copy Markdown
Collaborator

@nfx nfx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Test failure: test_migrate_external_table Test failure: test_experimental_permissions_migration_for_group_with_same_name

3 participants