CLI command to mark table/schema for skipping in the table migration process.#680

Merged

nfx merged 4 commits intomainfrom

feature/cli_table_skip_672

Dec 19, 2023

Contributor

FastLee commented Dec 6, 2023 •

edited

Loading

closes #672

FastLee had a problem deploying to account-admin

December 6, 2023 19:39

— with

GitHub Actions Failure

codecov bot commented Dec 6, 2023 •

edited

Loading

Codecov Report

Attention: 14 lines in your changes are missing coverage. Please review.

Comparison is base (e1b7a27) 78.60% compared to head (562a669) 79.09%.
Report is 2 commits behind head on main.

Files	Patch %	Lines
src/databricks/labs/ucx/hive_metastore/mapping.py	56.52%	6 Missing and 4 partials ⚠️
src/databricks/labs/ucx/cli.py	78.94%	4 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #680      +/-   ##
==========================================
+ Coverage   78.60%   79.09%   +0.49%     
==========================================
  Files          41       41              
  Lines        4272     4310      +38     
  Branches      800      806       +6     
==========================================
+ Hits         3358     3409      +51     
+ Misses        711      696      -15     
- Partials      203      205       +2

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

FastLee had a problem deploying to account-admin

December 6, 2023 21:40

— with

GitHub Actions Failure

FastLee marked this pull request as ready for review

December 6, 2023 22:12

FastLee requested review from a team and dipankarkush-db

December 6, 2023 22:12

FastLee had a problem deploying to account-admin

December 6, 2023 22:13

— with

GitHub Actions Failure

dmoore247 suggested changes

View reviewed changes

Contributor

dmoore247 left a comment

Logging and testing issues.

src/databricks/labs/ucx/cli.py Show resolved Hide resolved

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved

nfx requested changes

View reviewed changes

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved

FastLee had a problem deploying to account-admin

December 12, 2023 15:45

— with

GitHub Actions Failure

FastLee had a problem deploying to account-admin

December 12, 2023 18:57

— with

GitHub Actions Failure

FastLee force-pushed the feature/cli_table_skip_672 branch from 9cfaa6c to cafa380 Compare

December 12, 2023 19:01

FastLee had a problem deploying to account-admin

December 12, 2023 19:01

— with

GitHub Actions Failure

FastLee requested review from dmoore247 and nfx

December 13, 2023 15:54

dmoore247 suggested changes

View reviewed changes

Contributor

dmoore247 left a comment

Let's have a more scalable property naming convention using the dot notation.

src/databricks/labs/ucx/cli.py Show resolved Hide resolved

src/databricks/labs/ucx/hive_metastore/tables.py Outdated Show resolved Hide resolved

src/databricks/labs/ucx/hive_metastore/tables.py Outdated Show resolved Hide resolved

src/databricks/labs/ucx/hive_metastore/tables.py Outdated Show resolved Hide resolved

nfx requested changes

View reviewed changes

src/databricks/labs/ucx/cli.py Show resolved Hide resolved

src/databricks/labs/ucx/hive_metastore/tables.py Outdated Show resolved Hide resolved

tests/unit/hive_metastore/test_tables.py Outdated Show resolved Hide resolved

tests/unit/hive_metastore/test_tables.py Outdated Show resolved Hide resolved

tests/unit/hive_metastore/test_tables.py Outdated Show resolved Hide resolved

tests/unit/test_cli.py Show resolved Hide resolved

This was referenced Dec 14, 2023

Allow skipping DBFS Root Delta Table if size exceeds preconfigured threshold #334

Open

[EPIC] Migrate EXTERNAL tables from cloud storage accounts #333

Closed

FastLee added 2 commits

December 15, 2023 12:03


          Squashed all changes

74ad060


          Squashed all changes and rebased. Addressed review comments.

ff3102d

FastLee force-pushed the feature/cli_table_skip_672 branch from cafa380 to ff3102d Compare

December 15, 2023 18:39

FastLee had a problem deploying to account-admin

December 15, 2023 18:39

— with

GitHub Actions Failure

FastLee requested a review from nfx

December 15, 2023 18:40

nfx requested changes

View reviewed changes

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved

src/databricks/labs/ucx/hive_metastore/mapping.py Show resolved Hide resolved

nfx requested changes

View reviewed changes

src/databricks/labs/ucx/cli.py Outdated Show resolved Hide resolved


          Addressed final comments.

b0c6940

FastLee requested a review from nfx

December 19, 2023 13:45

nfx approved these changes

View reviewed changes


          Addressed final comments.

562a669

FastLee had a problem deploying to account-admin

December 19, 2023 16:02

— with

GitHub Actions Failure

FastLee requested a review from nfx

December 19, 2023 16:03

nfx merged commit 06a3539 into main

nfx deleted the feature/cli_table_skip_672 branch

December 19, 2023 16:04

nfx added a commit that referenced this pull request


          Release v0.7.0

289a4d1

* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

nfx added a commit that referenced this pull request


          Release v0.7.0

3bbc11a

* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).

nfx added a commit that referenced this pull request


          Release v0.7.0

c241578

* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).

nfx added a commit that referenced this pull request


          Release v0.7.0

ce3af3a

* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).

nfx mentioned this pull request

Release v0.7.0 #719

Closed

nfx added a commit that referenced this pull request


          Release v0.7.0

29a6410

* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for cli ([#715](#715)).
* Added `workspace_group_name` and `account_group_name` to `make_ucx_group` fixture ([#664](#664)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added filters to run only cloud specific task ([#681](#681)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Cleanup README.md ([#695](#695)).
* Cleanup installer framework and speed up test execution ([#711](#711)).
* Decouple group configuration from `install.py` ([#714](#714)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed for secret scope apply task always raises ValueError ([#683](#683)).
* Fixed some flaky integration tests ([#700](#700)).
* More `mypy` chores ([#697](#697)).
* Moved `ExternalLocations` and `Mounts` to `locations` module ([#692](#692)).
* New CLI command for workspace mapping ([#678](#678)).
* No more `mypy` chores after this ([#699](#699)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Some `mypy` chores ([#696](#696)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).

nfx mentioned this pull request

Release v0.7.0 #720

Closed

nfx added a commit that referenced this pull request


          Release v0.7.0

3839d4f

* Added `databricks labs ucx create-table-mapping` and `databricks labs ucx manual-workspace-info` commands for CLI ([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands ([#708](#708)).
* Added `databricks labs ucx installations` command ([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to mark table/schema for skipping in the table migration process ([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants ([#653](#653)).
* Added cluster override and handle case of write protected DBFS ([#610](#610)).
* Added cluster policy selector in the installer ([#655](#655)).
* Added detailed UCX pre-requisite information to README.md ([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command ([#657](#657)).
* Added more granular error retry logic ([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up assessment workflow ([#691](#691)).
* Added retry on workspace listing ([#659](#659)).
* Added support for mapping workspace group to account group by prefix/suffix/regex/external id ([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as `crawl_tables` was failing when run on non-UC Workspace in No Isolation mode with unable to access the config file ([#661](#661)).
* Changed the fields of the table "Tables" to lower case ([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations ([#677](#677)).
* Enforced `mypy` validation ([#713](#713)).
* Filtering out inventory database from loading into tables and filtering out the same from grant detail view ([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and updated `CONTRIBUTING.md` guide ([#654](#654)).
* Fixed secret scope apply task to raise ValueError ([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration testing issues ([#722](#722)).
* Fixed some flaky integration tests ([#700](#700)).
* New CLI command for workspace mapping ([#678](#678)).
* Reduce server load for getting workspace groups and their members ([#666](#666)).
* Throwing ManyError on migrate-groups tasks ([#710](#710)).
* Updated installation documentation to use Databricks CLI ([#686](#686)).

Dependency updates:

 * Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0 ([#651](#651)).
 * Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0 ([#687](#687)).
 * Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0 ([#712](#712)).

nfx mentioned this pull request

Release v0.7.0 #723

Merged

nfx added a commit that referenced this pull request


          Release v0.7.0 (#723)

5eeb0c2

* Added `databricks labs ucx create-table-mapping` and `databricks labs
ucx manual-workspace-info` commands for CLI
([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands
([#708](#708)).
* Added `databricks labs ucx installations` command
([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to
mark table/schema for skipping in the table migration process
([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for
cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants
([#653](#653)).
* Added cluster override and handle case of write protected DBFS
([#610](#610)).
* Added cluster policy selector in the installer
([#655](#655)).
* Added detailed UCX pre-requisite information to README.md
([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command
([#657](#657)).
* Added more granular error retry logic
([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up
assessment workflow
([#691](#691)).
* Added retry on workspace listing
([#659](#659)).
* Added support for mapping workspace group to account group by
prefix/suffix/regex/external id
([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as
`crawl_tables` was failing when run on non-UC Workspace in No Isolation
mode with unable to access the config file
([#661](#661)).
* Changed the fields of the table "Tables" to lower case
([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations
([#677](#677)).
* Enforced `mypy` validation
([#713](#713)).
* Filtering out inventory database from loading into tables and
filtering out the same from grant detail view
([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and
updated `CONTRIBUTING.md` guide
([#654](#654)).
* Fixed secret scope apply task to raise ValueError
([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration
testing issues ([#722](#722)).
* Fixed some flaky integration tests
([#700](#700)).
* New CLI command for workspace mapping
([#678](#678)).
* Reduce server load for getting workspace groups and their members
([#666](#666)).
* Throwing ManyError on migrate-groups tasks
([#710](#710)).
* Updated installation documentation to use Databricks CLI
([#686](#686)).

Dependency updates:

* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0
([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0
([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0
([#712](#712)).

FastLee pushed a commit that referenced this pull request


          Release v0.7.0 (#723)

35a3772

* Added `databricks labs ucx create-table-mapping` and `databricks labs
ucx manual-workspace-info` commands for CLI
([#682](#682)).
* Added `databricks labs ucx ensure-assessment-run` to CLI commands
([#708](#708)).
* Added `databricks labs ucx installations` command
([#679](#679)).
* Added `databricks labs ucx skip --schema ... --table ...` command to
mark table/schema for skipping in the table migration process
([#680](#680)).
* Added `databricks labs ucx validate-external-locations` command for
cli ([#715](#715)).
* Added capturing `ANY FILE` and `ANONYMOUS FUNCTION` grants
([#653](#653)).
* Added cluster override and handle case of write protected DBFS
([#610](#610)).
* Added cluster policy selector in the installer
([#655](#655)).
* Added detailed UCX pre-requisite information to README.md
([#689](#689)).
* Added interactive wizard for `databricks labs uninstall ucx` command
([#657](#657)).
* Added more granular error retry logic
([#704](#704)).
* Added parallel fetching of registered model identifiers to speed-up
assessment workflow
([#691](#691)).
* Added retry on workspace listing
([#659](#659)).
* Added support for mapping workspace group to account group by
prefix/suffix/regex/external id
([#650](#650)).
* Changed cluster security mode from NONE to LEGACY_SINGLE_USER, as
`crawl_tables` was failing when run on non-UC Workspace in No Isolation
mode with unable to access the config file
([#661](#661)).
* Changed the fields of the table "Tables" to lower case
([#684](#684)).
* Enabled integration tests for `EXTERNAL` table migrations
([#677](#677)).
* Enforced `mypy` validation
([#713](#713)).
* Filtering out inventory database from loading into tables and
filtering out the same from grant detail view
([#705](#705)).
* Fixed documentation for `reflect_account_groups_on_workspace` task and
updated `CONTRIBUTING.md` guide
([#654](#654)).
* Fixed secret scope apply task to raise ValueError
([#683](#683)).
* Fixed legacy table ACL ownership migration and other integration
testing issues ([#722](#722)).
* Fixed some flaky integration tests
([#700](#700)).
* New CLI command for workspace mapping
([#678](#678)).
* Reduce server load for getting workspace groups and their members
([#666](#666)).
* Throwing ManyError on migrate-groups tasks
([#710](#710)).
* Updated installation documentation to use Databricks CLI
([#686](#686)).

Dependency updates:

* Updated databricks-sdk requirement from ~=0.13.0 to ~=0.14.0
([#651](#651)).
* Updated databricks-sdk requirement from ~=0.14.0 to ~=0.15.0
([#687](#687)).
* Updated databricks-sdk requirement from ~=0.15.0 to ~=0.16.0
([#712](#712)).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet