Merged
Conversation
|
This PR breaks backwards compatibility for databrickslabs/ucx downstream. See build logs for more details. Running from downstreams #204 |
* Create a method to generate OAuth tokens ([#644](#644)) NOTE: this change renames `@credentials_provider`/`CredentialsProvider` to `@credentials_strategy`/`CredentialsStrategy`. Users using custom credentials need to update the code to use the new name. * Patch `dbutils.notebook.entry_point...` to return current local notebook path from env var ([#618](#618)). * Add `serverless_compute_id` field to the config ([#685](#685)). * Added `with_product(...)` and `with_user_agent_extra(...)` public functions to improve telemetry for mid-stream libraries ([#679](#679)). * Fixed Interactive OAuth on Azure & updated documentations ([#669](#669)). * Fix documentation examples ([#676](#676)). * Ignore DataPlane Services during generation ([#663](#663)). * Update OpenAPI spec ([#667](#667)). * Retry failed integration tests ([#674](#674)). * Changed `list()` method for [a.account_storage_credentials](https://databricks-sdk-py.readthedocs.io/en/latest/account/account_storage_credentials.html) account-level service to return `databricks.sdk.service.catalog.ListAccountStorageCredentialsResponse` dataclass. * Changed `isolation_mode` field for `databricks.sdk.service.catalog.CatalogInfo` to `databricks.sdk.service.catalog.CatalogIsolationMode` dataclass. * Added `isolation_mode` field for `databricks.sdk.service.catalog.ExternalLocationInfo`. * Added `max_results` and `page_token` fields for `databricks.sdk.service.catalog.ListCatalogsRequest`. * Added `next_page_token` field for `databricks.sdk.service.catalog.ListCatalogsResponse`. * Added `table_serving_url` field for `databricks.sdk.service.catalog.OnlineTable`. * Added `isolation_mode` field for `databricks.sdk.service.catalog.StorageCredentialInfo`. * Changed `isolation_mode` field for `databricks.sdk.service.catalog.UpdateCatalog` to `databricks.sdk.service.catalog.CatalogIsolationMode` dataclass. * Added `isolation_mode` field for `databricks.sdk.service.catalog.UpdateExternalLocation`. * Added `isolation_mode` field for `databricks.sdk.service.catalog.UpdateStorageCredential`. * Added `databricks.sdk.service.catalog.CatalogIsolationMode` and `databricks.sdk.service.catalog.ListAccountStorageCredentialsResponse` dataclasses. * Added `create_schedule()`, `create_subscription()`, `delete_schedule()`, `delete_subscription()`, `get_schedule()`, `get_subscription()`, `list()`, `list_schedules()`, `list_subscriptions()` and `update_schedule()` methods for [w.lakeview](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakeview.html) workspace-level service. * Added `databricks.sdk.service.dashboards.CreateScheduleRequest`, `databricks.sdk.service.dashboards.CreateSubscriptionRequest`, `databricks.sdk.service.dashboards.CronSchedule`, `databricks.sdk.service.dashboards.DashboardView`, `databricks.sdk.service.dashboards.DeleteScheduleRequest`, `databricks.sdk.service.dashboards.DeleteSubscriptionRequest` dataclass, `databricks.sdk.service.dashboards.GetScheduleRequest`, `databricks.sdk.service.dashboards.GetSubscriptionRequest`, `databricks.sdk.service.dashboards.ListDashboardsRequest`, `databricks.sdk.service.dashboards.ListDashboardsResponse`, `databricks.sdk.service.dashboards.ListSchedulesRequest`, `databricks.sdk.service.dashboards.ListSchedulesResponse`, `databricks.sdk.service.dashboards.ListSubscriptionsRequest`, `databricks.sdk.service.dashboards.ListSubscriptionsResponse`, `databricks.sdk.service.dashboards.Schedule`, `databricks.sdk.service.dashboards.SchedulePauseStatus`, `databricks.sdk.service.dashboards.Subscriber`, `databricks.sdk.service.dashboards.Subscription`, `databricks.sdk.service.dashboards.SubscriptionSubscriberDestination`, `databricks.sdk.service.dashboards.SubscriptionSubscriberUser` and `databricks.sdk.service.dashboards.UpdateScheduleRequest` dataclasses. * Added `termination_category` field for `databricks.sdk.service.jobs.ForEachTaskErrorMessageStats`. * Added `on_streaming_backlog_exceeded` field for `databricks.sdk.service.jobs.JobEmailNotifications`. * Added `environment_key` field for `databricks.sdk.service.jobs.RunTask`. * Removed `condition_task`, `dbt_task`, `notebook_task`, `pipeline_task`, `python_wheel_task`, `run_job_task`, `spark_jar_task`, `spark_python_task`, `spark_submit_task` and `sql_task` fields for `databricks.sdk.service.jobs.SubmitRun`. * Added `environments` field for `databricks.sdk.service.jobs.SubmitRun`. * Added `dbt_task` field for `databricks.sdk.service.jobs.SubmitTask`. * Added `environment_key` field for `databricks.sdk.service.jobs.SubmitTask`. * Added `on_streaming_backlog_exceeded` field for `databricks.sdk.service.jobs.TaskEmailNotifications`. * Added `periodic` field for `databricks.sdk.service.jobs.TriggerSettings`. * Added `on_streaming_backlog_exceeded` field for `databricks.sdk.service.jobs.WebhookNotifications`. * Added `databricks.sdk.service.jobs.PeriodicTriggerConfiguration` dataclass. * Added `databricks.sdk.service.jobs.PeriodicTriggerConfigurationTimeUnit` dataclass. * Added `batch_get()` method for [w.consumer_listings](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/consumer_listings.html) workspace-level service. * Added `batch_get()` method for [w.consumer_providers](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/consumer_providers.html) workspace-level service. * Added `provider_summary` field for `databricks.sdk.service.marketplace.Listing`. * Added `databricks.sdk.service.marketplace.BatchGetListingsRequest`, `databricks.sdk.service.marketplace.BatchGetListingsResponse`, `databricks.sdk.service.marketplace.BatchGetProvidersRequest`, `databricks.sdk.service.marketplace.BatchGetProvidersResponse`, `databricks.sdk.service.marketplace.ProviderIconFile`, `databricks.sdk.service.marketplace.ProviderIconType`, `databricks.sdk.service.marketplace.ProviderListingSummaryInfo` and `databricks.sdk.service.oauth2.DataPlaneInfo` dataclasses. * Removed `create_deployment()` method for [w.apps](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/apps.html) workspace-level service. * Added `deploy()` and `start()` method1 for [w.apps](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/apps.html) workspace-level service. * Added [w.serving_endpoints_data_plane](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/serving_endpoints_data_plane.html) workspace-level service. * Added `service_principal_id` and `service_principal_name` fields for `databricks.sdk.service.serving.App`. * Added `mode` field for `databricks.sdk.service.serving.AppDeployment`. * Added `mode` field for `databricks.sdk.service.serving.CreateAppDeploymentRequest`. * Added `data_plane_info` field for `databricks.sdk.service.serving.ServingEndpointDetailed`. * Added `databricks.sdk.service.serving.AppDeploymentMode`, `databricks.sdk.service.serving.ModelDataPlaneInfo` and `databricks.sdk.service.serving.StartAppRequest` dataclasses. * Added `query_next_page()` method for [w.vector_search_indexes](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/vector_search_indexes.html) workspace-level service. * Added `query_type` field for `databricks.sdk.service.vectorsearch.QueryVectorIndexRequest`. * Added `next_page_token` field for `databricks.sdk.service.vectorsearch.QueryVectorIndexResponse`. OpenAPI SHA: 7437dabb9dadee402c1fc060df4c1ce8cc5369f0, Date: 2024-06-24
de6292b to
e27f271
Compare
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #688 +/- ##
=======================================
Coverage ? 57.66%
=======================================
Files ? 48
Lines ? 33541
Branches ? 0
=======================================
Hits ? 19341
Misses ? 14200
Partials ? 0 ☔ View full report in Codecov by Sentry. |
edwardfeng-db
approved these changes
Jun 24, 2024
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Breaking Changes
NOTE: this change renames
@credentials_provider/CredentialsProviderto@credentials_strategy/CredentialsStrategy.Improvements and Bug Fixes
dbutils.notebook.entry_point...to return current local notebook path from env var (#618).serverless_compute_idfield to the config (#685).with_product(...)andwith_user_agent_extra(...)public functions to improve telemetry for mid-stream libraries (#679).Documentation
Internal Changes
API Changes
list()method for a.account_storage_credentials account-level service to returndatabricks.sdk.service.catalog.ListAccountStorageCredentialsResponsedataclass.isolation_modefield fordatabricks.sdk.service.catalog.CatalogInfotodatabricks.sdk.service.catalog.CatalogIsolationModedataclass.isolation_modefield fordatabricks.sdk.service.catalog.ExternalLocationInfo.max_resultsandpage_tokenfields fordatabricks.sdk.service.catalog.ListCatalogsRequest.next_page_tokenfield fordatabricks.sdk.service.catalog.ListCatalogsResponse.table_serving_urlfield fordatabricks.sdk.service.catalog.OnlineTable.isolation_modefield fordatabricks.sdk.service.catalog.StorageCredentialInfo.isolation_modefield fordatabricks.sdk.service.catalog.UpdateCatalogtodatabricks.sdk.service.catalog.CatalogIsolationModedataclass.isolation_modefield fordatabricks.sdk.service.catalog.UpdateExternalLocation.isolation_modefield fordatabricks.sdk.service.catalog.UpdateStorageCredential.databricks.sdk.service.catalog.CatalogIsolationModeanddatabricks.sdk.service.catalog.ListAccountStorageCredentialsResponsedataclasses.create_schedule(),create_subscription(),delete_schedule(),delete_subscription(),get_schedule(),get_subscription(),list(),list_schedules(),list_subscriptions()andupdate_schedule()methods for w.lakeview workspace-level service.databricks.sdk.service.dashboards.CreateScheduleRequest,databricks.sdk.service.dashboards.CreateSubscriptionRequest,databricks.sdk.service.dashboards.CronSchedule,databricks.sdk.service.dashboards.DashboardView,databricks.sdk.service.dashboards.DeleteScheduleRequest,databricks.sdk.service.dashboards.DeleteSubscriptionRequestdataclass,databricks.sdk.service.dashboards.GetScheduleRequest,databricks.sdk.service.dashboards.GetSubscriptionRequest,databricks.sdk.service.dashboards.ListDashboardsRequest,databricks.sdk.service.dashboards.ListDashboardsResponse,databricks.sdk.service.dashboards.ListSchedulesRequest,databricks.sdk.service.dashboards.ListSchedulesResponse,databricks.sdk.service.dashboards.ListSubscriptionsRequest,databricks.sdk.service.dashboards.ListSubscriptionsResponse,databricks.sdk.service.dashboards.Schedule,databricks.sdk.service.dashboards.SchedulePauseStatus,databricks.sdk.service.dashboards.Subscriber,databricks.sdk.service.dashboards.Subscription,databricks.sdk.service.dashboards.SubscriptionSubscriberDestination,databricks.sdk.service.dashboards.SubscriptionSubscriberUseranddatabricks.sdk.service.dashboards.UpdateScheduleRequestdataclasses.termination_categoryfield fordatabricks.sdk.service.jobs.ForEachTaskErrorMessageStats.on_streaming_backlog_exceededfield fordatabricks.sdk.service.jobs.JobEmailNotifications.environment_keyfield fordatabricks.sdk.service.jobs.RunTask.condition_task,dbt_task,notebook_task,pipeline_task,python_wheel_task,run_job_task,spark_jar_task,spark_python_task,spark_submit_taskandsql_taskfields fordatabricks.sdk.service.jobs.SubmitRun.environmentsfield fordatabricks.sdk.service.jobs.SubmitRun.dbt_taskfield fordatabricks.sdk.service.jobs.SubmitTask.environment_keyfield fordatabricks.sdk.service.jobs.SubmitTask.on_streaming_backlog_exceededfield fordatabricks.sdk.service.jobs.TaskEmailNotifications.periodicfield fordatabricks.sdk.service.jobs.TriggerSettings.on_streaming_backlog_exceededfield fordatabricks.sdk.service.jobs.WebhookNotifications.databricks.sdk.service.jobs.PeriodicTriggerConfigurationdataclass.databricks.sdk.service.jobs.PeriodicTriggerConfigurationTimeUnitdataclass.batch_get()method for w.consumer_listings workspace-level service.batch_get()method for w.consumer_providers workspace-level service.provider_summaryfield fordatabricks.sdk.service.marketplace.Listing.databricks.sdk.service.marketplace.BatchGetListingsRequest,databricks.sdk.service.marketplace.BatchGetListingsResponse,databricks.sdk.service.marketplace.BatchGetProvidersRequest,databricks.sdk.service.marketplace.BatchGetProvidersResponse,databricks.sdk.service.marketplace.ProviderIconFile,databricks.sdk.service.marketplace.ProviderIconType,databricks.sdk.service.marketplace.ProviderListingSummaryInfoanddatabricks.sdk.service.oauth2.DataPlaneInfodataclasses.create_deployment()method for w.apps workspace-level service.deploy()andstart()method1 for w.apps workspace-level service.service_principal_idandservice_principal_namefields fordatabricks.sdk.service.serving.App.modefield fordatabricks.sdk.service.serving.AppDeployment.modefield fordatabricks.sdk.service.serving.CreateAppDeploymentRequest.data_plane_infofield fordatabricks.sdk.service.serving.ServingEndpointDetailed.databricks.sdk.service.serving.AppDeploymentMode,databricks.sdk.service.serving.ModelDataPlaneInfoanddatabricks.sdk.service.serving.StartAppRequestdataclasses.query_next_page()method for w.vector_search_indexes workspace-level service.query_typefield fordatabricks.sdk.service.vectorsearch.QueryVectorIndexRequest.next_page_tokenfield fordatabricks.sdk.service.vectorsearch.QueryVectorIndexResponse.OpenAPI SHA: 7437dabb9dadee402c1fc060df4c1ce8cc5369f0, Date: 2024-06-24