Merged
Conversation
### Behavior Changes * Override INVALID_PARAMETER_VALUE on fetching non-existent job/cluster ([#591](#591)). When getting a job or cluster by ID that doesn't exist, the API currently returns a 400, corresponding to the InvalidParameterValue exception. This change throws a ResourceNotFoundException instead in this circumstance. To handle this change, modify error handling by updating your `except` blocks from: ```py try: w.jobs.get_by_id("123") except e as InvalidParameterValue: ... ``` to ```py try: w.jobs.get_by_id("123") except e as ResourceDoesNotExist: ... ``` ### Internal Changes * Check downstream backwards compatibility ([#600](#600)). * Add support for upcoming Marketplace package ([#608](#608)). API Changes: * Changed `cancel_refresh()` method for [w.lakehouse_monitors](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakehouse_monitors.html) workspace-level service with new required argument order. * Changed `create()` method for [w.lakehouse_monitors](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakehouse_monitors.html) workspace-level service with new required argument order. * Changed `delete()` method for [w.lakehouse_monitors](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakehouse_monitors.html) workspace-level service with new required argument order. * Changed `get()` method for [w.lakehouse_monitors](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakehouse_monitors.html) workspace-level service with new required argument order. * Changed `get_refresh()` method for [w.lakehouse_monitors](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakehouse_monitors.html) workspace-level service with new required argument order. * Changed `list_refreshes()` method for [w.lakehouse_monitors](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakehouse_monitors.html) workspace-level service with new required argument order. * Changed `run_refresh()` method for [w.lakehouse_monitors](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakehouse_monitors.html) workspace-level service with new required argument order. * Changed `update()` method for [w.lakehouse_monitors](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/lakehouse_monitors.html) workspace-level service with new required argument order. * Removed `databricks.sdk.service.catalog.AzureManagedIdentity` dataclass. * Removed `full_name` field for `databricks.sdk.service.catalog.CancelRefreshRequest`. * Added `table_name` field for `databricks.sdk.service.catalog.CancelRefreshRequest`. * Changed `custom_metrics` field for `databricks.sdk.service.catalog.CreateMonitor` to `databricks.sdk.service.catalog.MonitorMetricList` dataclass. * Removed `full_name` field for `databricks.sdk.service.catalog.CreateMonitor`. * Changed `inference_log` field for `databricks.sdk.service.catalog.CreateMonitor` to `databricks.sdk.service.catalog.MonitorInferenceLog` dataclass. * Changed `notifications` field for `databricks.sdk.service.catalog.CreateMonitor` to `databricks.sdk.service.catalog.MonitorNotifications` dataclass. * Changed `snapshot` field for `databricks.sdk.service.catalog.CreateMonitor` to `any` dataclass. * Changed `time_series` field for `databricks.sdk.service.catalog.CreateMonitor` to `databricks.sdk.service.catalog.MonitorTimeSeries` dataclass. * Added `table_name` field for `databricks.sdk.service.catalog.CreateMonitor`. * Changed `azure_managed_identity` field for `databricks.sdk.service.catalog.CreateStorageCredential` to `databricks.sdk.service.catalog.AzureManagedIdentityRequest` dataclass. * Removed `full_name` field for `databricks.sdk.service.catalog.DeleteLakehouseMonitorRequest`. * Added `table_name` field for `databricks.sdk.service.catalog.DeleteLakehouseMonitorRequest`. * Removed `full_name` field for `databricks.sdk.service.catalog.GetLakehouseMonitorRequest`. * Added `table_name` field for `databricks.sdk.service.catalog.GetLakehouseMonitorRequest`. * Removed `full_name` field for `databricks.sdk.service.catalog.GetRefreshRequest`. * Added `table_name` field for `databricks.sdk.service.catalog.GetRefreshRequest`. * Removed `full_name` field for `databricks.sdk.service.catalog.ListRefreshesRequest`. * Added `table_name` field for `databricks.sdk.service.catalog.ListRefreshesRequest`. * Changed `quartz_cron_expression` field for `databricks.sdk.service.catalog.MonitorCronSchedule` to be required. * Changed `timezone_id` field for `databricks.sdk.service.catalog.MonitorCronSchedule` to be required. * Removed `databricks.sdk.service.catalog.MonitorCustomMetric` dataclass. * Removed `databricks.sdk.service.catalog.MonitorCustomMetricType` dataclass. * Removed `databricks.sdk.service.catalog.MonitorDestinations` dataclass. * Removed `databricks.sdk.service.catalog.MonitorInferenceLogProfileType` dataclass. * Removed `databricks.sdk.service.catalog.MonitorInferenceLogProfileTypeProblemType` dataclass. * Changed `custom_metrics` field for `databricks.sdk.service.catalog.MonitorInfo` to `databricks.sdk.service.catalog.MonitorMetricList` dataclass. * Changed `drift_metrics_table_name` field for `databricks.sdk.service.catalog.MonitorInfo` to be required. * Changed `inference_log` field for `databricks.sdk.service.catalog.MonitorInfo` to `databricks.sdk.service.catalog.MonitorInferenceLog` dataclass. * Changed `monitor_version` field for `databricks.sdk.service.catalog.MonitorInfo` to be required. * Changed `notifications` field for `databricks.sdk.service.catalog.MonitorInfo` to `databricks.sdk.service.catalog.MonitorNotifications` dataclass. * Changed `profile_metrics_table_name` field for `databricks.sdk.service.catalog.MonitorInfo` to be required. * Changed `snapshot` field for `databricks.sdk.service.catalog.MonitorInfo` to `any` dataclass. * Changed `status` field for `databricks.sdk.service.catalog.MonitorInfo` to be required. * Changed `table_name` field for `databricks.sdk.service.catalog.MonitorInfo` to be required. * Changed `time_series` field for `databricks.sdk.service.catalog.MonitorInfo` to `databricks.sdk.service.catalog.MonitorTimeSeries` dataclass. * Removed `databricks.sdk.service.catalog.MonitorNotificationsConfig` dataclass. * Changed `refresh_id` field for `databricks.sdk.service.catalog.MonitorRefreshInfo` to be required. * Changed `start_time_ms` field for `databricks.sdk.service.catalog.MonitorRefreshInfo` to be required. * Changed `state` field for `databricks.sdk.service.catalog.MonitorRefreshInfo` to be required. * Added `trigger` field for `databricks.sdk.service.catalog.MonitorRefreshInfo`. * Removed `any` dataclass. * Removed `databricks.sdk.service.catalog.MonitorTimeSeriesProfileType` dataclass. * Removed `full_name` field for `databricks.sdk.service.catalog.RunRefreshRequest`. * Added `table_name` field for `databricks.sdk.service.catalog.RunRefreshRequest`. * Changed `azure_managed_identity` field for `databricks.sdk.service.catalog.StorageCredentialInfo` to `databricks.sdk.service.catalog.AzureManagedIdentityResponse` dataclass. * Removed `name` field for `databricks.sdk.service.catalog.TableRowFilter`. * Added `function_name` field for `databricks.sdk.service.catalog.TableRowFilter`. * Changed `custom_metrics` field for `databricks.sdk.service.catalog.UpdateMonitor` to `databricks.sdk.service.catalog.MonitorMetricList` dataclass. * Removed `full_name` field for `databricks.sdk.service.catalog.UpdateMonitor`. * Changed `inference_log` field for `databricks.sdk.service.catalog.UpdateMonitor` to `databricks.sdk.service.catalog.MonitorInferenceLog` dataclass. * Changed `notifications` field for `databricks.sdk.service.catalog.UpdateMonitor` to `databricks.sdk.service.catalog.MonitorNotifications` dataclass. * Changed `snapshot` field for `databricks.sdk.service.catalog.UpdateMonitor` to `any` dataclass. * Changed `time_series` field for `databricks.sdk.service.catalog.UpdateMonitor` to `databricks.sdk.service.catalog.MonitorTimeSeries` dataclass. * Added `table_name` field for `databricks.sdk.service.catalog.UpdateMonitor`. * Changed `azure_managed_identity` field for `databricks.sdk.service.catalog.UpdateStorageCredential` to `databricks.sdk.service.catalog.AzureManagedIdentityResponse` dataclass. * Changed `azure_managed_identity` field for `databricks.sdk.service.catalog.ValidateStorageCredential` to `databricks.sdk.service.catalog.AzureManagedIdentityRequest` dataclass. * Removed `operation` field for `databricks.sdk.service.catalog.ValidationResult`. * Added `aws_operation` field for `databricks.sdk.service.catalog.ValidationResult`. * Added `azure_operation` field for `databricks.sdk.service.catalog.ValidationResult`. * Added `gcp_operation` field for `databricks.sdk.service.catalog.ValidationResult`. * Removed `databricks.sdk.service.catalog.ValidationResultOperation` dataclass. * Added `databricks.sdk.service.catalog.AzureManagedIdentityRequest` dataclass. * Added `databricks.sdk.service.catalog.AzureManagedIdentityResponse` dataclass. * Added `databricks.sdk.service.catalog.MonitorDestination` dataclass. * Added `databricks.sdk.service.catalog.MonitorInferenceLog` dataclass. * Added `databricks.sdk.service.catalog.MonitorInferenceLogProblemType` dataclass. * Added `databricks.sdk.service.catalog.MonitorMetric` dataclass. * Added `databricks.sdk.service.catalog.MonitorMetricType` dataclass. * Added `databricks.sdk.service.catalog.MonitorNotifications` dataclass. * Added `databricks.sdk.service.catalog.MonitorRefreshInfoTrigger` dataclass. * Added `any` dataclass. * Added `databricks.sdk.service.catalog.MonitorTimeSeries` dataclass. * Added `databricks.sdk.service.catalog.ValidationResultAwsOperation` dataclass. * Added `databricks.sdk.service.catalog.ValidationResultAzureOperation` dataclass. * Added `databricks.sdk.service.catalog.ValidationResultGcpOperation` dataclass. * Added `clone_from` field for `databricks.sdk.service.compute.ClusterSpec`. * Removed `databricks.sdk.service.compute.ComputeSpec` dataclass. * Removed `databricks.sdk.service.compute.ComputeSpecKind` dataclass. * Added `clone_from` field for `databricks.sdk.service.compute.CreateCluster`. * Added `clone_from` field for `databricks.sdk.service.compute.EditCluster`. * Added `databricks.sdk.service.compute.CloneCluster` dataclass. * Added `databricks.sdk.service.compute.Environment` dataclass. * Changed `update()` method for [a.workspace_assignment](https://databricks-sdk-py.readthedocs.io/en/latest/account/workspace_assignment.html) account-level service to return `databricks.sdk.service.iam.PermissionAssignment` dataclass. * Removed `any` dataclass. * Removed `compute_key` field for `databricks.sdk.service.jobs.ClusterSpec`. * Removed `compute` field for `databricks.sdk.service.jobs.CreateJob`. * Added `environments` field for `databricks.sdk.service.jobs.CreateJob`. * Removed `databricks.sdk.service.jobs.JobCompute` dataclass. * Removed `compute` field for `databricks.sdk.service.jobs.JobSettings`. * Added `environments` field for `databricks.sdk.service.jobs.JobSettings`. * Removed `compute_key` field for `databricks.sdk.service.jobs.RunTask`. * Removed `databricks.sdk.service.jobs.TableTriggerConfiguration` dataclass. * Removed `compute_key` field for `databricks.sdk.service.jobs.Task`. * Added `environment_key` field for `databricks.sdk.service.jobs.Task`. * Changed `table` field for `databricks.sdk.service.jobs.TriggerSettings` to `databricks.sdk.service.jobs.TableUpdateTriggerConfiguration` dataclass. * Changed `table_update` field for `databricks.sdk.service.jobs.TriggerSettings` to `databricks.sdk.service.jobs.TableUpdateTriggerConfiguration` dataclass. * Added `databricks.sdk.service.jobs.JobEnvironment` dataclass. * Added `databricks.sdk.service.jobs.TableUpdateTriggerConfiguration` dataclass. * Added `databricks.sdk.service.marketplace` package. OpenAPI SHA: 94684175b8bd65f8701f89729351f8069e8309c9, Date: 2024-04-11
|
This PR breaks backwards compatibility for databrickslabs/ucx downstream. See build logs for more details. Running from downstreams #10 |
tanmay-db
approved these changes
Apr 11, 2024
Contributor
Author
|
Two failing tests are with cluster creation on GCP (took longer than the 10 minute timeout but both succeeded) and jobs listing (which requires at least one pre-existing job in each workspace, but these are new workspaces). Merging. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Behavior Changes
InvalidParameterValueexception. This change throws aResourceNotFoundExceptioninstead in this circumstance. To handle this change, modify error handling by updating yourexceptblocks from:to
Internal Changes
API Changes:
cancel_refresh()method for w.lakehouse_monitors workspace-level service with new required argument order.create()method for w.lakehouse_monitors workspace-level service with new required argument order.delete()method for w.lakehouse_monitors workspace-level service with new required argument order.get()method for w.lakehouse_monitors workspace-level service with new required argument order.get_refresh()method for w.lakehouse_monitors workspace-level service with new required argument order.list_refreshes()method for w.lakehouse_monitors workspace-level service with new required argument order.run_refresh()method for w.lakehouse_monitors workspace-level service with new required argument order.update()method for w.lakehouse_monitors workspace-level service with new required argument order.databricks.sdk.service.catalog.AzureManagedIdentitydataclass.full_namefield fordatabricks.sdk.service.catalog.CancelRefreshRequest.table_namefield fordatabricks.sdk.service.catalog.CancelRefreshRequest.custom_metricsfield fordatabricks.sdk.service.catalog.CreateMonitortodatabricks.sdk.service.catalog.MonitorMetricListdataclass.full_namefield fordatabricks.sdk.service.catalog.CreateMonitor.inference_logfield fordatabricks.sdk.service.catalog.CreateMonitortodatabricks.sdk.service.catalog.MonitorInferenceLogdataclass.notificationsfield fordatabricks.sdk.service.catalog.CreateMonitortodatabricks.sdk.service.catalog.MonitorNotificationsdataclass.snapshotfield fordatabricks.sdk.service.catalog.CreateMonitortoanydataclass.time_seriesfield fordatabricks.sdk.service.catalog.CreateMonitortodatabricks.sdk.service.catalog.MonitorTimeSeriesdataclass.table_namefield fordatabricks.sdk.service.catalog.CreateMonitor.azure_managed_identityfield fordatabricks.sdk.service.catalog.CreateStorageCredentialtodatabricks.sdk.service.catalog.AzureManagedIdentityRequestdataclass.full_namefield fordatabricks.sdk.service.catalog.DeleteLakehouseMonitorRequest.table_namefield fordatabricks.sdk.service.catalog.DeleteLakehouseMonitorRequest.full_namefield fordatabricks.sdk.service.catalog.GetLakehouseMonitorRequest.table_namefield fordatabricks.sdk.service.catalog.GetLakehouseMonitorRequest.full_namefield fordatabricks.sdk.service.catalog.GetRefreshRequest.table_namefield fordatabricks.sdk.service.catalog.GetRefreshRequest.full_namefield fordatabricks.sdk.service.catalog.ListRefreshesRequest.table_namefield fordatabricks.sdk.service.catalog.ListRefreshesRequest.quartz_cron_expressionfield fordatabricks.sdk.service.catalog.MonitorCronScheduleto be required.timezone_idfield fordatabricks.sdk.service.catalog.MonitorCronScheduleto be required.databricks.sdk.service.catalog.MonitorCustomMetricdataclass.databricks.sdk.service.catalog.MonitorCustomMetricTypedataclass.databricks.sdk.service.catalog.MonitorDestinationsdataclass.databricks.sdk.service.catalog.MonitorInferenceLogProfileTypedataclass.databricks.sdk.service.catalog.MonitorInferenceLogProfileTypeProblemTypedataclass.custom_metricsfield fordatabricks.sdk.service.catalog.MonitorInfotodatabricks.sdk.service.catalog.MonitorMetricListdataclass.drift_metrics_table_namefield fordatabricks.sdk.service.catalog.MonitorInfoto be required.inference_logfield fordatabricks.sdk.service.catalog.MonitorInfotodatabricks.sdk.service.catalog.MonitorInferenceLogdataclass.monitor_versionfield fordatabricks.sdk.service.catalog.MonitorInfoto be required.notificationsfield fordatabricks.sdk.service.catalog.MonitorInfotodatabricks.sdk.service.catalog.MonitorNotificationsdataclass.profile_metrics_table_namefield fordatabricks.sdk.service.catalog.MonitorInfoto be required.snapshotfield fordatabricks.sdk.service.catalog.MonitorInfotoanydataclass.statusfield fordatabricks.sdk.service.catalog.MonitorInfoto be required.table_namefield fordatabricks.sdk.service.catalog.MonitorInfoto be required.time_seriesfield fordatabricks.sdk.service.catalog.MonitorInfotodatabricks.sdk.service.catalog.MonitorTimeSeriesdataclass.databricks.sdk.service.catalog.MonitorNotificationsConfigdataclass.refresh_idfield fordatabricks.sdk.service.catalog.MonitorRefreshInfoto be required.start_time_msfield fordatabricks.sdk.service.catalog.MonitorRefreshInfoto be required.statefield fordatabricks.sdk.service.catalog.MonitorRefreshInfoto be required.triggerfield fordatabricks.sdk.service.catalog.MonitorRefreshInfo.anydataclass.databricks.sdk.service.catalog.MonitorTimeSeriesProfileTypedataclass.full_namefield fordatabricks.sdk.service.catalog.RunRefreshRequest.table_namefield fordatabricks.sdk.service.catalog.RunRefreshRequest.azure_managed_identityfield fordatabricks.sdk.service.catalog.StorageCredentialInfotodatabricks.sdk.service.catalog.AzureManagedIdentityResponsedataclass.namefield fordatabricks.sdk.service.catalog.TableRowFilter.function_namefield fordatabricks.sdk.service.catalog.TableRowFilter.custom_metricsfield fordatabricks.sdk.service.catalog.UpdateMonitortodatabricks.sdk.service.catalog.MonitorMetricListdataclass.full_namefield fordatabricks.sdk.service.catalog.UpdateMonitor.inference_logfield fordatabricks.sdk.service.catalog.UpdateMonitortodatabricks.sdk.service.catalog.MonitorInferenceLogdataclass.notificationsfield fordatabricks.sdk.service.catalog.UpdateMonitortodatabricks.sdk.service.catalog.MonitorNotificationsdataclass.snapshotfield fordatabricks.sdk.service.catalog.UpdateMonitortoanydataclass.time_seriesfield fordatabricks.sdk.service.catalog.UpdateMonitortodatabricks.sdk.service.catalog.MonitorTimeSeriesdataclass.table_namefield fordatabricks.sdk.service.catalog.UpdateMonitor.azure_managed_identityfield fordatabricks.sdk.service.catalog.UpdateStorageCredentialtodatabricks.sdk.service.catalog.AzureManagedIdentityResponsedataclass.azure_managed_identityfield fordatabricks.sdk.service.catalog.ValidateStorageCredentialtodatabricks.sdk.service.catalog.AzureManagedIdentityRequestdataclass.operationfield fordatabricks.sdk.service.catalog.ValidationResult.aws_operationfield fordatabricks.sdk.service.catalog.ValidationResult.azure_operationfield fordatabricks.sdk.service.catalog.ValidationResult.gcp_operationfield fordatabricks.sdk.service.catalog.ValidationResult.databricks.sdk.service.catalog.ValidationResultOperationdataclass.databricks.sdk.service.catalog.AzureManagedIdentityRequestdataclass.databricks.sdk.service.catalog.AzureManagedIdentityResponsedataclass.databricks.sdk.service.catalog.MonitorDestinationdataclass.databricks.sdk.service.catalog.MonitorInferenceLogdataclass.databricks.sdk.service.catalog.MonitorInferenceLogProblemTypedataclass.databricks.sdk.service.catalog.MonitorMetricdataclass.databricks.sdk.service.catalog.MonitorMetricTypedataclass.databricks.sdk.service.catalog.MonitorNotificationsdataclass.databricks.sdk.service.catalog.MonitorRefreshInfoTriggerdataclass.anydataclass.databricks.sdk.service.catalog.MonitorTimeSeriesdataclass.databricks.sdk.service.catalog.ValidationResultAwsOperationdataclass.databricks.sdk.service.catalog.ValidationResultAzureOperationdataclass.databricks.sdk.service.catalog.ValidationResultGcpOperationdataclass.clone_fromfield fordatabricks.sdk.service.compute.ClusterSpec.databricks.sdk.service.compute.ComputeSpecdataclass.databricks.sdk.service.compute.ComputeSpecKinddataclass.clone_fromfield fordatabricks.sdk.service.compute.CreateCluster.clone_fromfield fordatabricks.sdk.service.compute.EditCluster.databricks.sdk.service.compute.CloneClusterdataclass.databricks.sdk.service.compute.Environmentdataclass.update()method for a.workspace_assignment account-level service to returndatabricks.sdk.service.iam.PermissionAssignmentdataclass.anydataclass.compute_keyfield fordatabricks.sdk.service.jobs.ClusterSpec.computefield fordatabricks.sdk.service.jobs.CreateJob.environmentsfield fordatabricks.sdk.service.jobs.CreateJob.databricks.sdk.service.jobs.JobComputedataclass.computefield fordatabricks.sdk.service.jobs.JobSettings.environmentsfield fordatabricks.sdk.service.jobs.JobSettings.compute_keyfield fordatabricks.sdk.service.jobs.RunTask.databricks.sdk.service.jobs.TableTriggerConfigurationdataclass.compute_keyfield fordatabricks.sdk.service.jobs.Task.environment_keyfield fordatabricks.sdk.service.jobs.Task.tablefield fordatabricks.sdk.service.jobs.TriggerSettingstodatabricks.sdk.service.jobs.TableUpdateTriggerConfigurationdataclass.table_updatefield fordatabricks.sdk.service.jobs.TriggerSettingstodatabricks.sdk.service.jobs.TableUpdateTriggerConfigurationdataclass.databricks.sdk.service.jobs.JobEnvironmentdataclass.databricks.sdk.service.jobs.TableUpdateTriggerConfigurationdataclass.databricks.sdk.service.marketplacepackage.OpenAPI SHA: 94684175b8bd65f8701f89729351f8069e8309c9, Date: 2024-04-11