Skip to content

Retry in w.clusters().ensureClusterIsRunning(id) when cluster is simultaneously started by two different processes#134

Merged
nfx merged 1 commit intomainfrom
fix/retry-on-start
Aug 16, 2023
Merged

Retry in w.clusters().ensureClusterIsRunning(id) when cluster is simultaneously started by two different processes#134
nfx merged 1 commit intomainfrom
fix/retry-on-start

Conversation

@nfx
Copy link
Copy Markdown
Contributor

@nfx nfx commented Aug 11, 2023

…multaneously starter by two different processes.

This PR adds a retry for timing edge cases like `INVALID_STATE: Cluster XXX is in unexpected state Pending.`
@nfx nfx requested a review from mgyucht August 11, 2023 16:13
@nfx nfx enabled auto-merge August 11, 2023 16:13
github-merge-queue bot pushed a commit to databricks/databricks-sdk-go that referenced this pull request Aug 14, 2023
…ltaneously started by two different processes (#580)

This PR adds a retry for timing edge cases like `INVALID_STATE: Cluster
XXX is in unexpected state Pending.`

Other PRs:
- databricks/databricks-sdk-java#134
- databricks/databricks-sdk-py#283
github-merge-queue bot pushed a commit to databricks/databricks-sdk-py that referenced this pull request Aug 16, 2023
…imultaneously started by two different processes. (#283)

This PR adds a retry for timing edge cases like `INVALID_STATE: Cluster
XXX is in unexpected state Pending.`

Other PRs:
- databricks/databricks-sdk-go#580
- databricks/databricks-sdk-java#134
@nfx nfx added this pull request to the merge queue Aug 16, 2023
Merged via the queue into main with commit e0174d0 Aug 16, 2023
@nfx nfx deleted the fix/retry-on-start branch August 16, 2023 17:44
mgyucht added a commit that referenced this pull request Aug 18, 2023
* Added support for `dbutils.secrets` ([#132](#132)).
* Added retry in `w.clusters().ensureClusterIsRunning(id)` when cluster is simultaneously started by two different processes ([#134](#134)).
* Set necessary headers when authenticating via Azure CLI ([#136](#136)).

New Services:

 * Added `workspaceClient.artifactAllowlists()` service.
 * Added `workspaceClient.securableTags()` service.
 * Added `workspaceClient.subentityTags()` service.
 * Added `com.databricks.sdk.service.catalog.ArtifactAllowlistInfo` class.
 * Added `com.databricks.sdk.service.catalog.ArtifactMatcher` class.
 * Added `com.databricks.sdk.service.catalog.ArtifactType` class.
 * Added `com.databricks.sdk.service.catalog.GetArtifactAllowlistRequest` class.
 * Added `com.databricks.sdk.service.catalog.ListSecurableTagsRequest` class.
 * Added `com.databricks.sdk.service.catalog.ListSecurableType` class.
 * Added `com.databricks.sdk.service.catalog.ListSubentityTagsRequest` class.
 * Added `com.databricks.sdk.service.catalog.MatchType` class.
 * Added `com.databricks.sdk.service.catalog.SetArtifactAllowlist` class.
 * Added `com.databricks.sdk.service.catalog.TagChanges` class.
 * Added `com.databricks.sdk.service.catalog.TagKeyValuePair` class.
 * Added `com.databricks.sdk.service.catalog.TagSecurable` class.
 * Added `com.databricks.sdk.service.catalog.TagSecurableAssignment` class.
 * Added `com.databricks.sdk.service.catalog.TagSecurableAssignmentsList` class.
 * Added `com.databricks.sdk.service.catalog.TagSubentity` class.
 * Added `com.databricks.sdk.service.catalog.TagSubentityAssignmentsList` class.
 * Added `com.databricks.sdk.service.catalog.TagsSubentityAssignment` class.
 * Added `com.databricks.sdk.service.catalog.UpdateSecurableType` class.
 * Added `com.databricks.sdk.service.catalog.UpdateTags` class.

New APIs:

 * Added `deleteRuns()` method for `workspaceClient.experiments()` service.
 * Added `restoreRuns()` method for `workspaceClient.experiments()` service.
 * Added `com.databricks.sdk.service.ml.DeleteRuns` class.
 * Added `com.databricks.sdk.service.ml.DeleteRunsResponse` class.
 * Added `com.databricks.sdk.service.ml.RestoreRuns` class.
 * Added `com.databricks.sdk.service.ml.RestoreRunsResponse` class.
 * Added `getSecret()` method for `workspaceClient.secrets()` service.
 * Added `com.databricks.sdk.service.workspace.GetSecretRequest` class.
 * Added `com.databricks.sdk.service.workspace.GetSecretResponse` class.

API Renames:

 * Renamed `effectiveAutoMaintenanceFlag` field to `effectivePredictiveOptimizationFlag` field for `com.databricks.sdk.service.catalog.CatalogInfo`.
 * Renamed `enableAutoMaintenance` field to `enablePredictiveOptimization` field for `com.databricks.sdk.service.catalog.CatalogInfo`.
 * Renamed `com.databricks.sdk.service.catalog.EffectiveAutoMaintenanceFlag` class to `com.databricks.sdk.service.catalog.EffectivePredictiveOptimizationFlag` class.
 * Renamed `com.databricks.sdk.service.catalog.EffectiveAutoMaintenanceFlagInheritedFromType` class to `com.databricks.sdk.service.catalog.EffectivePredictiveOptimizationFlagInheritedFromType`.
 * Renamed `com.databricks.sdk.service.catalog.EnableAutoMaintenance` class to `com.databricks.sdk.service.catalog.EnablePredictiveOptimization`.
 * Renamed `effectiveAutoMaintenanceFlag` field to `effectivePredictiveOptimizationFlag` field for `com.databricks.sdk.service.catalog.SchemaInfo`.
 * Renamed `enableAutoMaintenance` field to `enablePredictiveOptimization` field for `com.databricks.sdk.service.catalog.SchemaInfo`.
 * Renamed `effectiveAutoMaintenanceFlag` field to `effectivePredictiveOptimizationFlag` field for `com.databricks.sdk.service.catalog.TableInfo`.
 * Renamed `enableAutoMaintenance` field to `enablePredictiveOptimization` field for `com.databricks.sdk.service.catalog.TableInfo`.

OpenAPI SHA: beff621d7b3e1d59244e2e34fc53a496f310e130, Date: 2023-08-17
@mgyucht mgyucht mentioned this pull request Aug 18, 2023
github-merge-queue bot pushed a commit that referenced this pull request Aug 18, 2023
* Added support for `dbutils.secrets`
([#132](#132)).
* Added retry in `w.clusters().ensureClusterIsRunning(id)` when cluster
is simultaneously started by two different processes
([#134](#134)).
* Set necessary headers when authenticating via Azure CLI
([#136](#136)).

New Services:

 * Added `workspaceClient.artifactAllowlists()` service.
 * Added `workspaceClient.securableTags()` service.
 * Added `workspaceClient.subentityTags()` service.
* Added `com.databricks.sdk.service.catalog.ArtifactAllowlistInfo`
class.
 * Added `com.databricks.sdk.service.catalog.ArtifactMatcher` class.
 * Added `com.databricks.sdk.service.catalog.ArtifactType` class.
* Added `com.databricks.sdk.service.catalog.GetArtifactAllowlistRequest`
class.
* Added `com.databricks.sdk.service.catalog.ListSecurableTagsRequest`
class.
 * Added `com.databricks.sdk.service.catalog.ListSecurableType` class.
* Added `com.databricks.sdk.service.catalog.ListSubentityTagsRequest`
class.
 * Added `com.databricks.sdk.service.catalog.MatchType` class.
* Added `com.databricks.sdk.service.catalog.SetArtifactAllowlist` class.
 * Added `com.databricks.sdk.service.catalog.TagChanges` class.
 * Added `com.databricks.sdk.service.catalog.TagKeyValuePair` class.
 * Added `com.databricks.sdk.service.catalog.TagSecurable` class.
* Added `com.databricks.sdk.service.catalog.TagSecurableAssignment`
class.
* Added `com.databricks.sdk.service.catalog.TagSecurableAssignmentsList`
class.
 * Added `com.databricks.sdk.service.catalog.TagSubentity` class.
* Added `com.databricks.sdk.service.catalog.TagSubentityAssignmentsList`
class.
* Added `com.databricks.sdk.service.catalog.TagsSubentityAssignment`
class.
 * Added `com.databricks.sdk.service.catalog.UpdateSecurableType` class.
 * Added `com.databricks.sdk.service.catalog.UpdateTags` class.

New APIs:

* Added `deleteRuns()` method for `workspaceClient.experiments()`
service.
* Added `restoreRuns()` method for `workspaceClient.experiments()`
service.
 * Added `com.databricks.sdk.service.ml.DeleteRuns` class.
 * Added `com.databricks.sdk.service.ml.DeleteRunsResponse` class.
 * Added `com.databricks.sdk.service.ml.RestoreRuns` class.
 * Added `com.databricks.sdk.service.ml.RestoreRunsResponse` class.
 * Added `getSecret()` method for `workspaceClient.secrets()` service.
 * Added `com.databricks.sdk.service.workspace.GetSecretRequest` class.
 * Added `com.databricks.sdk.service.workspace.GetSecretResponse` class.

API Renames:

* Renamed `effectiveAutoMaintenanceFlag` field to
`effectivePredictiveOptimizationFlag` field for
`com.databricks.sdk.service.catalog.CatalogInfo`.
* Renamed `enableAutoMaintenance` field to
`enablePredictiveOptimization` field for
`com.databricks.sdk.service.catalog.CatalogInfo`.
* Renamed
`com.databricks.sdk.service.catalog.EffectiveAutoMaintenanceFlag` class
to
`com.databricks.sdk.service.catalog.EffectivePredictiveOptimizationFlag`
class.
* Renamed
`com.databricks.sdk.service.catalog.EffectiveAutoMaintenanceFlagInheritedFromType`
class to
`com.databricks.sdk.service.catalog.EffectivePredictiveOptimizationFlagInheritedFromType`.
* Renamed `com.databricks.sdk.service.catalog.EnableAutoMaintenance`
class to
`com.databricks.sdk.service.catalog.EnablePredictiveOptimization`.
* Renamed `effectiveAutoMaintenanceFlag` field to
`effectivePredictiveOptimizationFlag` field for
`com.databricks.sdk.service.catalog.SchemaInfo`.
* Renamed `enableAutoMaintenance` field to
`enablePredictiveOptimization` field for
`com.databricks.sdk.service.catalog.SchemaInfo`.
* Renamed `effectiveAutoMaintenanceFlag` field to
`effectivePredictiveOptimizationFlag` field for
`com.databricks.sdk.service.catalog.TableInfo`.
* Renamed `enableAutoMaintenance` field to
`enablePredictiveOptimization` field for
`com.databricks.sdk.service.catalog.TableInfo`.

OpenAPI SHA: beff621d7b3e1d59244e2e34fc53a496f310e130, Date: 2023-08-17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants