Bundle deploy error on Windows with CLI Databricks CLI v0.214.1 #1243
Description
Describe the issue
I'm using Powershell as a terminal, and I'm trying to get started with databricks bundles. I am working through the beginning tutorial. I was able to authorize successfully and build a bundle. When I go to deploy this bundle, however, it fails. The only thing I notice is that it expects bash instead of cmd/pwsh, and the file path for the shell script it fails on has missing slashes.
Configuration
databricks auth login --host MYHOST
databricks clusters spark-versions # just to confirm connectivity
Steps to reproduce the behavior
databricks bundle init # complete menu, name the profile 'VROCR'
cd ./VROCR
databricks bundle validate
databricks bundle deploy --profile prod
See error, replacing my windows login name with {USER}
Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec942522541.sh: No such file or directory
Expected Behavior
Load bundle to Azure Databricks environment
Actual Behavior
See error message.
OS and CLI version
Databricks CLI v0.214.1
Windows 11 professional
Is this a regression?
New user, unknown
Debug Logs
DEBUG GET /api/2.0/preview/scim/v2/Me
< HTTP/2.0 200 OK
< {
< "active": true,
< "emails": [
< {
< "primary": true,
< "type": "work",
< "value": "{REDACTED}"
< }
< ],
< "externalId": "{REDACTED}"
< "groups": [
< {
< "$ref": "{REDACTED}",
< "display": "{REDACTED}",
< "type": "direct",
< "value": "{REDACTED}"
< }
< ],
< "id": "REDACT",
< "schemas": [
< "urn:ietf:params:scim:schemas:core:2.0:User",
< "urn:ietf:params:scim:schemas:extension:workspace:2.0:User"
< ],
< "userName": "REDACT"
< } pid=7152 mutator=seq mutator=initialize mutator=seq mutator=PopulateCurrentUser sdk=true
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=DefineDefaultWorkspaceRoot
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=ExpandWorkspaceRoot
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=DefaultWorkspacePaths
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=SetVariables
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=ResolveResourceReferences
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=ResolveVariableReferences
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=SetRunAs
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=OverrideCompute
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=ProcessTargetMode
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=ExpandPipelineGlobPaths
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=TranslatePaths
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=PythonWrapperWarning
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=ApplyBundlePermissions
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=metadata.AnnotateJobs
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=terraform.Initialize
13:26:39 DEBUG Using Terraform at C:\Jon\VROCR\VROCR\.databricks\bundle\dev\bin\terraform.exe pid=7152
mutator=seq mutator=initialize mutator=seq mutator=terraform.Initialize
13:26:39 DEBUG Environment variables for Terraform: DATABRICKS_CLI_PATH, DATABRICKS_AUTH_TYPE, USERPROFILE, PATH, TMP, DATABRICKS_HOST pid=7152 mutator=seq mutator=initialize mutator=seq mutator=terraform.Initialize
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=initialize mutator=seq mutator=scripts.postinit
13:26:39 DEBUG No script defined for postinit, skipping pid=7152 mutator=seq mutator=initialize mutator=seq mutator=scripts.postinit
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build
13:26:39 INFO Phase: build pid=7152 mutator=seq mutator=build
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=scripts.prebuild
13:26:39 DEBUG No script defined for prebuild, skipping pid=7152 mutator=seq mutator=build mutator=seq
mutator=scripts.prebuild
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages mutator=seq
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages mutator=seq mutator=artifacts.whl.AutoDetect
13:26:39 INFO Detecting Python wheel project... pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages mutator=seq mutator=artifacts.whl.AutoDetect
13:26:39 INFO Found Python wheel project at C:\Jon\VROCR\VROCR pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages mutator=seq mutator=artifacts.whl.AutoDetect
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages mutator=seq mutator=artifacts.whl.DefineArtifactsFromLibraries
13:26:39 DEBUG Skipping defining artifacts from libraries because artifacts section is explicitly defined pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.DetectPackages mutator=seq mutator=artifacts.whl.DefineArtifactsFromLibraries
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.inferAll
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.inferAll mutator=seq
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.inferAll mutator=seq mutator=artifacts.Infer(VROCR)
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.inferAll mutator=seq mutator=artifacts.Infer(VROCR) mutator=artifacts.whl.Infer(VROCR)
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(VROCR)
13:26:39 DEBUG Apply pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(VROCR) mutator=artifacts.whl.Build(VROCR)
Building VROCR...
13:26:41 ERROR Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory
pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(VROCR) mutator=artifacts.whl.Build(VROCR)
13:26:41 ERROR Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory
pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq mutator=artifacts.Build(VROCR)
13:26:41 ERROR Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory
pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll mutator=seq
13:26:41 ERROR Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory
pid=7152 mutator=seq mutator=build mutator=seq mutator=artifacts.BuildAll
13:26:41 ERROR Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory
pid=7152 mutator=seq mutator=build mutator=seq
13:26:41 ERROR Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory
pid=7152 mutator=seq mutator=build
13:26:41 ERROR Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory
pid=7152 mutator=seq
Error: build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory
13:26:41 ERROR failed execution pid=7152 exit_code=1 error="build failed VROCR, error: exit status 1, output: /bin/bash: C:Users{USER}AppDataLocalTempcli-exec3432211548.sh: No such file or directory\n"