Skip to content

[BUG]: Asses jobs fails 400 Bad Request, perhaps related to an non functioning init script #1585

@danielm-db

Description

@danielm-db

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

In the UCX assesment the asses jobs task fails with the following:

400 Bad request api :
GET /api/2.0/workspace/export?path={hidden}@{hidden}.com+
{
“error_code”: “INVALID_PARAMETER_VALUE”,
“message”: “Path ({hidden}@{hidden}.) doesn’t start with ‘/’”
}

Expected Behavior

No response

Steps To Reproduce

No response

Cloud

Azure

Operating System

macOS

Version

latest via Databricks CLI

Relevant log output

22:15:04 ERROR [databricks.labs.ucx] {MainThread} Execute `databricks workspace export //Applications/ucx/logs/assessment/run-4011653704-1/assess_jobs.log` locally to troubleshoot with more details. Path ({hidden}@{hidden}. ) doesn't start with '/'
22:15:04 DEBUG [databricks] {MainThread} Task crash details
Traceback (most recent call last):
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/runtime.py", line 90, in trigger
    current_task(ctx)
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/assessment/workflows.py", line 79, in assess_jobs
    ctx.jobs_crawler.snapshot()
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/assessment/jobs.py", line 131, in snapshot
    return self._snapshot(self._try_fetch, self._crawl)
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/framework/crawlers.py", line 116, in _snapshot
    loaded_records = list(loader())
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/assessment/jobs.py", line 80, in _crawl
    return self._assess_jobs(all_jobs, all_clusters)
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/assessment/jobs.py", line 89, in _assess_jobs
    cluster_failures = self._check_cluster_failures(cluster_details, "Job cluster")
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/assessment/clusters.py", line 131, in _check_cluster_failures
    failures.extend(self._check_cluster_init_script(cluster.init_scripts, source))
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/assessment/clusters.py", line 97, in _check_cluster_init_script
    init_script_data = self._get_init_script_data(init_script_info)
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/assessment/clusters.py", line 79, in _get_init_script_data
    data = self._ws.workspace.export(workspace_file_destination).content
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/sdk/service/workspace.py", line 2193, in export
    res = self._api.do('GET', '/api/2.0/workspace/export', query=query, headers=headers)
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/sdk/core.py", line 130, in do
    response = retryable(self._perform)(method,
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper
    raise err
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper
    return func(*args, **kwargs)
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/sdk/core.py", line 238, in _perform
    raise self._make_nicer_error(response=response, **payload) from None

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions