Databricks CLI v0.232.0 databricks bundle deploy fails

[sassai]

Describe the issue

databricks bundle deploy -t dev fails with Error: Path (/Shared/bundle/<redacted>/dev/resources) doesn't exist.

With v0.231.0 the deployment was successful.

Steps to reproduce the behavior

1. Set workspace.root_path in databricks.yml to /Shared/bundle/${bundle.name}/${bundle.target}
2. Run databricks databricks bundle deploy -t dev
3. See error

With the default target the deployment is successful, though.

Expected Behavior

Bundle deployment is successful with each target

Actual Behavior

Bundle deployment fails with error

Uploading bundle files to /Workspace/Shared/bundle/<redacted>/dev/files...
Error: Path (/Shared/bundle/<redacted>/dev/resources) doesn't exist.

databricks.yml

---
bundle:
  name: "<redacted>"

include:
  - "resources/*.yml"


targets:
  own:
    mode: "development"
    default: "true"
    workspace:
      host: "https://adb-<redacted>.azuredatabricks.net"
    variables:
      url: "abfss://<redacted>@<redacted>.dfs.core.windows.net"
      catalog: "<redacted>"
      metadata_catalog: "<redacted>"
      config_dir: "${workspace.file_path}/sql"
      service_principal_group: "<redacted>"
    run_as:
      user_name: "${workspace.current_user.userName}"
    sync:
      include:
        - "sql/"


  dev:
    mode: "production"
    workspace:
      host: "https://adb-<redacted>.azuredatabricks.net"
      root_path: "/Shared/bundle/${bundle.name}/${bundle.target}"
    variables:
      url: "abfss://<redacted>@<redacted>.dfs.core.windows.net"
      catalog: "<redacted>"
      metadata_catalog: "<redacted>"
      config_dir: "${workspace.file_path}/sql"
      service_principal_group: "<redacted>"
    run_as:
      service_principal_name: "<redacted>"
    permissions:
      - level: "CAN_MANAGE"
        service_principal_name: "<redacted>"
      - level: "CAN_RUN"
        group_name: "<redacted>"
    sync:
      include:
        - "sql/"

OS and CLI version

Databricks CLI v.0.232.0 (Linux and Windows)

Is this a regression?

Yes, with v.0.231.0 everything was fine

[pietern]

Thanks for reporting. We're working on a fix and patch release to address this.

In the meantime, you can workaround the issue by prefixing your root_path setting with /Workspace, such that it looks like /Workspace/Shared/....

[pietern]

GitHub auto-closed this issue because the fix is on the main branch.

We're now working on getting it out as a patch release v0.232.1.

[pietern]

Re-opening to keep this at the top of the issue list.

[sassai]

Thanks for the quick response and fix!

[andrewnester]

@sassai the patch release containing the fix (0.232.1) was just released, please give it a try

[sassai]

@andrewnester I can confirm that it's working again as expected! Thanks again for the quick response and fix!