v0.217.0

Breaking Change:

• Add allow list for resources when bundle run_as is set (#1233).
• Make bundle validation print text output by default (#1335).

CLI:

• Added auth describe command (#1244).
• Fixed message for successful auth describe run (#1336).

Bundles:

• Use UserName field to identify if service principal is used (#1310).
• Allow unknown properties in the config file for template initialization (#1315).
• Remove support for DATABRICKS_BUNDLE_INCLUDES (#1317).
• Make bundle.deployment optional in the bundle schema (#1321).
• Fix the generated DABs JSON schema (#1322).
• Make bundle loaders return diagnostics (#1319).
• Add bundle debug terraform command (#1294).
• Allow specifying CLI version constraints required to run the bundle (#1320).

Internal:

• Retain location information of variable reference (#1333).
• Define dyn.Mapping to represent maps (#1301).
• Return diag.Diagnostics from mutators (#1305).
• Fix flaky test in libs/process (#1314).
• Move path field to bundle type (#1316).
• Load bundle configuration from mutator (#1318).
• Return diagnostics from config.Load (#1324).
• Return warning for nil primitive types during normalization (#1329).
• Include dyn.Path in normalization warnings and errors (#1332).
• Make normalization return warnings instead of errors (#1334).

v0.216.0

CLI:

• Propagate correct User-Agent for CLI during OAuth flow (#1264).
• Add usage string when command fails with incorrect arguments (#1276).

Bundles:

• Include dyn.Path as argument to the visit callback function (#1260).
• Inline logic to set a value in dyn.SetByPath (#1261).
• Add assertions for the dyn.Path argument to the visit callback (#1265).
• Add dyn.MapByPattern to map a function to values with matching paths (#1266).
• Filter current user from resource permissions (#1262).
• Retain location annotation when expanding globs for pipeline libraries (#1274).
• Added deployment state for bundles (#1267).
• Do CheckRunningResource only after terraform.Write (#1292).
• Rewrite relative paths using dyn.Location of the underlying value (#1273).
• Push deployment state right after files upload (#1293).
• Make Append function to dyn.Path return independent slice (#1295).
• Move bundle tests into bundle/tests (#1299).
• Upgrade Terraform provider to 1.38.0 (#1308).

Internal:

• Add integration test for mlops-stacks initialization (#1155).
• Update actions/setup-python to v5 (#1290).
• Update codecov/codecov-action to v4 (#1291).

API Changes:

• Changed databricks catalogs list command.
• Changed databricks online-tables create command.
• Changed databricks lakeview publish command.
• Added databricks lakeview create command.
• Added databricks lakeview get command.
• Added databricks lakeview get-published command.
• Added databricks lakeview trash command.
• Added databricks lakeview update command.
• Moved settings related commands to databricks settings and databricks account settings.

OpenAPI commit 93763b0d7ae908520c229c786fff28b8fd623261 (2024-03-20)

Dependency updates:

• Bump golang.org/x/oauth2 from 0.17.0 to 0.18.0 (#1270).
• Bump golang.org/x/mod from 0.15.0 to 0.16.0 (#1271).
• Update Go SDK to v0.35.0 (#1300).
• Update Go SDK to v0.36.0 (#1304).

v0.215.0

CLI:

• The SDK update fixes fs cp calls timing out when copying large files.

Bundles:

• Fix summary command when internal Terraform config doesn't exist (#1242).
• Configure cobra.NoArgs for bundle commands where applicable (#1250).
• Fixed building Python artifacts on Windows with WSL (#1249).
• Add --validate-only flag to run validate-only pipeline update (#1251).
• Only transform wheel libraries when using trampoline (#1248).
• Return application_id for service principal lookups (#1245).
• Support relative paths in artifact files source section and always upload all artifact files (#1247).
• Fix DBConnect support in VS Code (#1253).

Internal:

• Added test to verify scripts.Execute mutator works correctly (#1237).

API Changes:

• Added databricks permission-migration command group.
• Updated nesting of the databricks settings and databricks account settings commands
• Changed databricks vector-search-endpoints delete-endpoint command with new required argument order.
• Changed databricks vector-search-indexes create-index command with new required argument order.
• Changed databricks vector-search-indexes delete-data-vector-index command with new required argument order.
• Changed databricks vector-search-indexes upsert-data-vector-index command with new required argument order.

OpenAPI commit d855b30f25a06fe84f25214efa20e7f1fffcdf9e (2024-03-04)

Dependency updates:

• Bump github.com/stretchr/testify from 1.8.4 to 1.9.0 (#1252).
• Update Go SDK to v0.34.0 (#1256).

v0.214.1

CLI:

• Improved error message when no .databrickscfg (#1223).
• Use Go SDK Iterators when listing resources with the CLI (#1202).

Bundles:

• Only set ComputeID value when --compute-id flag provided (#1229).
• Add correct tag value for models in dev mode (#1230).
• Upgrade Terraform provider to 1.37.0 (#1235).

Internal:

• Fix CLI nightlies on our UC workspaces (#1225).
• Handle alias types for map keys in toTyped conversion (#1232).

v0.214.0

CLI:

• Add support for UC Volumes to the databricks fs commands (#1209).

Bundles:

• Use dynamic configuration model in bundles (#1098).
• Allow use of variables references in primitive non-string fields (#1219).
• Add an experimental default-sql template (#1051).
• Add an experimental dbt-sql template (#1059).

Internal:

• Add fork-user to winget release workflow (#1214).
• Use any as type for data sources and resources in tf/schema (#1216).
• Avoid infinite recursion when normalizing a recursive type (#1213).
• Fix issue where interpolating a new ref would rewrite unrelated fields (#1217).
• Use dyn.Value as input to generating Terraform JSON (#1218).

API Changes:

• Changed databricks lakehouse-monitors update command with new required argument order.
• Added databricks online-tables command group.

OpenAPI commit cdd76a98a4fca7008572b3a94427566dd286c63b (2024-02-19)
Dependency updates:

• Bump Terraform provider to v1.36.2 (#1215).
• Bump github.com/databricks/databricks-sdk-go from 0.32.0 to 0.33.0 (#1222).

v0.213.0

CLI:

• Ignore environment variables for auth profiles (#1189).
• Update LICENSE file to match Databricks license language (#1013).

Bundles:

• Added bundle deployment bind and unbind command (#1131).
• Use allowlist for Git-related fields to include in metadata (#1187).
• Added --restart flag for bundle run command (#1191).
• Generate correct YAML if custom_tags or spark_conf is used for pipeline or job cluster configuration (#1210).

Internal:

• Move folders package into libs (#1184).
• Log time it takes for profile to load (#1186).
• Use mockery to generate mocks compatible with testify/mock (#1190).
• Retain partially valid structs in convert.Normalize (#1203).
• Skip for_each_task when generating the bundle schema (#1204).
• Regenerate the CLI using the same OpenAPI spec as the SDK (#1205).
• Avoid race-conditions while executing sub-commands (#1201).

API Changes:

• Added databricks tables exists command.
• Added databricks lakehouse-monitors command group.
• Removed databricks files get-status command.
• Added databricks files create-directory command.
• Added databricks files delete-directory command.
• Added databricks files get-directory-metadata command.
• Added databricks files get-metadata command.
• Added databricks files list-directory-contents command.
• Removed databricks pipelines reset command.
• Changed databricks account settings delete-personal-compute-setting command with new required argument order.
• Removed databricks account settings read-personal-compute-setting command.
• Changed databricks account settings update-personal-compute-setting command with new required argument order.
• Added databricks account settings get-personal-compute-setting command.
• Removed databricks settings delete-default-workspace-namespace command.
• Removed databricks settings read-default-workspace-namespace command.
• Removed databricks settings update-default-workspace-namespace command.
• Added databricks settings delete-default-namespace-setting command.
• Added databricks settings delete-restrict-workspace-admins-setting command.
• Added databricks settings get-default-namespace-setting command.
• Added databricks settings get-restrict-workspace-admins-setting command.
• Added databricks settings update-default-namespace-setting command.
• Added databricks settings update-restrict-workspace-admins-setting command.
• Changed databricks token-management create-obo-token command with new required argument order.
• Changed databricks token-management get command to return .
• Changed databricks dashboards create command . New request type is .
• Added databricks dashboards update command.

OpenAPI commit c40670f5a2055c92cf0a6aac92a5bccebfb80866 (2024-02-14)
Dependency updates:

• Bump github.com/hashicorp/hc-install from 0.6.2 to 0.6.3 (#1200).
• Bump golang.org/x/term from 0.16.0 to 0.17.0 (#1197).
• Bump golang.org/x/oauth2 from 0.16.0 to 0.17.0 (#1198).
• Bump github.com/databricks/databricks-sdk-go from 0.30.1 to 0.32.0 (#1199).

v0.212.4

Bundles:

• Allow specifying executable in artifact section and skip bash from WSL (#1169).
• Added warning when trying to deploy bundle with --fail-on-active-runs and running resources (#1163).
• Group bundle run flags by job and pipeline types (#1174).
• Make sure grouped flags are added to the command flag set (#1180).
• Add short_name helper function to bundle init templates (#1167).

Internal:

• Fix dynamic representation of zero values in maps and slices (#1154).
• Refactor library to artifact matching to not use pointers (#1172).
• Harden dyn.Value equality check (#1173).
• Ensure every variable reference is passed to lookup function (#1176).
• Empty struct should yield empty map in convert.FromTyped (#1177).
• Zero destination struct in convert.ToTyped (#1178).
• Fix integration test with invalid configuration (#1182).
• Use acc.WorkspaceTest helper from bundle integration tests (#1181).

v0.212.3

CLI:

• Release Windows packages to winget-pkgs (#1144).

Bundles:

• Add --key flag for generate commands to specify resource key (#1165).

Dependency updates:

• Bump github.com/google/uuid from 1.5.0 to 1.6.0 (#1160).
• Update Go SDK to v0.30.1 (#1162).

v0.212.2

CLI:

• Prompt for account profile only for account-level command execution instead of during databricks labs install flow (#1128).
• Bring back --json flag for workspace-conf set-status command (#1151).

Bundles:

• Set run_as permissions after variable interpolation (#1141).
• Add functionality to visit values in dyn.Value tree (#1142).
• Add dynvar package for variable resolution with a dyn.Value tree (#1143).
• Add support for anyOf to skip_prompt_if (#1133).
• Added bundle generate pipeline command (#1139).

Internal:

• Use MockWorkspaceClient from SDK instead of WithImpl mocking (#1134).

Dependency updates:

• Bump github.com/databricks/databricks-sdk-go from 0.29.0 to 0.29.1 (#1137).
• Bump github.com/hashicorp/terraform-json from 0.20.0 to 0.21.0 (#1138).
• Update actions/setup-go to v5 (#1148).
• Update codecov/codecov-action to v3 (#1149).
• Use latest patch release of Go toolchain (#1152).

v0.212.1

CLI:

• Fix windows style file paths in fs cp command (#1118).
• Do not require positional arguments if they should be provided in JSON (#1125).
• Always require path parameters as positional arguments (#1129).

Bundles:

• Add debug log line for when bundle init is run from non-TTY interface (#1117).
• Added databricks bundle generate job command (#1043).
• Support passing job parameters to bundle run (#1115).

Dependency updates:

• Bump golang.org/x/oauth2 from 0.15.0 to 0.16.0 (#1124).