Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improved support for custom configs in data tests #5679

Merged
merged 48 commits into from
Jul 23, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
5bed59d
Improved support for custom configs in data tests
nghi-ly Jun 20, 2024
7ba3152
Minor nits
nghi-ly Jun 20, 2024
92663ae
Update example
nghi-ly Jun 20, 2024
c5f4770
One more
nghi-ly Jun 20, 2024
3f26951
Merge branch 'current' into ly-docs-issue-5548
runleonarun Jun 20, 2024
c5596d0
This branch was auto-updated!
github-actions[bot] Jun 21, 2024
9ca03fa
This branch was auto-updated!
github-actions[bot] Jun 22, 2024
0feb5a4
This branch was auto-updated!
github-actions[bot] Jun 24, 2024
77bfd19
This branch was auto-updated!
github-actions[bot] Jun 25, 2024
30edd36
This branch was auto-updated!
github-actions[bot] Jun 26, 2024
dea749c
This branch was auto-updated!
github-actions[bot] Jun 27, 2024
2c5aebc
This branch was auto-updated!
github-actions[bot] Jun 28, 2024
dc1faf2
This branch was auto-updated!
github-actions[bot] Jun 29, 2024
3bdeb21
This branch was auto-updated!
github-actions[bot] Jul 1, 2024
3f50a9d
This branch was auto-updated!
github-actions[bot] Jul 2, 2024
bf272bd
This branch was auto-updated!
github-actions[bot] Jul 3, 2024
7df9ca9
This branch was auto-updated!
github-actions[bot] Jul 4, 2024
b030c6f
This branch was auto-updated!
github-actions[bot] Jul 5, 2024
49d60a6
This branch was auto-updated!
github-actions[bot] Jul 9, 2024
36cbdce
Update website/docs/reference/data-test-configs.md
nghi-ly Jul 9, 2024
cf5230b
Update website/docs/reference/data-test-configs.md
nghi-ly Jul 9, 2024
ebb3ff5
Fold in feedback
nghi-ly Jul 9, 2024
1ce9ee8
Add release note
nghi-ly Jul 9, 2024
ee35108
Merge branch 'current' into ly-docs-issue-5548
nghi-ly Jul 9, 2024
77900e8
This branch was auto-updated!
github-actions[bot] Jul 10, 2024
e412ddd
Update website/docs/docs/dbt-versions/release-notes.md
nghi-ly Jul 10, 2024
9b2bba1
Update website/docs/reference/data-test-configs.md
nghi-ly Jul 10, 2024
adb56b2
This branch was auto-updated!
github-actions[bot] Jul 11, 2024
deb3b07
This branch was auto-updated!
github-actions[bot] Jul 12, 2024
431816a
This branch was auto-updated!
github-actions[bot] Jul 13, 2024
3831cc8
This branch was auto-updated!
github-actions[bot] Jul 15, 2024
d65708b
This branch was auto-updated!
github-actions[bot] Jul 16, 2024
85fb267
Update website/docs/docs/dbt-versions/release-notes.md
nghi-ly Jul 17, 2024
17ef26b
Update website/docs/docs/dbt-versions/release-notes.md
nghi-ly Jul 17, 2024
3686392
Update website/docs/reference/data-test-configs.md
nghi-ly Jul 17, 2024
1efb9d0
Fix merge conflict
nghi-ly Jul 17, 2024
811ebac
Feedback
nghi-ly Jul 18, 2024
4d75c41
This branch was auto-updated!
github-actions[bot] Jul 18, 2024
4848556
This branch was auto-updated!
github-actions[bot] Jul 19, 2024
bef3943
This branch was auto-updated!
github-actions[bot] Jul 20, 2024
4d1abc5
This branch was auto-updated!
github-actions[bot] Jul 21, 2024
c7fdfdc
This branch was auto-updated!
github-actions[bot] Jul 22, 2024
f3e49ea
Merge branch 'ly-docs-issue-5548' of github.com:dbt-labs/docs.getdbt.…
nghi-ly Jul 23, 2024
4029623
Feedback
nghi-ly Jul 23, 2024
567cc05
Merge branch 'current' into ly-docs-issue-5548
nghi-ly Jul 23, 2024
b92c88e
Feedback
nghi-ly Jul 23, 2024
44b5870
Nit
nghi-ly Jul 23, 2024
5f4abfb
Merge branch 'current' into ly-docs-issue-5548
nghi-ly Jul 23, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions website/docs/docs/dbt-versions/release-notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,9 @@ Release notes are grouped by month for both multi-tenant and virtual private clo
[^*] The official release date for this new format of release notes is May 15th, 2024. Historical release notes for prior dates may not reflect all available features released earlier this year or their tenancy availability.

## July 2024
- **Enhancement:** Custom configurations are now supported by generic data tests. Use this to configure how dbt should run the data test (for example, specifying a Snowflake virtual warehouse different from the one in your connection). To learn more, refer to [Specify custom configurations for generic data tests](/reference/data-test-configs#specify-custom-configurations-for-generic-data-tests).

Support for this configuration is available in dbt Cloud when selecting "Keep on latest version." Specifying custom configurations for data tests will become available in dbt Core later this year.

- **Enhancement**: Introducing a revamped overview page for dbt Explorer, available in beta. It includes a new design and layout for the Explorer homepage. The new layout provides a more intuitive experience for users to navigate their dbt projects, as well as a new **Latest updates** section to view the latest changes or issues related to project resources. To learn more, refer to [Overview page](/docs/collaborate/explore-projects#overview-page).
- **Enhancement**: The dbt Semantic Layer now offers more granular control by supporting multiple data platform credentials, which can represent different roles or service accounts. Available for dbt Cloud Enterprise plans, you can map credentials to service tokens for secure authentication. Refer to [Set up dbt Semantic Layer](/docs/use-dbt-semantic-layer/setup-sl#set-up-dbt-semantic-layer) for more details.
Expand Down
23 changes: 23 additions & 0 deletions website/docs/reference/data-test-configs.md
Original file line number Diff line number Diff line change
Expand Up @@ -275,3 +275,26 @@ tests:
```

</File>

#### Specify custom configurations for generic data tests

_Currently available in dbt Cloud only. Specifying custom configurations for data tests will become available in dbt Core later this year._
nghi-ly marked this conversation as resolved.
Show resolved Hide resolved

Use any custom config key to specify custom configurations for data tests. For example, the following specifies the `snowflake_warehouse` custom config that dbt should use when executing the `accepted_values` data test:

```yml

models:
- name: my_model
columns:
- name: color
tests:
- accepted_values:
values: ['blue', 'red']
config:
severity: warn
snowflake_warehouse: my_warehouse

```

Given the config, the data test runs on a different Snowflake virtual warehouse than the one in your default connection to enable better price-performance with a different warehouse size or more granular cost allocation and visibility.
Loading