Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DO NOT MERGE / TEST: only for diff #800

Closed
wants to merge 54 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
12fc7af
add datadog env vars (#690)
emmyoop Jul 17, 2023
7ae6f9a
Cleanup main after cutting new 1.6.latest branch (#693)
FishtownBuildBot Jul 18, 2023
57563ab
fix: add option to use private key for authentication (#671)
jschenz-chwy Jul 20, 2023
87b07a2
add new line at the end of the dependabot changie to pass linter (#705)
mikealfare Jul 24, 2023
6eb6dea
Update stale workflow to use centralized version (#707)
mikealfare Jul 25, 2023
02935f7
ADAP-728: Fix "On Configuration Change" config (#708)
mikealfare Jul 28, 2023
c58c54d
Mcknight/fix python model test (#717)
McKnight-42 Aug 1, 2023
d75e24b
Update wheel requirement from ~=0.40 to ~=0.41 (#706)
dependabot[bot] Aug 2, 2023
da99d9b
Update pip-tools requirement from ~=6.14 to ~=7.0 (#692)
dependabot[bot] Aug 2, 2023
121b498
Update flake8 requirement from ~=6.0 to ~=6.1 (#714)
dependabot[bot] Aug 3, 2023
3ebc714
Update pip-tools requirement from ~=7.0 to ~=7.1 (#722)
dependabot[bot] Aug 3, 2023
8c5685d
Update black requirement from ~=23.3 to ~=23.7 (#688)
dependabot[bot] Aug 3, 2023
c231ed2
Update ddtrace requirement from ~=1.16 to ~=1.17 (#704)
dependabot[bot] Aug 3, 2023
22f50a9
Update pip-tools requirement from ~=7.1 to ~=7.2 (#723)
dependabot[bot] Aug 3, 2023
5489398
move alerts to adapter channel (#685)
Aug 3, 2023
8423ed0
[ADAP-620] [Bug] Incremental materialization with "append" strategy d…
danielefrigo Aug 3, 2023
fd28b35
Update connections.py so it doesn’t run anything after its canceled (…
julio-romero Aug 5, 2023
5d5c18e
[ADAP-774] fix snowflake_warehouse issue with dynamic tables (#727)
McKnight-42 Aug 10, 2023
1fdd854
Update pip-tools requirement from ~=7.2 to ~=7.3 (#731)
dependabot[bot] Aug 11, 2023
1d1057a
Update tox requirement from ~=4.6 to ~=4.7 (#730)
dependabot[bot] Aug 11, 2023
e0376b2
add datadog env vars to tox.ini (#739)
mikealfare Aug 11, 2023
fbf63cd
Bump mypy from 1.4.1 to 1.5.0 (#733)
dependabot[bot] Aug 12, 2023
73ea41a
[ADAP-631] Convert Target_lag to str type to add Downstream option (#…
McKnight-42 Aug 14, 2023
6105891
Update tox requirement from ~=4.7 to ~=4.8 (#744)
dependabot[bot] Aug 16, 2023
0176790
Update ddtrace requirement from ~=1.17 to ~=1.18 (#745)
dependabot[bot] Aug 16, 2023
26c1c8b
Update tox requirement from ~=4.8 to ~=4.9 (#748)
dependabot[bot] Aug 17, 2023
6f12f1a
Bumping version to 1.7.0b1 and generate changelog
FishtownBuildBot Aug 17, 2023
c95b9d8
[Automated] Merged prep-release/1.7.0b1_5896244073 into target main d…
FishtownBuildBot Aug 17, 2023
43d12bc
Update tox requirement from ~=4.9 to ~=4.10 (#752)
dependabot[bot] Aug 25, 2023
8d5fca9
ADAP-821: Refactor prep for dynamic table / table/view swap (#751)
mikealfare Aug 28, 2023
e72e8f1
[ADAP-849] removes some user connection details from stdout (#756)
McKnight-42 Aug 28, 2023
0923424
Update tox requirement from ~=4.10 to ~=4.11 (#759)
dependabot[bot] Sep 1, 2023
c44eb7c
Bump mypy from 1.5.0 to 1.5.1 (#749)
dependabot[bot] Sep 1, 2023
a67838d
update expected values (#763)
McKnight-42 Sep 11, 2023
b9d511b
Update black requirement from ~=23.7 to ~=23.9 (#765)
dependabot[bot] Sep 12, 2023
cf04fd7
Update pre-commit requirement from ~=3.3 to ~=3.4 (#760)
dependabot[bot] Sep 12, 2023
903ccea
bug/Dynamic-table-comment-on-syntax (#770)
kaarthik108 Sep 14, 2023
336bd9f
Bumping version to v1.7.0b2 and generate changelog
FishtownBuildBot Sep 15, 2023
01f2c3e
[Automated] Merged prep-release/v1.7.0b2_6200460036 into target main …
FishtownBuildBot Sep 15, 2023
eb4fd78
ADAP-821: Add support for replacing dynamic tables with tables/views …
mikealfare Sep 15, 2023
9fa8de2
Redact values from logs due 'duplicate key' error (#773)
jaypeedevlin Sep 18, 2023
82b2acb
allow testing against any core branch (#771)
colin-rogers-dbt Sep 19, 2023
a181a7d
automate repo cleanup (#789)
emmyoop Sep 26, 2023
cd789b0
Add debug logging (#768)
colin-rogers-dbt Sep 26, 2023
658e16e
add dbt show tests (#779)
MichelleArk Sep 28, 2023
1bbbb96
test against 1.7.latest release branch and fix semve (#797)
McKnight-42 Oct 9, 2023
273694b
Add tests for `date_spine` macro, and sub macros (#787)
QMalcolm Oct 10, 2023
69168e7
Bug/dynamic table alter on column syntax (#790)
kaarthik108 Oct 11, 2023
0bf3822
ADAP-893: Support test results as views (#783)
mikealfare Oct 11, 2023
ff08a1c
remove manual refresh on dynamic table create (#798)
mikealfare Oct 11, 2023
d44e80e
ADAP-865: Parameterize where clause, add option to supply list of rel…
mikealfare Oct 11, 2023
36fe646
Respect `transient` config for dbt Python models (#802)
dbeatty10 Oct 11, 2023
8970aaa
Implementation of metadata-based freshness (#796)
peterallenwebb Oct 12, 2023
cf854b5
Cleanup main after cutting new 1.7.latest branch (#804)
FishtownBuildBot Oct 12, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .bumpversion.cfg
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
[bumpversion]
current_version = v1.6.0b3
current_version = 1.8.0a1
parse = (?P<major>[\d]+) # major version number
\.(?P<minor>[\d]+) # minor version number
\.(?P<patch>[\d]+) # patch version number
Expand Down
1 change: 1 addition & 0 deletions .changes/0.0.0.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
## Previous Releases
For information on prior major and minor releases, see their changelogs:
- [1.6](https://github.com/dbt-labs/dbt-snowflake/blob/1.6.latest/CHANGELOG.md)
- [1.5](https://github.com/dbt-labs/dbt-snowflake/blob/1.5.latest/CHANGELOG.md)
- [1.4](https://github.com/dbt-labs/dbt-snowflake/blob/1.4.latest/CHANGELOG.md)
- [1.3](https://github.com/dbt-labs/dbt-snowflake/blob/1.3.latest/CHANGELOG.md)
Expand Down
1 change: 0 additions & 1 deletion .changes/1.6.0-a1.md

This file was deleted.

12 changes: 0 additions & 12 deletions .changes/1.6.0-b1.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changes/1.6.0-b2.md

This file was deleted.

22 changes: 0 additions & 22 deletions .changes/1.6.0-b3.md

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Dependencies-20230526-160223.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Features-20230417-173251.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Features-20230516-122740.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Features-20230604-042329.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Fixes-20230508-224927.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Fixes-20230509-132208.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Fixes-20230518-011334.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Under the Hood-20230511-144429.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/1.6.0/Under the Hood-20230530-161341.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Dependencies-20230523-125851.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Dependencies-20230606-125842.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Dependencies-20230621-125859.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Dependencies-20230627-125855.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Dependencies-20230627-125859.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Dependencies-20230627-195905.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Dependencies-20230628-002940.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Dependencies-20230703-122521.yaml

This file was deleted.

7 changes: 0 additions & 7 deletions .changes/unreleased/Features-20220816-081318.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Features-20230622-114621.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Features-20230714-224033.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Fixes-20230628-163503.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Fixes-20230706-163838.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions .changes/unreleased/Under the Hood-20230601-140627.yaml

This file was deleted.

2 changes: 2 additions & 0 deletions .flake8
Original file line number Diff line number Diff line change
Expand Up @@ -12,3 +12,5 @@ ignore =
E741,
E501,
exclude = test
per-file-ignores =
*/__init__.py: F401
20 changes: 20 additions & 0 deletions .github/scripts/update_dbt_core_branch.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
#!/bin/bash -e
set -e

git_branch=$1
target_req_file="dev-requirements.txt"
core_req_sed_pattern="s|dbt-core.git.*#egg=dbt-core|dbt-core.git@${git_branch}#egg=dbt-core|g"
postgres_req_sed_pattern="s|dbt-core.git.*#egg=dbt-postgres|dbt-core.git@${git_branch}#egg=dbt-postgres|g"
tests_req_sed_pattern="s|dbt-core.git.*#egg=dbt-tests|dbt-core.git@${git_branch}#egg=dbt-tests|g"
if [[ "$OSTYPE" == darwin* ]]; then
# mac ships with a different version of sed that requires a delimiter arg
sed -i "" "$core_req_sed_pattern" $target_req_file
sed -i "" "$postgres_req_sed_pattern" $target_req_file
sed -i "" "$tests_req_sed_pattern" $target_req_file
else
sed -i "$core_req_sed_pattern" $target_req_file
sed -i "$postgres_req_sed_pattern" $target_req_file
sed -i "$tests_req_sed_pattern" $target_req_file
fi
core_version=$(curl "https://raw.githubusercontent.com/dbt-labs/dbt-core/${git_branch}/core/dbt/version.py" | grep "__version__ = *"|cut -d'=' -f2)
bumpversion --allow-dirty --new-version "$core_version" major
18 changes: 17 additions & 1 deletion .github/workflows/integration.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,11 @@ on:
pull_request_target:
# manual trigger
workflow_dispatch:
inputs:
dbt-core-branch:
description: "branch of dbt-core to use in dev-requirements.txt"
required: false
type: string

# explicitly turn off permissions for `GITHUB_TOKEN`
permissions: read-all
Expand Down Expand Up @@ -125,6 +130,11 @@ jobs:
TOXENV: integration-${{ matrix.adapter }}
PYTEST_ADDOPTS: "-v --color=yes -n4 --csv integration_results.csv"
DBT_INVOCATION_ENV: github-actions
DD_CIVISIBILITY_AGENTLESS_ENABLED: true
DD_API_KEY: ${{ secrets.DATADOG_API_KEY }}
DD_SITE: datadoghq.com
DD_ENV: ci
DD_SERVICE: ${{ github.event.repository.name }}

steps:
- name: Check out the repository
Expand Down Expand Up @@ -154,6 +164,12 @@ jobs:
python -m pip --version
tox --version

- name: Update dev_requirements.txt
if: inputs.dbt-core-branch != ''
run: |
pip install bumpversion
./.github/scripts/update_dbt_core_branch.sh ${{ inputs.dbt-core-branch }}

- name: Run tox (snowflake)
if: matrix.adapter == 'snowflake'
env:
Expand All @@ -172,7 +188,7 @@ jobs:
DBT_TEST_USER_1: dbt_test_role_1
DBT_TEST_USER_2: dbt_test_role_2
DBT_TEST_USER_3: dbt_test_role_3
run: tox
run: tox -- --ddtrace

- uses: actions/upload-artifact@v3
if: always()
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/main-branch-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -56,4 +56,4 @@ jobs:
message_format: ':x: ${{ matrix.workflow_name }} CI on branch "${{ matrix.branch }}" ${{ steps.trigger-step.outputs.workflow-conclusion }}'
footer: 'Linked failed CI run ${{ steps.trigger-step.outputs.workflow-url }}'
env:
SLACK_WEBHOOK_URL: ${{ secrets.SLACK_DEV_CORE_ALERTS }}
SLACK_WEBHOOK_URL: ${{ secrets.SLACK_DEV_ADAPTER_ALERTS }}
4 changes: 2 additions & 2 deletions .github/workflows/nightly-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ defaults:
shell: bash

env:
RELEASE_BRANCH: "1.5.latest"
RELEASE_BRANCH: "1.6.latest"

jobs:
aggregate-release-data:
Expand Down Expand Up @@ -75,7 +75,7 @@ jobs:
- name: "Generate Nightly Release Version Number"
id: nightly-release-version
run: |
number="${{ steps.semver.outputs.major }}.${{ steps.semver.outputs.minor }}.${{ steps.bump_patch.outputs.patch }}.dev${{ steps.current-date.outputs.date }}"
number="${{ steps.semver.outputs.major }}.${{ steps.semver.outputs.minor }}.${{ steps.bump_patch.outputs.patch }}+dev${{ steps.current-date.outputs.date }}"
echo "number=$number" >> $GITHUB_OUTPUT

- name: "Audit Nightly Release Version And Parse Into Parts"
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -225,4 +225,4 @@ jobs:
status: "failure"

secrets:
SLACK_WEBHOOK_URL: ${{ secrets.SLACK_DEV_CORE_ALERTS }}
SLACK_WEBHOOK_URL: ${{ secrets.SLACK_DEV_ADAPTER_ALERTS }}
30 changes: 30 additions & 0 deletions .github/workflows/repository-cleanup.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
# **what?**
# Cleanup branches left over from automation and testing. Also cleanup
# draft releases from release testing.

# **why?**
# The automations are leaving behind branches and releases that clutter
# the repository. Sometimes we need them to debug processes so we don't
# want them immediately deleted. Running on Saturday to avoid running
# at the same time as an actual release to prevent breaking a release
# mid-release.

# **when?**
# Mainly on a schedule of 12:00 Saturday.
# Manual trigger can also run on demand

name: Repository Cleanup

on:
schedule:
- cron: '0 12 * * SAT' # At 12:00 on Saturday - details in `why` above

workflow_dispatch: # for manual triggering

permissions:
contents: write

jobs:
cleanup-repo:
uses: dbt-labs/actions/.github/workflows/repository-cleanup.yml@main
secrets: inherit
15 changes: 6 additions & 9 deletions .github/workflows/stale.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,14 +2,11 @@ name: "Close stale issues and PRs"
on:
schedule:
- cron: "30 1 * * *"

permissions:
issues: write
pull-requests: write

jobs:
stale:
runs-on: ubuntu-latest
steps:
# pinned at v4 (https://github.com/actions/stale/releases/tag/v4.0.0)
- uses: actions/stale@cdf15f641adb27a71842045a94023bef6945e3aa
with:
stale-issue-message: "This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue, or it will be closed in 7 days."
stale-pr-message: "This PR has been marked as Stale because it has been open for 180 days with no activity. If you would like the PR to remain open, please remove the stale label or comment on the PR, or it will be closed in 7 days."
# mark issues/PRs stale when they haven't seen activity in 180 days
days-before-stale: 180
uses: dbt-labs/actions/.github/workflows/stale-bot-matrix.yml@main
Loading
Loading