Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V1.9.0 release #252

Merged
merged 1 commit into from
Dec 26, 2024
Merged

V1.9.0 release #252

merged 1 commit into from
Dec 26, 2024

Conversation

prdpsvs
Copy link
Collaborator

@prdpsvs prdpsvs commented Dec 26, 2024

This pull request introduces several changes to the dbt project, focusing on incremental strategies, snapshot handling, and testing. The most significant changes include the addition of a new incremental strategy, updates to snapshot macros, and the inclusion of new tests for the microbatch strategy.

Incremental Strategies:

  • Added a new incremental strategy named "microbatch" in the valid_incremental_strategies method of fabric_adapter.py and corresponding SQL macros. [1] [2] [3]

Snapshot Handling:

  • Updated the fabric__build_snapshot_table and fabric__snapshot_staging_table macros to use configurable column names, enhancing flexibility and readability. [1] [2]
  • Improved the fabric__snapshot_merge_sql macro to handle dynamic column names and added checks for dbt_valid_to_current. [1] [2]
  • Modified snapshot.sql to integrate the new snapshot staging table logic and ensure proper column handling. [1] [2]

Testing:

  • Introduced new tests for the microbatch incremental strategy in test_incremental_microbatch.py, including setup for input models and insertion of test data.

Miscellaneous:

  • Corrected a variable name in columns.sql to ensure the correct SQL string is evaluated.

…lid_to, hard_deletes, and unique_key as list snapshot improvements
@prdpsvs prdpsvs requested a review from Copilot December 26, 2024 06:52

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot reviewed 4 out of 10 changed files in this pull request and generated no comments.

Files not reviewed (6)
  • dbt/include/fabric/macros/adapters/columns.sql: Language not supported
  • dbt/include/fabric/macros/materializations/models/incremental/incremental_strategies.sql: Language not supported
  • dbt/include/fabric/macros/materializations/models/incremental/merge.sql: Language not supported
  • dbt/include/fabric/macros/materializations/snapshots/helpers.sql: Language not supported
  • dbt/include/fabric/macros/materializations/snapshots/snapshot.sql: Language not supported
  • dbt/include/fabric/macros/materializations/snapshots/snapshot_merge.sql: Language not supported
@prdpsvs prdpsvs merged commit 8f27f60 into main Dec 26, 2024
6 checks passed
@prdpsvs prdpsvs deleted the v1.9.0 branch December 26, 2024 07:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant