Releases: microsoft/dbt-fabric
Releases · microsoft/dbt-fabric
v1.9.0
Incremental Strategies:
- Added a new incremental strategy named "microbatch" in the
valid_incremental_strategies
method offabric_adapter.py
and corresponding SQL macros. [1]
Snapshot Handling:
- Updated the
fabric__build_snapshot_table
andfabric__snapshot_staging_table
macros to use configurable snapshot column names, enhancing flexibility and readability. [1] [2] - Improved the
fabric__snapshot_merge_sql
macro to handle dynamic column names and added checks fordbt_valid_to_current
. [1] - Modified
snapshot.sql
to integrate the new snapshot staging table logic and ensure proper column handling. [1] [2] - Added unique_key as list and hard deletes support to snapshots. [1]
Testing:
- Introduced new tests for the microbatch incremental strategy in
test_incremental_microbatch.py
, including setup for input models and insertion of test data.
Full Changelog: v1.8.9...v1.9.0
v1.8.9
Workflow Configuration Updates:
.github/workflows/integration-tests-azure.yml
: Renamed the job and updated the profile and permissions for integration tests. Switched from Azure CLI login to Azure login with OIDC and added a step to test the connection to Fabric Data Warehouse. [1] [2].github/workflows/publish-docker.yml
: Addedworkflow_dispatch
trigger and a step to list Docker images. [1] [2].github/workflows/unit-tests.yml
: Limited Python versions to 3.10 and 3.11 for unit tests.
Codebase Enhancements:
dbt/adapters/fabric/fabric_connection_manager.py
: Added methods for handling access tokens and updated the connection string logic to include pooling and retry configurations. [1] [2] [3] [4] [5] [6]dbt/adapters/fabric/__version__.py
: Bumped version to 1.8.9.dbt/adapters/fabric/fabric_credentials.py
: Addedaccess_token
attribute and updated default retry count.
Macro Improvements:
dbt/include/fabric/macros/adapters/catalog.sql
: Added database usage checks and improved join conditions. [1] [2] [3] [4] [5]dbt/include/fabric/macros/adapters/metadata.sql
: Ensured database names are properly formatted.dbt/include/fabric/macros/adapters/schema.sql
: Added database usage commands before dropping schemas.dbt/include/fabric/macros/adapters/show.sql
: Improved SQL limit handling logic.dbt/include/fabric/macros/materializations/models/table/table.sql
: Enhanced logic for creating backup relations.dbt/include/fabric/macros/materializations/snapshots/helpers.sql
: Simplified column creation logic.dbt/include/fabric/macros/materializations/snapshots/snapshot.sql
: Improved handling of temporary views in snapshots.
These changes collectively enhance the integration testing setup, streamline connection management, and improve the reliability and clarity of macro definitions.
Full Changelog: v1.8.8...v1.8.9
v1.8.8
What's Changed
Even though this is a minor release, a lot of work has been done to secure the repository and code as part of Security Foundation Initiative by Microsoft in addition to addressing issues from the community. Thanks for your patience.
- Added password less integration tests using Azure Open ID Connect + GitHub Workflows
- Added support for truncate table
- Added Alter Table Add Column support
- Fixed seed batch calculation
- Fixed dbt-show errors
- Addressed #221, #228, #229, #243, #232, #235, #
Full Changelog: v1.8.7...v1.8.8
v1.8.7
v1.8.6
v1.8.5
v1.8.4
v1.8.3
What's Changed
- Added Fabric Relation to suppport render_limited in 1.8 release, @prdpsvs in #156
- Addressed cross database incremental models bug #161
- Added get_tables_by_pattern_sql #158 @simon-sandell-swedavia-se
- Updated concat support for single value, dbt utils macro #157, @simon-sandell-swedavia-se
Full Changelog: v1.8.2...v1.8.3
v1.8.2
What's Changed
- Adding Synapse Spark Authentication Option by @marvinbuss in #155
Full Changelog: v1.8.1...v1.8.2