Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for incremental models #10

Merged
merged 1 commit into from
Oct 7, 2021
Merged

Conversation

findinpath
Copy link
Collaborator

The incremental strategy supported is to insert new records into target table,
without updating or overwriting.

Resolves: #1

@findinpath findinpath requested a review from hovaesco September 30, 2021 21:21
docker/run_tests.bash Outdated Show resolved Hide resolved
README.md Show resolved Hide resolved
README.md Show resolved Hide resolved
@hovaesco
Copy link
Contributor

hovaesco commented Oct 1, 2021

Looks good, some initial comments, I will test it later

@findinpath findinpath force-pushed the feature/incremental-append branch from 8011356 to 406eea4 Compare October 1, 2021 11:46
@hovaesco
Copy link
Contributor

hovaesco commented Oct 1, 2021

I tested it and it works nice. One question, is temp table *__dbt_tmp not being dropped after dbt run is an expected behaviour? I see in logs that it does only drop table if exists before query execution. Let's maybe try to add adapter.drop_relation before running post hooks command. WDYT?

@findinpath findinpath force-pushed the feature/incremental-append branch 2 times, most recently from 294430f to 74bd613 Compare October 1, 2021 16:51
@findinpath
Copy link
Collaborator Author

@hovaesco thanks for raising this comment : #10 (comment)

i've added handling for deleting the temporary table in case of appending new content.

Copy link
Contributor

@hovaesco hovaesco left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

docker/run_tests.bash Show resolved Hide resolved
docker/run_tests.bash Outdated Show resolved Hide resolved
@findinpath findinpath force-pushed the feature/incremental-append branch 3 times, most recently from e026e19 to 6fda13a Compare October 4, 2021 19:52
README.md Outdated Show resolved Hide resolved
The incremental strategy supported is to insert new records into target table,
without updating or overwriting.

Resolves: #1
@findinpath findinpath force-pushed the feature/incremental-append branch from 6fda13a to 36b6c85 Compare October 7, 2021 07:03
@hovaesco hovaesco merged commit e29df0a into master Oct 7, 2021
@hovaesco hovaesco deleted the feature/incremental-append branch December 16, 2021 15:53
EminUZUN pushed a commit to EminUZUN/dbt-trino that referenced this pull request Feb 14, 2023
…ental-append

Add support for incremental models
damian3031 pushed a commit to damian3031/dbt-trino that referenced this pull request Sep 9, 2024
…ental-append

Add support for incremental models
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add incremental models
2 participants