Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Adaptive Job] Add freshness spec to model #11123

Open
1 task done
ChenyuLInx opened this issue Dec 10, 2024 · 0 comments · May be fixed by #11170
Open
1 task done

[Adaptive Job] Add freshness spec to model #11123

ChenyuLInx opened this issue Dec 10, 2024 · 0 comments · May be fixed by #11170
Labels
user docs [docs.getdbt.com] Needs better documentation

Comments

@ChenyuLInx
Copy link
Contributor

Housekeeping

  • I am a maintainer of dbt-core

Short description

Introduce new configuration on the model to support adaptive job

models:
  - name: stg_orders
    freshness:
      # build this model after X amount of time, as long as it has new data
      build_after: 
        count: 4
        period: hour
        depends_on: all

Acceptance criteria

The new configuration will be parsed and represented on the model node after the parsing phase.

Suggested Tests

  1. Test valid freshness config, parsing works
  2. Test invalid freshnees config, user should get a clear parsing error.

Impact to Other Teams

This involve adding new fields to model node, so it will impact metadata team when it is done.

Will backports be required?

No

Context

No response

@ChenyuLInx ChenyuLInx added user docs [docs.getdbt.com] Needs better documentation Adaptive Job labels Dec 10, 2024
@ChenyuLInx ChenyuLInx linked a pull request Dec 19, 2024 that will close this issue
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
user docs [docs.getdbt.com] Needs better documentation
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants