Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] microbatches should default run in parallel according to threads #10855

Open
3 tasks done
Tracked by #10624
graciegoheen opened this issue Oct 15, 2024 · 0 comments
Open
3 tasks done
Tracked by #10624
Labels
enhancement New feature or request microbatch

Comments

@graciegoheen
Copy link
Contributor

Is this your first time submitting a feature request?

  • I have read the expectations for open source contributors
  • I have searched the existing issues, and I could not find an existing issue for this feature
  • I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

Describe the feature

For faster processing of microbatch models, we should by default run the batches in parallel. We are assuming batches can be run independently.

We could additionally:

Describe alternatives you've considered

No response

Who will this benefit?

No response

Are you interested in contributing this feature?

No response

Anything else?

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request microbatch
Projects
None yet
Development

No branches or pull requests

1 participant