Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhancement(vector): Allow external autoscaler #386

Merged

Conversation

srstrickland
Copy link
Contributor

When using any autoscaler, replicas should not be set on any Deployment or StatefulSet. This helm chart has hooks for defining an HPA, but there are times when users may want to create their own, or use something external like KEDA. In our case, we want to use KEDA for scaling based on kafka lag and other triggers. This largely works as expected, but I need to prevent the replicas field from being populated, or else things appear out-of-sync when the external autoscaler is doing its thing (we use ArgoCD and it will show the project as out-of-sync because of replicas).

The feature here is just to offer an additional field under autoscaling options: external: true/false.

@srstrickland srstrickland force-pushed the allow-external-autoscaler branch 3 times, most recently from 6e0828c to 90855c1 Compare May 2, 2024 18:13
Copy link
Member

@jszwedko jszwedko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this contribution @srstrickland ! I think you just need to bump the chart version to satisfy the linter in CI.

@jszwedko jszwedko changed the title Allow external autoscaler enhancement(vector): Allow external autoscaler May 3, 2024
@srstrickland
Copy link
Contributor Author

srstrickland commented May 3, 2024

Ah, great... will do. Should I put in a note in the CHANGELOG.md as well? Side note: I see the current chart version is 0.32.2, but only 0.32.1 has been produced (and no note in changelog about 0.32.2). So I wasn't sure if you had an external release cycle. Let me know, happy to update anything.

(also thx for fixing PR title 😄)

@jszwedko
Copy link
Member

jszwedko commented May 3, 2024

Ah, great... will do. Should I put in a note in the CHANGELOG.md as well? Side note: I see the current chart version is 0.32.2, but only 0.32.1 has been produced (and no note in changelog about 0.32.2). So I wasn't sure if you had an external release cycle. Let me know, happy to update anything.

Ah, I missed the version was updated in another PR. This is a feature addition rather than a bug fix, though, so we should update to 0.33.0 to follow semver. The changelog is generated during release, from commit titles, so you don't have to update that.

When using any autoscaler, replicas should not be set on any Deployment
or StatefulSet. This helm chart has hooks for defining an HPA, but there
are times when users may want to create their own, or use something
external like [KEDA](https://keda.sh). In our case, we want to use KEDA
for scaling based on kafka lag and other triggers. This largely works as
expected, but I need to prevent the `replicas` field from being
populated, or else things appear out-of-sync when the external
autoscaler is doing its thing (we use ArgoCD and it will show the
project as out-of-sync because of replicas).

The feature here is just to offer an additional field under `autoscaling`
options: `external: true/false`.
@srstrickland srstrickland force-pushed the allow-external-autoscaler branch from 90855c1 to 174c756 Compare May 3, 2024 20:58
Signed-off-by: Jesse Szwedko <jesse.szwedko@datadoghq.com>
@jszwedko jszwedko enabled auto-merge (squash) May 3, 2024 21:03
@jszwedko jszwedko merged commit d03e980 into vectordotdev:develop May 3, 2024
11 checks passed
@srstrickland srstrickland deleted the allow-external-autoscaler branch May 3, 2024 21:18
@srstrickland
Copy link
Contributor Author

Any thoughts on when 0.33.0 will be published? It's not blocking me; I've published this update to our own internal repo, just would prefer to use the official one whenever it's available.

@jszwedko
Copy link
Member

jszwedko commented May 6, 2024

Any thoughts on when 0.33.0 will be published? It's not blocking me; I've published this update to our own internal repo, just would prefer to use the official one whenever it's available.

Should be this week!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants