Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws: fix maxPods when cilium ipam=eni is used #16253

Merged

Conversation

argusua
Copy link
Contributor

@argusua argusua commented Jan 15, 2024

What does this PR introduce?
This PR addresses the issue where kubelet is configured with maxPods 100 in the AWS environment and when cilium with ipam=eni is used.

Why is this change needed?
The number of IP addresses is connected to the AWS instance type and is much less than 100 which is the default maxPods value. So, for small instance types we in most cases end up with the pod not being able to schedule because of 'No IP's left to assign on aws instances'

How does it address the issue?
We use the same code to determine maxPods per AWS instance type as for amazonvpc networking.

Related Issue
Fixes #16064

Copy link

linux-foundation-easycla bot commented Jan 15, 2024

CLA Signed

The committers listed above are authorized under a signed CLA.

  • ✅ login: argusua / name: Dmytro Kozlovskyi (d9075f1)

@k8s-ci-robot k8s-ci-robot added the cncf-cla: no Indicates the PR's author has not signed the CNCF CLA. label Jan 15, 2024
@k8s-ci-robot
Copy link
Contributor

Welcome @argusua!

It looks like this is your first PR to kubernetes/kops 🎉. Please refer to our pull request process documentation to help your PR have a smooth ride to approval.

You will be prompted by a bot to use commands during the review process. Do not be afraid to follow the prompts! It is okay to experiment. Here is the bot commands documentation.

You can also check if kubernetes/kops has its own contribution guidelines.

You may want to refer to our testing guide if you run into trouble with your tests not passing.

If you are having difficulty getting your pull request seen, please follow the recommended escalation practices. Also, for tips and tricks in the contribution process you may want to read the Kubernetes contributor cheat sheet. We want to make sure your contribution gets all the attention it needs!

Thank you, and welcome to Kubernetes. 😃

@k8s-ci-robot k8s-ci-robot added needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Jan 15, 2024
@k8s-ci-robot
Copy link
Contributor

Hi @argusua. Thanks for your PR.

I'm waiting for a kubernetes member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@hakman
Copy link
Member

hakman commented Jan 15, 2024

Hi @argusua. Thanks for taking the time to submit a PR.
Please sign the CLA to be able to accept it.

@argusua argusua force-pushed the fix-max-pods-when-cilium-ipam-eni-used branch from 17c0c5b to 191add6 Compare January 16, 2024 09:58
@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. and removed cncf-cla: no Indicates the PR's author has not signed the CNCF CLA. labels Jan 16, 2024
@argusua argusua force-pushed the fix-max-pods-when-cilium-ipam-eni-used branch from 191add6 to aa26093 Compare January 16, 2024 10:03
@argusua
Copy link
Contributor Author

argusua commented Jan 16, 2024

Hi @argusua. Thanks for taking the time to submit a PR. Please sign the CLA to be able to accept it.

Done.

@argusua argusua force-pushed the fix-max-pods-when-cilium-ipam-eni-used branch from aa26093 to 7050b01 Compare January 16, 2024 10:04
@hakman
Copy link
Member

hakman commented Jan 16, 2024

/ok-to-test

@k8s-ci-robot k8s-ci-robot added ok-to-test Indicates a non-member PR verified by an org member that is safe to test. and removed needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Jan 16, 2024
@argusua
Copy link
Contributor Author

argusua commented Jan 17, 2024

Can someone help with failed tests? Because for me it's not clear why they are failing. I've tried building and running nodeup on my test cluster with amazonvpc and cilium cni and it works correctly.

nodeup/pkg/model/kubelet.go Outdated Show resolved Hide resolved
@argusua
Copy link
Contributor Author

argusua commented Jan 17, 2024

Thanks, @hakman It was also my thought but not clear why I can't recreate this on my local cluster. Anyway, I've commited your suggestion. Let's if this helps.

@argusua
Copy link
Contributor Author

argusua commented Jan 17, 2024

/retest-required

@argusua
Copy link
Contributor Author

argusua commented Jan 17, 2024

/test pull-kops-e2e-k8s-aws-calico

@argusua
Copy link
Contributor Author

argusua commented Jan 17, 2024

Hi, @hakman
Was able to recreate the issue locally too, and your suggestion has fixed it. Also, looks like the tests here are green now. Thanks.

@hakman
Copy link
Member

hakman commented Jan 17, 2024

Thanks @argusua. If you don't mind, could you also squash the commits?

Co-authored-by: Ciprian Hacman <ciprian@hakman.dev>
@argusua argusua force-pushed the fix-max-pods-when-cilium-ipam-eni-used branch from 2f0e6b7 to d9075f1 Compare January 17, 2024 14:15
@argusua argusua requested a review from hakman January 17, 2024 14:16
@argusua
Copy link
Contributor Author

argusua commented Jan 17, 2024

Hi, @hakman
Done

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jan 17, 2024
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: hakman

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jan 17, 2024
@k8s-ci-robot k8s-ci-robot merged commit 82f4082 into kubernetes:master Jan 17, 2024
22 checks passed
@k8s-ci-robot k8s-ci-robot added this to the v1.29 milestone Jan 17, 2024
@argusua argusua deleted the fix-max-pods-when-cilium-ipam-eni-used branch January 17, 2024 15:21
k8s-ci-robot added a commit that referenced this pull request Jan 19, 2024
…16253-upstream-release-1.28

Automated cherry pick of #16216: aws: Retrieve instance info only when max pods is not set
#16253: aws: fix maxPods when cilium ipam is used
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/nodeup cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cilium , No IP's left to assign on aws instances
3 participants