-
Notifications
You must be signed in to change notification settings - Fork 224
pkg/assets/internal: Remove critical pod annotations #777
pkg/assets/internal: Remove critical pod annotations #777
Conversation
Rebased. |
Do I read it right, that annotations are removed just to make rescheduler happier? It is confusing, bootkube and rescheduler are different projects, bootkube doesn't install rescheduler into cluster by default, why bootkube is making changes, not rescheduler is improving? I am concerned, because removed annotations are used by kuberneted itself, when |
@redbaron as discussed in #519 (comment), the rescheduler is actually dangerous in self-hosted clusters, and it will be replaced by priorities anyway (see comments from bsalamat in that thread). Since bootkube has never shipped the rescheduler or enabled experimental features it was deemed prudent to remove the annotations. If you are deciding to run the rescheduler and accept the risks associated with it you are of course welcome to add the annotations to your deployment. |
That is what I thought too, I am not running rescheduller. My point is, that removed annotations are used by kubernetes itself, not rescheduler. These anontations are taken into account when kubelet evicts pods when it is under disk space pressure. So these annotations are useful and their removal makes self hosted setup less safe |
@diegs @dghubble @redbaron @aaronlevy The This comment and code block is particularly relevant and shows that without the feature flag and without the annotation, static pods could be evicted, and will not be re-admitted. |
Supercedes #728 and should remove all critical annotations on the control plane as requested.
Broader discussion and rationale: