Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

There are always some nodes in NotReady state, reason: OutOfSync ;when resource Allocatable changed #1776

Closed
zishen opened this issue Oct 11, 2021 · 1 comment
Labels
kind/bug Categorizes issue or PR as related to a bug.

Comments

@zishen
Copy link
Contributor

zishen commented Oct 11, 2021

What happened:
I have the same issue:1506, when the node's resource in fault.
The phenomenon is the same:
Volcano scheduler continually warns:
"Failed to set node info, phase: NotReady, reason: OutOfSync"

Different from this issue, the NPU resource Capacity is not changed, but Allocatable do.

What you expected to happen:
node sysnyc normal when resource in fault.

How to reproduce it (as minimally and precisely as possible):

Anything else we need to know?:

Environment:

  • Volcano Version: v1.3.0
  • Kubernetes version (use kubectl version):1.17.3
  • Cloud provider or hardware configuration:
  • OS (e.g. from /etc/os-release):
  • Kernel (e.g. uname -a):
  • Install tools:
  • Others:
@zishen zishen added the kind/bug Categorizes issue or PR as related to a bug. label Oct 11, 2021
@zishen zishen closed this as completed Oct 14, 2021
@zishen
Copy link
Contributor Author

zishen commented Oct 14, 2021

have get reason1289
thanks @Thor-wl

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
Development

No branches or pull requests

1 participant