Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Master shows duplicate minion IDs after being offline for a couple of hours #66406

Open
amalaguti opened this issue Apr 19, 2024 · 0 comments
Assignees
Labels
Bug broken, incorrect, or confusing behavior

Comments

@amalaguti
Copy link

Description
This is a weird one, the master was down for a couple of hours, after starting the master and running test.ping, the master shows multiple duplicate minion ID, minions are connected in multimaster configuration. This is not fixed until restarting the minions to force reconnection to the master.
Another weird issue, I see multiple start events from the minions (#66341).

All is hosted in Azure cloud (maybe the virtual network layer has anything to do ?), 3006.x versions.
I waited for about 10 minutes to see if it self heals, but the issue continued until restarting the minion.

[root@vesselsim ~]# salt \*-ems\* test.ping
vesselsim-win-ems-2:
    True
vesselsim-win-ems-2:
    True
vesselsim-win-ems-1:
    True
vesselsim-win-ems-1:
    True
[root@vesselsim ~]# salt \*-ems\* test.ping
vesselsim-win-ems-2:
    True
vesselsim-win-ems-2:
    True
vesselsim-win-ems-2:
    True
vesselsim-win-ems-1:
    True
vesselsim-win-ems-1:
    True
vesselsim-win-ems-1:
    True
[root@vesselsim ~]# salt \*-ems\* test.ping
vesselsim-win-ems-2:
    True
vesselsim-win-ems-2:
    True
vesselsim-win-ems-1:
    True
vesselsim-win-ems-1:
    True
[root@vesselsim ~]# salt \*-ems\* test.ping
vesselsim-win-ems-2:
    True
vesselsim-win-ems-2:
    True
vesselsim-win-ems-2:
    True
vesselsim-win-ems-1:
    True
vesselsim-win-ems-1:
    True
vesselsim-win-ems-1:
    True
[root@vesselsim ~]# salt \*-ems\* service.restart salt-minion --async
Executed command with job ID: 20240418151619456071


[root@vesselsim ~]# salt-run jobs.lookup_jid 20240418151619456071
vesselsim-win-ems-1:
    True
vesselsim-win-ems-2:
    True
[INFO    ] Runner completed: 20240418151634997026
[root@vesselsim ~]# salt \*-ems\* test.ping
vesselsim-win-ems-2:
    True
vesselsim-win-ems-1:
    True

[root@vesselsim ~]# salt \*-ems\* test.version
vesselsim-win-ems-2:
    3006.4
vesselsim-win-ems-1:
    3006.4
[root@vesselsim ~]# salt --version
salt 3006.4 (Sulfur)

@amalaguti amalaguti added Bug broken, incorrect, or confusing behavior needs-triage labels Apr 19, 2024
@dwoz dwoz removed the needs-triage label May 6, 2024
@dwoz dwoz self-assigned this May 6, 2024
@dwoz dwoz added this to the Sulfur v3006.9 milestone May 6, 2024
@dwoz dwoz modified the milestones: Sulfur v3006.9, Sulfur v3006.10 Jul 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug broken, incorrect, or confusing behavior
Projects
None yet
Development

No branches or pull requests

2 participants