Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] [Remote Store] [Auto Restore] Recover indices to green state after quorum loss recovery in remote backed clusters #9985

Closed
linuxpi opened this issue Sep 12, 2023 · 0 comments
Labels
bug Something isn't working Storage:Remote untriaged

Comments

@linuxpi
Copy link
Collaborator

linuxpi commented Sep 12, 2023

Describe the bug

  • During cluster state recovery, if cluster state is recovered from local disk, all shards would be initialized with ExistingStoreRecoverySource
  • This leads to shards being in unassigned state and index in red. We manually trigger _remotestore/_restore for such indices after recovery to turn them green.
  • For Remote backed shards ExistingStoreRecoverySource is not the best RecoverySource, they should be initialized with RemoteStoreRecoverySource once we have completed [Remote Store] Optimize remote store restore flow to not download all the files from remote if local disk already has data #9984
  • This will allow us to skip the _remotestore/_restore call when cluster state is recovered from local disk after quorum loss

Expected behavior
After quorum loss recovery, if cluster state is recovered from local disk, remote backed indices should turn up green automatically

@linuxpi linuxpi added bug Something isn't working untriaged labels Sep 12, 2023
@linuxpi linuxpi changed the title [BUG] [Remote Store] [Auto Restore] During cluster state recovery, if cluster state is recovered from local disk, all shards would be initialized with [BUG] [Remote Store] [Auto Restore] Recover indices to green state after quorum loss recovery in remote backed clusters Sep 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Storage:Remote untriaged
Projects
None yet
Development

No branches or pull requests

4 participants