[Remote Store] Garbage Collection for Remote Backed Storage #8378
Labels
enhancement
Enhancement or improvement to existing feature or request
Storage:Durability
Issues and PRs related to the durability framework
Storage
Issues and PRs relating to data and metadata storage
Is your feature request related to a problem? Please describe.
As part of #8201 we are moving stale commit deletion to asynchronous flow. Its possible that there can be files which doesn't get deleted from remote store due asynchronous nature.
Eg - If the deletion fails while closing an index this might lead to lingering files present in S3.
Describe the solution you'd like
A background time based job which will try to keep only the files which are referenced locally and delete anything which is not referenced from remote store.
The text was updated successfully, but these errors were encountered: