Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Meta] Enable multi-hop migration of data through snapshot-restore #23

Closed
1 of 3 tasks
kartg opened this issue Dec 1, 2022 · 4 comments
Closed
1 of 3 tasks

[Meta] Enable multi-hop migration of data through snapshot-restore #23

kartg opened this issue Dec 1, 2022 · 4 comments
Labels
enhancement New feature or request

Comments

@kartg
Copy link
Member

kartg commented Dec 1, 2022

This meta issue tracks feature work that enables customers to migrate their data from a cluster running on a legacy version to the latest version of OpenSearch, through the snapshot-restore mechanism.

This method could also be used for upgrading clusters in-place, but would result in downtime

@kartg kartg added the enhancement New feature or request label Dec 1, 2022
@kartg kartg changed the title [FEATURE] Enable searchable snapshots to access legacy indices [Meta] Enable multi-hop migration through snapshot-restore Dec 6, 2022
@kartg kartg changed the title [Meta] Enable multi-hop migration through snapshot-restore [Meta] Enable multi-hop migration of data through snapshot-restore Dec 6, 2022
@setiah
Copy link

setiah commented Dec 8, 2022

Enabling a legacy snapshot to restore on latest version of OpenSearch would enable users to migrate directly from previous versions of Elasticsearch and OpenSearch to the latest tip via the familiar Snapshot Restore process. I like the idea of solving 1 & 3 tasks first w.r.t. ES 6.x+ versions and later moving to expand this support with subtask 2 to more legacy versions. @kartg

@setiah
Copy link

setiah commented Dec 8, 2022

While snapshot restore is great option for lift-and-shift migrations, it would be exciting to see this functionality expanded to in-place upgrades as well as it provides zero downtime option for version migrations. Could we also track that as part of Multi-version meta issue?

@kartg
Copy link
Member Author

kartg commented Dec 20, 2022

Related - opensearch-project/OpenSearch#5443

@kartg
Copy link
Member Author

kartg commented Jan 20, 2023

Ownership of the extended compatibility of searchable snapshots has been moved to the core opensearch repo - opensearch-project/OpenSearch#5948

We will revisit reindexing of snapshots at a later time. Closing the issue.

@kartg kartg closed this as completed Jan 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants