Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[META] Searchable Snapshot Tracking Issue #2919

Closed
22 tasks done
andrross opened this issue Apr 15, 2022 · 1 comment
Closed
22 tasks done

[META] Searchable Snapshot Tracking Issue #2919

andrross opened this issue Apr 15, 2022 · 1 comment
Labels
distributed framework enhancement Enhancement or improvement to existing feature or request Meta Meta issue, not directly linked to a PR v2.4.0 'Issues and PRs related to version v2.4.0'

Comments

@andrross
Copy link
Member

andrross commented Apr 15, 2022 •
edited
Loading

Issues:
@andrross andrross added enhancement Enhancement or improvement to existing feature or request Meta Meta issue, not directly linked to a PR distributed framework labels Apr 15, 2022
@andrross andrross mentioned this issue Jun 29, 2022
Open
@andrross andrross changed the title [META] Searchable Remote Index Tracking Issue [META] Searchable Snapshot Tracking Issue Jun 29, 2022
@kotwanikunal kotwanikunal mentioned this issue Jul 12, 2022
Closed
@andrross andrross mentioned this issue Jul 15, 2022
Closed
1 task
@kotwanikunal kotwanikunal mentioned this issue Aug 5, 2022
Closed
@kotwanikunal kotwanikunal mentioned this issue Sep 30, 2022
Closed
@andrross andrross mentioned this issue Sep 30, 2022
Closed
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 4, 2022
@andrross
Introduce experimental searchable snapshot API
aaf753d 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 4, 2022
@andrross
Introduce experimental searchable snapshot API
4e25290 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 4, 2022
@andrross
Introduce experimental searchable snapshot API
251c152 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 4, 2022
@andrross
Introduce experimental searchable snapshot API
29c9ecf 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 4, 2022
@andrross
Introduce experimental searchable snapshot API
69b40cd 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
@andrross andrross mentioned this issue Oct 4, 2022
Merged
6 tasks
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 4, 2022
@andrross
Introduce experimental searchable snapshot API
482dad4 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 4, 2022
@andrross
Introduce experimental searchable snapshot API
520b3d2 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 4, 2022
@andrross
Introduce experimental searchable snapshot API
438082d 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 6, 2022
@andrross
Introduce experimental searchable snapshot API
fae136b 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 7, 2022
@andrross
Introduce experimental searchable snapshot API
b51d74a 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 7, 2022
@andrross
Introduce experimental searchable snapshot API
10f000f 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
@elfisher
Copy link

@andrross can we add the label for 2.4?

andrross added a commit to andrross/OpenSearch that referenced this issue Oct 13, 2022
@andrross
Introduce experimental searchable snapshot API
5fcc653 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 13, 2022
@andrross
Introduce experimental searchable snapshot API
af1a0b5 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 13, 2022
@andrross
Introduce experimental searchable snapshot API
4bfe3de 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit that referenced this issue Oct 13, 2022
@andrross
Introduce experimental searchable snapshot API (#4680)
431bdeb 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue #2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>

Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross added a commit to andrross/OpenSearch that referenced this issue Oct 13, 2022
@andrross
Introduce experimental searchable snapshot API (opensearch-project#4680)
e29ff3d 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>

Signed-off-by: Andrew Ross <andrross@amazon.com>
(cherry picked from commit 431bdeb)
andrross added a commit that referenced this issue Oct 13, 2022
@andrross
[Backport 2.x] Introduce experimental searchable snapshot API (#4780)
50225cb 
* Introduce experimental searchable snapshot API (#4680)

This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue #2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>

Signed-off-by: Andrew Ross <andrross@amazon.com>
(cherry picked from commit 431bdeb)

* Fix assertion in test of ShardStateMetadata (#4774)

This test randomly fails if the enum selected isn't the same as the one
choosen by the legacy constructor.

Signed-off-by: Andrew Ross <andrross@amazon.com>

Signed-off-by: Andrew Ross <andrross@amazon.com>
(cherry picked from commit 1a7aaba)

* Update version check for 2.4

Checking on or after version 3.0 does not work (or make sense) since
this is on the 2.x branch.

Signed-off-by: Andrew Ross <andrross@amazon.com>

Signed-off-by: Andrew Ross <andrross@amazon.com>
@anasalkouz anasalkouz moved this to In Progress in Searchable Snapshots Oct 14, 2022
@anasalkouz anasalkouz added the v2.4.0 'Issues and PRs related to version v2.4.0' label Oct 25, 2022
@andrross andrross mentioned this issue Nov 3, 2022
Closed
@andrross andrross closed this as completed Nov 4, 2022
Repository owner moved this from In Progress to Done in Searchable Snapshots Nov 4, 2022
ashking94 pushed a commit to ashking94/OpenSearch that referenced this issue Nov 7, 2022
@andrross @ashking94
Introduce experimental searchable snapshot API (opensearch-project#4680)
abb2fa2 
This commit adds a new parameter to the snapshot restore API to restore
to a new type of "remote snapshot" index where, unlike traditional
snapshot restores, the index data is not all downloaded to disk and
instead is read on-demand at search time. The feature is functional with
this commit, and includes a simple end-to-end integration test, but is
far from complete. See tracking issue opensearch-project#2919 for the rest of the work
planned/underway.

All new capabilities are gated behind a new searchable snapshot feature
flag.

Signed-off-by: Andrew Ross <andrross@amazon.com>

Signed-off-by: Andrew Ross <andrross@amazon.com>
@kasundra07 kasundra07 mentioned this issue Nov 27, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
distributed framework enhancement Enhancement or improvement to existing feature or request Meta Meta issue, not directly linked to a PR v2.4.0 'Issues and PRs related to version v2.4.0'
Projects
Searchable Snapshots
Status: Done
Milestone
No milestone
Development

No branches or pull requests
3 participants
@andrross @elfisher @anasalkouz