Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recovery/Replication changes for Writable Warm Index #2

Draft
wants to merge 16 commits into
base: composite-directory-poc
Choose a base branch
from

Conversation

nisgoel-amazon
Copy link
Collaborator

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

rayshrey and others added 16 commits May 9, 2024 14:09
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
…RemoteStoreFileTrackerAdapter, CompositeDirectoryFactory and update Composite Directory implementation

Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
…ace to fetch an InputStream instead

Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
…teIndexInput

Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
…view fixes

Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
…ment fixes

Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
…til uploaded to Remote

Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
super.testDropPrimaryDuringReplication();
}

public void testPressureServiceStats() throws Exception {
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you don't need all these super calls, it will run all parent tests when you inherit it.


@OpenSearchIntegTestCase.ClusterScope(scope = OpenSearchIntegTestCase.Scope.TEST, numDataNodes = 0)
@ThreadLeakFilters(filters = CleanerDaemonThreadLeakFilter.class)
public class WarmIndexRemoteStoreSegmentReplicationIT extends SegmentReplicationIT {
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would prefer we add parameterization to SegmentReplicationIT or the remote store version that randomly enables writeable warm here vs duplicating the suite.

@rayshrey rayshrey force-pushed the composite-directory-poc branch from 78fee6e to fd20fad Compare May 30, 2024 08:19
@rayshrey rayshrey force-pushed the composite-directory-poc branch 3 times, most recently from 57eca38 to 901849b Compare June 20, 2024 07:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants