-
Notifications
You must be signed in to change notification settings - Fork 72
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Initial commit for adding BWC tests in neural search plugin (#515)
* Reformatting test package Signed-off-by: Varun Jain <varunudr@amazon.com> * Initial commit of BWC Test Signed-off-by: Varun Jain <varunudr@amazon.com> * Text Search Signed-off-by: Varun Jain <varunudr@amazon.com> * Fixing bug Signed-off-by: Varun Jain <varunudr@amazon.com> * Text Search bug fix Signed-off-by: Varun Jain <varunudr@amazon.com> * Adding windows platform in bwc Signed-off-by: Varun Jain <varunudr@amazon.com> * Adding windows platform in bwc Signed-off-by: Varun Jain <varunudr@amazon.com> * Rolling Upgrade tests Signed-off-by: Varun Jain <varunudr@amazon.com> * Bux Fix in rolling upgrade Signed-off-by: Varun Jain <varunudr@amazon.com> * Bug Fix Rolling Upgrade Signed-off-by: Varun Jain <varunudr@amazon.com> * Fixing Flaky tests Signed-off-by: Varun Jain <varunudr@amazon.com> * Updating BWC version to latest Signed-off-by: Varun Jain <varunudr@amazon.com> * Fixing bwc test Signed-off-by: Varun Jain <varunudr@amazon.com> * Semantic Search Signed-off-by: Varun Jain <varunudr@amazon.com> * Bug Fix Signed-off-by: Varun Jain <varunudr@amazon.com> * Debugging Signed-off-by: Varun Jain <varunudr@amazon.com> * Bug Fix Signed-off-by: Varun Jain <varunudr@amazon.com> * Increase memory in nodes Signed-off-by: Varun Jain <varunudr@amazon.com> * Removing extra logging Signed-off-by: Varun Jain <varunudr@amazon.com> * Cleaning up Signed-off-by: Varun Jain <varunudr@amazon.com> * Updating Pipeline Configuration Signed-off-by: Varun Jain <varunudr@amazon.com> * Remove KNN delete models Signed-off-by: Varun Jain <varunudr@amazon.com> * Remove unecessary KNN code Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing comments of naveen Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing comments of naveen Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing comments of Naveen Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing martin comments Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing comments of martin Signed-off-by: Varun Jain <varunudr@amazon.com> * Apply formatting.xml in all lines Signed-off-by: Varun Jain <varunudr@amazon.com> * Removing extra spacess from formatting.gradle Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing martin comment Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing Jack comments Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing Jack comments Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing Jack's comments Signed-off-by: Varun Jain <varunudr@amazon.com> * Fixing Test cases Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing comments of Navneet Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing comments of Navneet Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing comments of Navneet Signed-off-by: Varun Jain <varunudr@amazon.com> * Addressing comments of Navneet Signed-off-by: Varun Jain <varunudr@amazon.com> * Removing extra parameter from createPipelineProcessor Signed-off-by: Varun Jain <varunudr@amazon.com> * Fixing bug Signed-off-by: Varun Jain <varunudr@amazon.com> * Increasing number of shards Signed-off-by: Varun Jain <varunudr@amazon.com> * Bug fix of load model id Signed-off-by: Varun Jain <varunudr@amazon.com> * Changing names of tests to TextEmbeddingPRocessor Signed-off-by: Varun Jain <varunudr@amazon.com> * Updating indexes and replicas Signed-off-by: Varun Jain <varunudr@amazon.com> --------- Signed-off-by: Varun Jain <varunudr@amazon.com>
- Loading branch information
1 parent
585fbbe
commit ff38622
Showing
135 changed files
with
1,215 additions
and
211 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -37,4 +37,4 @@ categories: | |
| - 'Maintenance' | ||
| - title: 'Refactoring' | ||
| labels: | ||
| - 'Refactoring' | ||
| - 'Refactoring' | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,19 +1,19 @@ | ||
| name: Apply 'untriaged' label during issue lifecycle | ||
|
|
||
| on: | ||
| issues: | ||
| types: [opened, reopened, transferred] | ||
|
|
||
| jobs: | ||
| apply-label: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - uses: actions/github-script@v6 | ||
| with: | ||
| script: | | ||
| github.rest.issues.addLabels({ | ||
| issue_number: context.issue.number, | ||
| owner: context.repo.owner, | ||
| repo: context.repo.repo, | ||
| labels: ['untriaged'] | ||
| }) | ||
| name: Apply 'untriaged' label during issue lifecycle | ||
|
|
||
| on: | ||
| issues: | ||
| types: [opened, reopened, transferred] | ||
|
|
||
| jobs: | ||
| apply-label: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - uses: actions/github-script@v6 | ||
| with: | ||
| script: | | ||
| github.rest.issues.addLabels({ | ||
| issue_number: context.issue.number, | ||
| owner: context.repo.owner, | ||
| repo: context.repo.repo, | ||
| labels: ['untriaged'] | ||
| }) |
65 changes: 65 additions & 0 deletions
65
.github/workflows/backwards_compatibility_tests_workflow.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,65 @@ | ||
| name: Backwards Compatibility Tests NeuralSearch | ||
| on: | ||
| push: | ||
| branches: | ||
| - "*" | ||
| - "feature/**" | ||
| pull_request: | ||
| branches: | ||
| - "*" | ||
| - "feature/**" | ||
|
|
||
| jobs: | ||
| Restart-Upgrade-BWCTests-NeuralSearch: | ||
| strategy: | ||
| matrix: | ||
| java: [ 11, 17, 21 ] | ||
| os: [ubuntu-latest,windows-latest] | ||
| bwc_version : ["2.9.0","2.10.0","2.11.0","2.12.0-SNAPSHOT"] | ||
| opensearch_version : [ "3.0.0-SNAPSHOT" ] | ||
|
|
||
| name: NeuralSearch Restart-Upgrade BWC Tests | ||
| runs-on: ${{ matrix.os }} | ||
| env: | ||
| BWC_VERSION_RESTART_UPGRADE: ${{ matrix.bwc_version }} | ||
|
|
||
| steps: | ||
| - name: Checkout NeuralSearch | ||
| uses: actions/checkout@v1 | ||
|
|
||
| - name: Setup Java ${{ matrix.java }} | ||
| uses: actions/setup-java@v1 | ||
| with: | ||
| java-version: ${{ matrix.java }} | ||
|
|
||
| - name: Run NeuralSearch Restart-Upgrade BWC Tests from BWCVersion-${{ matrix.bwc_version }} to OpenSearch Version-${{ matrix.opensearch_version }} on ${{matrix.os}} | ||
| run: | | ||
| echo "Running restart-upgrade backwards compatibility tests ..." | ||
| ./gradlew :qa:restart-upgrade:testAgainstNewCluster -D'tests.bwc.version=${{ matrix.bwc_version }}' | ||
| Rolling-Upgrade-BWCTests-NeuralSearch: | ||
| strategy: | ||
| matrix: | ||
| java: [ 11, 17, 21 ] | ||
| os: [ubuntu-latest,windows-latest] | ||
| bwc_version: [ "2.12.0-SNAPSHOT" ] | ||
| opensearch_version: [ "3.0.0-SNAPSHOT" ] | ||
|
|
||
| name: NeuralSearch Rolling-Upgrade BWC Tests | ||
| runs-on: ${{ matrix.os }} | ||
| env: | ||
| BWC_VERSION_ROLLING_UPGRADE: ${{ matrix.bwc_version }} | ||
|
|
||
| steps: | ||
| - name: Checkout NeuralSearch | ||
| uses: actions/checkout@v1 | ||
|
|
||
| - name: Setup Java ${{ matrix.java }} | ||
| uses: actions/setup-java@v1 | ||
| with: | ||
| java-version: ${{ matrix.java }} | ||
|
|
||
| - name: Run NeuralSearch Rolling-Upgrade BWC Tests from BWCVersion-${{ matrix.bwc_version }} to OpenSearch Version-${{ matrix.opensearch_version }} on ${{matrix.os}} | ||
| run: | | ||
| echo "Running rolling-upgrade backwards compatibility tests ..." | ||
| ./gradlew :qa:rolling-upgrade:testRollingUpgrade -D'tests.bwc.version=${{ matrix.bwc_version }}' |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,4 @@ | ||
| /* | ||
| * Copyright OpenSearch Contributors | ||
| * SPDX-License-Identifier: Apache-2.0 | ||
| */ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,32 @@ | ||
| allprojects { | ||
| project.apply plugin: "com.diffplug.spotless" | ||
| spotless { | ||
| java { | ||
| // Normally this isn't necessary, but we have Java sources in | ||
| // non-standard places | ||
| target '**/*.java' | ||
|
|
||
| removeUnusedImports() | ||
| eclipse().configFile rootProject.file('formatter/formatterConfig.xml') | ||
| trimTrailingWhitespace() | ||
| endWithNewline(); | ||
|
|
||
| custom 'Refuse wildcard imports', { | ||
| // Wildcard imports can't be resolved; fail the build | ||
| if (it =~ /\s+import .*\*;/) { | ||
| throw new AssertionError("Do not use wildcard imports. 'spotlessApply' cannot resolve this issue.") | ||
| } | ||
| } | ||
| } | ||
| format 'misc', { | ||
| target '*.md', '**/*.gradle', '**/*.json', '**/*.yaml', '**/*.yml', '**/*.svg' | ||
|
|
||
| trimTrailingWhitespace() | ||
| endWithNewline() | ||
| } | ||
| format("license", { | ||
| licenseHeaderFile("${rootProject.file("formatter/license-header.txt")}", "package "); | ||
| target("src/*/java/**/*.java","qa/*/java/**/*.java") | ||
| }) | ||
| } | ||
| } |
Oops, something went wrong.