Add BWC tests for running against distribution bundle. #1209

zelinh · 2022-12-23T23:10:15Z

Description

Add option to run BWC tests in distribution level, which is running tests in the test cluster with latest distribution bundle installed and all plugins (included in the latest manifest) present.

The command to run BWC tests in distribution level would be ./gradlew bwcTestSuite -Dtests.security.manager=false -PcustomDistributionDownloadType=bundle
If property customDistributionDownloadType is not set nor set to bundle, the BWC tests would be default to run in plugins level as previously configured.

This won't affect current plugin level tests written in the ./scripts/bwctest.sh.

Issues Resolved

Part of opensearch-project/opensearch-build#2870

Check List

New functionality includes testing.
- All tests pass, including unit test, integration test and doctest
New functionality has been documented.
- New functionality has javadoc added
- New functionality has user manual doc added
Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

codecov-commenter · 2022-12-23T23:18:51Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.84%. Comparing base (13474e3) to head (1b4fe77).
Report is 387 commits behind head on 2.x.

Additional details and impacted files

@@             Coverage Diff              @@
##                2.x    #1209      +/-   ##
============================================
- Coverage     98.32%   95.84%   -2.49%     
- Complexity     3553     3555       +2     
============================================
  Files           346      356      +10     
  Lines          8760     9426     +666     
  Branches        555      673     +118     
============================================
+ Hits           8613     9034     +421     
- Misses          142      334     +192     
- Partials          5       58      +53

Flag	Coverage Δ
query-workbench	`62.76% <ø> (?)`
sql-engine	`98.32% <ø> (+<0.01%)`	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

integ-test/build.gradle

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

penghuo

Thanks for the change!

Signed-off-by: Zelin Hao <zelinhao@amazon.com> (cherry picked from commit 3ab1f78)

Signed-off-by: Zelin Hao <zelinhao@amazon.com> (cherry picked from commit 3ab1f78) Signed-off-by: Zelin Hao <zelinhao@amazon.com>

* Add BWC tests for running against distribution bundle. (#1209) Signed-off-by: Zelin Hao <zelinhao@amazon.com> * Add Alternate Syntax For Match_Query And Other Functions (#1166) Added Tests And Implementation For Match_Query, Match_Phrase, and Multi_Match Functions Signed-off-by: GabeFernandez310 <gabrielf@bitquilltech.com> Signed-off-by: GabeFernandez310 <gabrielf@bitquilltech.com> Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> * Merge pull request #1241 from Bit-Quill/Failing-CI-Hot-Fix Hot Fix For CI Build (cherry picked from commit aae57a0) Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> * Fixed error with single timestamp query (#1244) (#1246) Signed-off-by: vamsi-amazon <reddyvam@amazon.com> Signed-off-by: vamsi-amazon <reddyvam@amazon.com> (cherry picked from commit ee949cc) Co-authored-by: vamsi-amazon <reddyvam@amazon.com> * Add Second_Of_Minute Function As An Alias Of The Second Function (#1231) (#1237) Added Testing And Implementation For Second_Of_Minute Function Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> (cherry picked from commit dce7d0e) Co-authored-by: GabeFernandez310 <gabrielf@bitquilltech.com> * Add functions `ADDTIME` and `SUBTIME`. (#132) (#1194) (#1252) * Add functions `ADDTIME` and `SUBTIME`. (#132) Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com> (cherry picked from commit 7630f87) Co-authored-by: Yury-Fridlyand <yury.fridlyand@improving.com> * Add Day_Of_Week Function As An Alias Of DayOfWeek (#190) (#1228) (#1239) Added Implementation And Testing For Day_Of_Week Function Signed-off-by: GabeFernandez310 <gabrielf@bitquilltech.com> Signed-off-by: GabeFernandez310 <gabrielf@bitquilltech.com> (cherry picked from commit bac9c37) Co-authored-by: GabeFernandez310 <gabrielf@bitquilltech.com> * [Backport 2.x] Add Minute_Of_Hour Function As An Alias Of Minute Function (#1253) * Add Minute_Of_Hour Function As An Alias Of Minute Function (#196) (#1230) Added Testing And Implementation For Minute_Of_Hour Function Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> (cherry picked from commit 61e2374) * Added Missing Imports Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> * Add support for long value return for CEIL, CEILING and FLOOR math functions (#1205) (#1255) * Added long fix for CEIL, CEILING and FLOOR functions using LONG instead of INT for RETURN. Signed-off-by: MitchellGale-BitQuill <mitchellg@bitquilltech.com> Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com> Co-authored-by: Yury-Fridlyand <yury.fridlyand@improving.com> * Support JOIN query on object field with unexpanded name (#1229) (#1250) * Resolve sub object field in search hit source Signed-off-by: Chen Dai <daichen@amazon.com> * Rename to unexpanded object Signed-off-by: Chen Dai <daichen@amazon.com> * Update IT with where condition Signed-off-by: Chen Dai <daichen@amazon.com> * Fix test index mapping Signed-off-by: Chen Dai <daichen@amazon.com> Signed-off-by: Chen Dai <daichen@amazon.com> (cherry picked from commit 151f4cc) Co-authored-by: Chen Dai <daichen@amazon.com> * Remove unnecessary scripts after repo split (#1256) Signed-off-by: Joshua Li <joshuali925@gmail.com> * Add Support For `TIME` Type in "*_OF_YEAR" Functions (#199) (#1223) (#1258) Added Support And Tests For Time Type in day_of_year, week_of_year, month_of_year Functions Signed-off-by: GabeFernandez310 <gabrielf@bitquilltech.com> (cherry picked from commit 6e72f18) Co-authored-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> Signed-off-by: Zelin Hao <zelinhao@amazon.com> Signed-off-by: GabeFernandez310 <gabrielf@bitquilltech.com> Signed-off-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> Signed-off-by: MitchellGale-BitQuill <mitchellg@bitquilltech.com> Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com> Signed-off-by: Joshua Li <joshuali925@gmail.com> Co-authored-by: Zelin Hao <87548827+zelinh@users.noreply.github.com> Co-authored-by: GabeFernandez310 <gabrielf@bitquilltech.com> Co-authored-by: YANGDB <yang.db.dev@gmail.com> Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> Co-authored-by: vamsi-amazon <reddyvam@amazon.com> Co-authored-by: Yury-Fridlyand <yury.fridlyand@improving.com> Co-authored-by: GabeFernandez310 <Gabriel.Fernandez@improving.com> Co-authored-by: Chen Dai <daichen@amazon.com> Co-authored-by: Joshua Li <joshuali925@gmail.com>

zelinh added 2 commits December 22, 2022 14:44

Add tests for bundle

3f6983f

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

Modification

a7b5a24

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

zelinh requested a review from a team as a code owner December 23, 2022 23:10

penghuo reviewed Jan 3, 2023

View reviewed changes

integ-test/build.gradle Outdated Show resolved Hide resolved

Update the current version derived from opensearch_version

1b4fe77

Signed-off-by: Zelin Hao <zelinhao@amazon.com>

penghuo approved these changes Jan 6, 2023

View reviewed changes

dai-chen added the infrastructure Changes to infrastructure, testing, CI/CD, pipelines, etc. label Jan 7, 2023

dai-chen approved these changes Jan 7, 2023

View reviewed changes

penghuo merged commit 3ab1f78 into opensearch-project:2.x Jan 7, 2023

penghuo added the v2.5.0 'Issues and PRs related to version v2.5.0' label Jan 7, 2023

zelinh added the backport 2.5 label Jan 10, 2023

opensearch-trigger-bot bot mentioned this pull request Jan 10, 2023

[Backport 2.5] Add BWC tests for running against distribution bundle. #1259

Closed

opensearch-trigger-bot bot pushed a commit that referenced this pull request Jan 10, 2023

Add BWC tests for running against distribution bundle. (#1209)

24fddf7

Signed-off-by: Zelin Hao <zelinhao@amazon.com> (cherry picked from commit 3ab1f78)

zelinh added a commit that referenced this pull request Jan 10, 2023

Add BWC tests for running against distribution bundle. (#1209)

d9e691b

Signed-off-by: Zelin Hao <zelinhao@amazon.com> (cherry picked from commit 3ab1f78) Signed-off-by: Zelin Hao <zelinhao@amazon.com>

zelinh mentioned this pull request Jan 23, 2024

[FEATURE] Onboard distribution level BWC bundle test opensearch-project/reporting#946

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add BWC tests for running against distribution bundle. #1209

Add BWC tests for running against distribution bundle. #1209

zelinh commented Dec 23, 2022

codecov-commenter commented Dec 23, 2022 •

edited by codecov bot

Loading

penghuo left a comment

Add BWC tests for running against distribution bundle. #1209

Add BWC tests for running against distribution bundle. #1209

Conversation

zelinh commented Dec 23, 2022

Description

Issues Resolved

Check List

codecov-commenter commented Dec 23, 2022 • edited by codecov bot Loading

Codecov Report

penghuo left a comment

Choose a reason for hiding this comment

codecov-commenter commented Dec 23, 2022 •

edited by codecov bot

Loading