BWC tests neural search

[vibrantvarun]

Description

Neural search transforms text into vectors and facilitates vector search both at ingestion time and at search time. During ingestion, neural search transforms document text into vector embeddings and indexes both the text and its vector embeddings in a vector index. When you use a neural query during search, neural search converts the query text into vector embeddings, uses vector search to compare the query and document embeddings, and returns the closest results.
Before you ingest documents into an index, documents are passed through a machine learning (ML) model, which generates vector embeddings for the document fields. When you send a search request, the query text or image is also passed through the ML model, which generates the corresponding vector embeddings. Then neural search performs a vector search on the embeddings and returns matching documents.

BWC stands for Backward Compatibility.

Since, neural search feature is launched there are many features added to it. Therefore, there is a need to write BWC tests for the plugin to maintain compatibility with older versions.

This PR contains

• Setting up architecture for BWC tests
• Optimizing the location of Common files used in BWC tests and Integ test framework
• Semantic search

Moreover, in this PR I have added work to format the entire project by apply ./gradlew spotlessApply to all files and remove empty new lines new lines added below. This will do the following

• User cannot add a new file without license header
• No wildcard imports
• Remove existing whitespaces and extra lines from the project

Issues Resolved

202

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed as per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (585fbbe) 84.33% compared to head (faa8dec) 84.33%.

Additional details and impacted files

@@            Coverage Diff            @@
##               main     #515   +/-   ##
=========================================
  Coverage     84.33%   84.33%           
  Complexity      533      533           
=========================================
  Files            40       40           
  Lines          1564     1564           
  Branches        244      244           
=========================================
  Hits           1319     1319           
  Misses          133      133           
  Partials        112      112           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[navneet1v]

Few minor comments. Overall code looks good.

Great effort in adding the spotlessCheck this was long pending. Code looks in awesome shape now.

[jmazanec15]

LGTM thanks!

[opensearch-trigger-bot]

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-2.x 2.x
# Navigate to the new working tree
cd .worktrees/backport-2.x
# Create a new branch
git switch --create backport/backport-515-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 ff3862250ccdae41798fe0787d4872a9b07ffe2d
# Push it to GitHub
git push --set-upstream origin backport/backport-515-to-2.x
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-515-to-2.x.

[vibrantvarun]

This PR also adds the feature request from #530