Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PROPOSAL] Add integration tests #277

Closed
dblock opened this issue May 1, 2024 · 1 comment
Closed

[PROPOSAL] Add integration tests #277

dblock opened this issue May 1, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@dblock
Copy link
Member

dblock commented May 1, 2024

What/Why

What are you proposing?

Coming from #271 (comment), we don't actually know whether the specs authored here are correct. Add integration tests that exercise these specs.

What users have asked for this feature?

See #271 (comment).

What problems are you trying to solve?

  • Test that the specs authored match what OpenSearch code is doing.
  • Early signal if OpenSearch is breaking specs.

What is the developer experience going to be?

Every PR will start various versions of OpenSearch, load the specs, run tests against the local version of OpenSearch.

What will it take to execute?

Unsure. Maybe there's an existing tool? Otherwise I would start with something simple that executes all GET requests and compares outputs against a previous recording. Then author requests/responses and compare. Finally, we need coverage to know how many of the APIs are invoked, how many request/response bodies are matched.

@dblock
Copy link
Member Author

dblock commented Jun 4, 2024

Closing via #299.

@dblock dblock closed this as completed Jun 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant