Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Observability AI Assistant] Add tests for serverless projects #180925

Open
miltonhultgren opened this issue Apr 16, 2024 · 4 comments
Open

[Observability AI Assistant] Add tests for serverless projects #180925

miltonhultgren opened this issue Apr 16, 2024 · 4 comments
Labels
Team:Obs AI Assistant Observability AI Assistant
Milestone

Comments

@miltonhultgren
Copy link
Contributor

miltonhultgren commented Apr 16, 2024

Summary

With most of our features being available in serverless Observability projects we should have some test automation in place to make sure it doesn't break without us noticing.

Adding tests for serverless is the same as adding tests for stateful but in a different folder xpack/test_serverless/functional/test_suites/observability but these test suites cannot rely on any test tools available in stateful tests.

So we need to decide on either duplicating all of our setup and helper code or extract that code into packages and refactor the existing stateful tests to use those packages instead before adding serverless tests.

Notes

While testing ELSER (TINY_ELSER) in a Serverless project, we need to call await ml.api.assureMlStatsIndexExists(); before importing the model, not after as the other (non-serverless) ML tests show.

@miltonhultgren miltonhultgren added the Team:obs-knowledge Observability Experience Knowledge team label Apr 16, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-knowledge-team (Team:obs-knowledge)

@emma-raffenne emma-raffenne added this to the 8.15 milestone Apr 18, 2024
@emma-raffenne emma-raffenne added Team:Obs AI Assistant Observability AI Assistant and removed Team:obs-knowledge Observability Experience Knowledge team labels Jun 26, 2024
@emma-raffenne emma-raffenne modified the milestones: 8.15, 8.16 Jul 11, 2024
@neptunian neptunian self-assigned this Jul 24, 2024
@neptunian neptunian changed the title [Observability AI Assistant] Add smoke tests for serverless projects [Observability AI Assistant] Add tests for serverless projects Jul 24, 2024
@neptunian
Copy link
Contributor

QAF issue to add custom config to the MKI pipeline https://github.com/elastic/qaf-tests/issues/126

@emma-raffenne
Copy link
Contributor

emma-raffenne commented Oct 22, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Obs AI Assistant Observability AI Assistant
Projects
None yet
Development

No branches or pull requests

4 participants