Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Functional tests - split ML test groups #131716

Merged
merged 15 commits into from
May 9, 2022

Conversation

pheyos
Copy link
Member

@pheyos pheyos commented May 6, 2022

Summary

This PR splits up the ML functional UI test groups and renames them to better match the contained test suites.

Details

  • Follow-up on [ftr] automatically determine config run order #130983

  • Rename test tag mlqa to ml

  • Set group specific junit report names

  • Test group changes in x-pack/test/functional/apps/ml:

    • group2 contained only anomaly_detection anyway, renamed

    • Runtime of data_frame_analytics, permissions and stack_management_jobs is long enough to justify a separate group

    • Suites with less than 3 minutes runtime are grouped into short_tests (there's a ~1 minute CI overhead for running a group, so splitting up the short_tests even more is not ideal - we'll do this when tests in here are extended)

    • Before After
      image image
  • In each new group, adjust the esArchiver unloads, such that only archives are unloaded that are used in tests of this group

  • Adjust readme files for the machine learning and transform plugins to reflect the changes in test server / runner commands

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@pheyos pheyos self-assigned this May 9, 2022
@pheyos pheyos added :ml test_ui_functional release_note:skip Skip the PR/issue when compiling release notes v8.3.0 labels May 9, 2022
@pheyos pheyos marked this pull request as ready for review May 9, 2022 11:45
@pheyos pheyos requested review from a team as code owners May 9, 2022 11:45
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

Copy link
Contributor

@spalger spalger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for doing this @pheyos!

Passed in 58m 6s

🤩

Copy link
Contributor

@peteharverson peteharverson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pheyos pheyos merged commit c79eb03 into elastic:main May 9, 2022
@kibanamachine kibanamachine added the backport:skip This commit does not require backporting label May 9, 2022
@pheyos pheyos deleted the split_ml_test_groups branch May 9, 2022 15:22
kertal pushed a commit to kertal/kibana that referenced this pull request May 24, 2022
This PR splits up the ML functional UI test groups and renames them to better match the contained test suites.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting :ml release_note:skip Skip the PR/issue when compiling release notes test_ui_functional v8.3.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants