Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Jest Integration Tests.src/core/server/integration_tests/elasticsearch - Version Compatibility should flag the incompatibility on version mismatch (ES is previous minor) #171289

Open
kibanamachine opened this issue Nov 15, 2023 · 23 comments · Fixed by #190160
Open

Failing test: Jest Integration Tests.src/core/server/integration_tests/elasticsearch - Version Compatibility should flag the incompatibility on version mismatch (ES is previous minor) #171289

kibanamachine opened this issue Nov 15, 2023 · 23 comments · Fixed by #190160
Assignees
@afharo
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Core Core services & architecture: plugins, logging, config, saved objects, http, ES client, i18n, etc Team:Operations Team label for Operations Team

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Nov 15, 2023 •
edited
Loading

A test failed on a tracked branch

Error: ES exited with code 1
    at createCliError (/var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/packages/kbn-es/src/errors.ts:14:24)
    at /var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/packages/kbn-es/src/cluster.ts:506:29
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at /var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/packages/kbn-es/src/cluster.ts:204:7
    at /var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/packages/kbn-tooling-log/src/tooling_log.ts:84:18
    at Cluster.start (/var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/packages/kbn-es/src/cluster.ts:201:5)
    at TestCluster.start (/var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/packages/kbn-test/src/es/test_es_cluster.ts:305:9)
    at startES (/var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/packages/core/test-helpers/core-test-helpers-kbn-server/src/create_root.ts:268:7)
    at startServers (/var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/src/core/server/integration_tests/elasticsearch/version_compatibility.test.ts:79:16)
    at Object.<anonymous> (/var/lib/buildkite-agent/builds/kb-n2-4-spot-eed79d9f715ba58b/elastic/kibana-on-merge/kibana/src/core/server/integration_tests/elasticsearch/version_compatibility.test.ts:100:5)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Nov 15, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Nov 15, 2023
@kibanamachine kibanamachine added the Team:Core Core services & architecture: plugins, logging, config, saved objects, http, ES client, i18n, etc label Nov 15, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-core (Team:Core)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Nov 15, 2023
@kibanamachine kibanamachine reopened this Feb 15, 2024
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - main

@kibanamachine kibanamachine reopened this Jul 4, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - main

mistic added a commit that referenced this issue Jul 4, 2024
@mistic
skip flaky suite (#171289)
bb80995
@mistic
Copy link
Member

mistic commented Jul 4, 2024

Skipped.

main: bb80995

@pgayvallet pgayvallet reopened this Jul 8, 2024
afharo added a commit to afharo/kibana that referenced this issue Aug 8, 2024
@afharo
Flaky elastic#171289
3604bca
@afharo afharo mentioned this issue Aug 8, 2024
Merged
1 task
@afharo afharo self-assigned this Aug 8, 2024
afharo added a commit that referenced this issue Aug 8, 2024
@afharo
Flaky #171289 (#190160)
bfb1bf5
@kibanamachine kibanamachine reopened this Oct 16, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-es-forward-compatibility-testing-9-dot-0 - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-es-forward-compatibility-testing-9-dot-0 - 8.x

@afharo
Copy link
Member

afharo commented Dec 17, 2024 •
edited
Loading

The reason these are failing in the ES-forward-compatibility tests is because the intention of this test is to run Kibana with a higher minor than the current version.
So the test spins up Kibana 8.19.0, assuming ES will run in 8.18.0, but we're overriding ES version to 9.0.0 in the tests.

Relevant piece of code:

kibana/src/core/server/integration_tests/elasticsearch/version_compatibility.test.ts

Line 105 in ac0b0b4

startServers({ customKibanaVersion: nextMinor() }).then(() => {

The nextMinor() is calculated from this version:

kibana/packages/kbn-test/src/es/es_test_config.ts

Line 16 in b628770

return process.env.TEST_ES_BRANCH || pkg.version;

Maybe we can provide an env var to let the tests know and we need to mimic 9.1.0 Kibana instead?

cc @elastic/kibana-operations

Alternatively, we can skip this test in the forward-compatibility since that's a valid scenario.

@afharo afharo added the Team:Operations Team label for Operations Team label Dec 17, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-es-forward-compatibility-testing-9-dot-0 - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-es-forward-compatibility-testing-9-dot-0 - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-es-forward-compatibility-testing-9-dot-0 - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-es-forward-compatibility-testing-9-dot-0 - 8.x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@afharo afharo

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Core Core services & architecture: plugins, logging, config, saved objects, http, ES client, i18n, etc Team:Operations Team label for Operations Team
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Flaky #171289 afharo/kibana
5 participants
@pgayvallet @mistic @afharo @elasticmachine @kibanamachine