Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Plugin Functional Tests.test/plugin_functional/test_suites/core/route·ts - core route timeouts idle socket should timeout if payload sending has too long of an idle period #75440

Open
kibanamachine opened this issue Aug 19, 2020 · 11 comments · Fixed by #162947
Open

Failing test: Plugin Functional Tests.test/plugin_functional/test_suites/core/route·ts - core route timeouts idle socket should timeout if payload sending has too long of an idle period #75440

kibanamachine opened this issue Aug 19, 2020 · 11 comments · Fixed by #162947
Assignees
@gsoldevila
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Core Core services & architecture: plugins, logging, config, saved objects, http, ES client, i18n, etc

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Aug 19, 2020 •
edited
Loading

A test failed on a tracked branch

Error: expected 'read ECONNRESET' to equal 'socket hang up'
    at Assertion.assert (packages/kbn-expect/expect.js:100:11)
    at Assertion.be.Assertion.equal (packages/kbn-expect/expect.js:227:8)
    at Assertion.be (packages/kbn-expect/expect.js:69:22)
    at result.then.err (test/plugin_functional/test_suites/core/route.ts:107:38)
    at process._tickCallback (internal/process/next_tick.js:68:7)

First failure: Jenkins Build
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Aug 19, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-test-triage (failed-test)

@spalger spalger added the Team:Core Core services & architecture: plugins, logging, config, saved objects, http, ES client, i18n, etc label Aug 19, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-platform (Team:Platform)

spalger added a commit that referenced this issue Aug 19, 2020
@spalger
skip flaky suite (#75440)
f5e5abe
spalger added a commit that referenced this issue Aug 19, 2020
@spalger
skip flaky suite (#75440)
9abcd78 
(cherry picked from commit f5e5abe)
@kobelb kobelb self-assigned this Aug 19, 2020
@spalger
Copy link
Contributor

spalger commented Aug 19, 2020

We've only had two failures of this test, but the tests are brand new and were added in #73730. The fact that they're based on clocks is concerning and I'm confident that we'd see more than enough justification to skip these if we left them going for a couple more days.

Skipped

master: f5e5abe
7.x/7.10: 9abcd78

gmmorris added a commit to gmmorris/kibana that referenced this issue Aug 19, 2020
@gmmorris
Merge branch 'master' into actions/webhook-remove-header
fd42b0c 
* master: (30 commits)
  [code coverage] always download node before team assignment (elastic#75424)
  [Form lib] Allow new "defaultValue" to be provided when resetting the… (elastic#75302)
  [Logs UI] Add "View in machine learning" links in the anomaly explorer (elastic#74555)
  skip flaky suite (elastic#75440)
  skip flaky suite (elastic#75386)
  [Saved objects] Add support for version on create & bulkCreate when overwriting a document (elastic#75172)
  [Functional]Table Vis increase sleep time in order filter to be applied (elastic#75138)
  MOAR RAM (elastic#75423)
  [Visualize] Horizontal Bar Percentiles Overlapping (elastic#75315)
  [ML] DF Analytics / Transforms: Fix job row actions menu invalid DOM nesting warning (elastic#74499)
  [ML] Inference models management (elastic#74978)
  [Monitoring] Migrate karma tests (elastic#75301)
  [Index template] Add filters to simulate preview (elastic#74497)
  Bump and consolidate dependencies (elastic#75360)
  [Ingest Manager] Fix agent config rollout rate limit to use constants (elastic#75364)
  Update Node.js to version 10.22.0 (elastic#75254)
  [ML] Anomaly Explorer / Single Metric Viewer: Fix error reporting for annotations. (elastic#74953)
  [Discover] Fix histogram cloud tests (elastic#75268)
  Uiactions to navigate to visualize or maps (elastic#74121)
  Use prefix search invis editor field/agg combo box (elastic#75290)
  ...
@rudolf
Copy link
Contributor

rudolf commented Sep 15, 2021

Similar integration test failure #82002

@gsoldevila gsoldevila self-assigned this Aug 2, 2023
@gsoldevila gsoldevila mentioned this issue Aug 2, 2023
Merged
@afharo afharo linked a pull request Oct 26, 2023 that will close this issue
Avoid ECONNRESET errors on idle timeout #162947
Merged
e40pud pushed a commit to e40pud/kibana that referenced this issue Nov 22, 2023
@gsoldevila
Avoid ECONNRESET errors on idle timeout (elastic#162947)
721d68a 
### Summary

Address elastic#82002 and
elastic#75440

I think I found a breakthrough for this flaky behavior. I run the
integration test 800x locally, with different settings:

Adjusting both the delayed emission (send 1 char at a time), and the
socket idle timeout to have exacly the same value (e.g. `10 millis`), I
managed to get the `ECONNRESET` 100% of the times.

Thus, IIUC the ECONNRESET happens when the client tries to send a
character over the socket and at the same time the server responds with
the idle timeout.

Adjusting the values so that the delay between character emissions is
significantly larger than the idle timeout, e.g. 20 vs 5, I get `socket
hang up` 100% of the times.

Flaky Test Runner Pipeline - 300x 🟢
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4030
@kibanamachine kibanamachine reopened this Dec 11, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.12

@pgayvallet
Copy link
Contributor

From last failure, it seems it's still the same cause, so I guess #162947 was not enough 😞


└- ✖ fail: core route timeouts idle socket should timeout if payload sending has too long of an idle period
--
  | │      Error: expected 'read ECONNRESET' to equal 'socket hang up'

@afharo
Copy link
Member

afharo commented Aug 8, 2024

No new failures for half a year... maybe it was a rogue commit that failed?

@afharo afharo closed this as not planned Won't fix, can't repro, duplicate, stale Aug 8, 2024
@kibanamachine kibanamachine reopened this Oct 31, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.16

@afharo
Copy link
Member

afharo commented Nov 6, 2024

Again Error: expected 'read ECONNRESET' to equal 'socket hang up'.

There are other jobs in the build that failed with an unfinished list of tasks. I wonder if the error is actually the runner killing Kibana ahead of time.

@afharo afharo closed this as not planned Won't fix, can't repro, duplicate, stale Nov 6, 2024
@kibanamachine kibanamachine reopened this Nov 18, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gsoldevila gsoldevila

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Core Core services & architecture: plugins, logging, config, saved objects, http, ES client, i18n, etc
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Avoid ECONNRESET errors on idle timeout gsoldevila/kibana
8 participants
@kobelb @rudolf @spalger @pgayvallet @afharo @elasticmachine @gsoldevila @kibanamachine