Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cherry-pick #5150 to 6.0: Update queue.mem defaults #5171

Merged
merged 2 commits into from
Sep 13, 2017

Conversation

tsg
Copy link
Contributor

@tsg tsg commented Sep 13, 2017

Cherry-pick of PR #5150 to 6.0 branch. Original message:

Requires: #5148

  • Enable flush based memory queue by default:
    Increases chance of pushing bigger batches of events to the outputs.
    Especially if number of CPUs is limited to 1 or 2 this helps with
    throughput, as outputs and producers go-routines will interleave less.

  • Set flush.events=2048 and flush.timeout=1s

* Update queue.mem defaults

- Enable flush based memory queue by default:
  Increases chance of pushing bigger batches of events to the outputs.
  Especially if number of CPUs is limited to 1 or 2 this helps with
  throughput, as outputs and producers go-routines will interleave less.

- Set flush.events=2048 and flush.timeout=1s

* set queue flush parameters in system tests

update queue flush parameters to min_events of 8 and a timeout of 0.1s.
This hopefully stabilizes some time sensitive tests.

* Fix typo in CHANGELOG

(cherry picked from commit 052172f)
@@ -64,6 +64,11 @@ https://github.com/elastic/beats/compare/v6.0.0-beta2...master[Check the HEAD di

*Affecting all Beats*

- Move TCP UDP start up into `server.Start()` {pull}4903[4903]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Merge problem?

@ruflin
Copy link
Contributor

ruflin commented Sep 13, 2017

WFG

@ruflin ruflin mentioned this pull request Sep 13, 2017
@ruflin ruflin merged commit 0c840b3 into elastic:6.0 Sep 13, 2017
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
)

* Update queue.mem defaults (elastic#5150)

* Update queue.mem defaults

- Enable flush based memory queue by default:
  Increases chance of pushing bigger batches of events to the outputs.
  Especially if number of CPUs is limited to 1 or 2 this helps with
  throughput, as outputs and producers go-routines will interleave less.

- Set flush.events=2048 and flush.timeout=1s

* set queue flush parameters in system tests

update queue flush parameters to min_events of 8 and a timeout of 0.1s.
This hopefully stabilizes some time sensitive tests.

* Fix typo in CHANGELOG

(cherry picked from commit 8877dd4)

* fix changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants