Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] write warning if configured memory limit is too low for analytics job #61505

Merged
merged 4 commits into from
Aug 25, 2020

Conversation

benwtrent
Copy link
Member

Having _start fail when the configured memory limit is too low can be frustrating.

We should instead warn the user that their job might not run properly if their configured limit is too low.

It might be that our estimate is too high, and their configured limit works just fine.

@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

Copy link
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Just a few minor comments.

Copy link
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@benwtrent benwtrent merged commit 44d667b into elastic:master Aug 25, 2020
@benwtrent benwtrent deleted the feature/dfa-mem-cap-warning branch August 25, 2020 14:12
benwtrent added a commit to benwtrent/elasticsearch that referenced this pull request Aug 25, 2020
…s job (elastic#61505)

Having `_start` fail when the configured memory limit is too low can be frustrating. 

We should instead warn the user that their job might not run properly if their configured limit is too low. 

It might be that our estimate is too high, and their configured limit works just fine.
benwtrent added a commit that referenced this pull request Aug 26, 2020
…alytics job (#61505) (#61528)

Backports the following commits to 7.x:

[ML] write warning if configured memory limit is too low for analytics job (#61505)

Having `_start` fail when the configured memory limit is too low can be frustrating. 

We should instead warn the user that their job might not run properly if their configured limit is too low. 

It might be that our estimate is too high, and their configured limit works just fine.
benwtrent added a commit to elastic/ml-cpp that referenced this pull request Sep 1, 2020
…er than predicted memory usage (#1465)

From the management side, we allow users to update configured memory limits after the analytics configuration has started.

To help users with their workflow, we should allow analytics processes to attempt to run even if the configured memory limit is lower than our memory estimate. 


related to: elastic/elasticsearch#61505
benwtrent added a commit to elastic/ml-cpp that referenced this pull request Sep 1, 2020
…er than predicted memory usage (#1465) (#1467)

From the management side, we allow users to update configured memory limits after the analytics configuration has started.

To help users with their workflow, we should allow analytics processes to attempt to run even if the configured memory limit is lower than our memory estimate. 


related to: elastic/elasticsearch#61505
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants