Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve runbook for MimirRequestErrors, Alertmanager section, for alertmanager distributor problems #5694

Merged
merged 3 commits into from
Aug 9, 2023

Conversation

alexweav
Copy link
Contributor

@alexweav alexweav commented Aug 7, 2023

What this PR does

The alertmanager's distributor fans out tenant requests to the correct alertmanager. There is a specific state where this may be failing, but it's not immediately obvious from the alert.

Add a couple lines to the Alertmanager section of the MimirRequestErrors runbook which handle this case, and describe what to do.

Which issue(s) this PR fixes or relates to

n/a

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@alexweav alexweav added type/docs Improvements or additions to documentation component/alertmanager monitoring/runbooks labels Aug 7, 2023
@alexweav alexweav requested review from a team as code owners August 7, 2023 20:28
Copy link
Member

@JohnnyQQQQ JohnnyQQQQ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@56quarters 56quarters merged commit e47cb0e into main Aug 9, 2023
28 checks passed
@56quarters 56quarters deleted the alexweav/request-errors-runbook branch August 9, 2023 19:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/alertmanager monitoring/runbooks type/docs Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants