Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add aggregation specific errors #1731

Merged
merged 5 commits into from
Jun 14, 2019
Merged

Conversation

robskillington
Copy link
Collaborator

What this PR does / why we need it:

Returns specific errors for metrics that are being aggregated that arrive too late or too early.

Special notes for your reviewer:

Does this PR introduce a user-facing and/or backwards incompatible change?:

NONE

Does this PR require updating code package or user-facing documentation?:

NONE

Copy link
Contributor

@richardartoul richardartoul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@robskillington Can you feature flag this behind some kind of verbosity flag thats disabled by default (but enabled in m3coordinator)? This looks like its 5 string allocations per rejected data point which could definitely cause issues for us with the distributed aggregation tier.

I talked to @cw9 and @vdarulis and they said we actually get a lot of these errors since we're forwarding traffic from the shunts

@robskillington
Copy link
Collaborator Author

@richardartoul sure thing not opposed to that, put it behind a flag for now and added config that allows adjusting the values if required too.

@codecov
Copy link

codecov bot commented Jun 13, 2019

Codecov Report

Merging #1731 into master will increase coverage by <.1%.
The diff coverage is 100%.

Impacted file tree graph

@@           Coverage Diff            @@
##           master   #1731     +/-   ##
========================================
+ Coverage    71.8%   71.9%   +<.1%     
========================================
  Files         981     981             
  Lines       81875   81904     +29     
========================================
+ Hits        58867   58904     +37     
+ Misses      19140   19131      -9     
- Partials     3868    3869      +1
Flag Coverage Δ
#aggregator 82.5% <100%> (ø) ⬆️
#cluster 85.7% <ø> (ø) ⬆️
#collector 63.9% <ø> (ø) ⬆️
#dbnode 79.9% <ø> (-0.1%) ⬇️
#m3em 73.2% <ø> (ø) ⬆️
#m3ninx 74.1% <ø> (ø) ⬆️
#m3nsch 51.1% <ø> (ø) ⬆️
#metrics 17.6% <ø> (ø) ⬆️
#msg 74.7% <ø> (ø) ⬆️
#query 66.3% <ø> (ø) ⬆️
#x 85.3% <ø> (+0.1%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 089da87...9386126. Read the comment docs.

Copy link
Collaborator

@martin-mao martin-mao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@robskillington robskillington merged commit 75c2664 into master Jun 14, 2019
@justinjc justinjc deleted the r/aggregation-errors-and-config branch July 12, 2019 20:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants