Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Local blocks processor honor per-tenant max trace size #3305

Merged
merged 6 commits into from
Jan 17, 2024

Conversation

mdisibio
Copy link
Contributor

@mdisibio mdisibio commented Jan 17, 2024

What this PR does:
Updates the local-blocks processor to honor the per-tenant override max_trace_bytes. The generators already make use of the per-tenant overrides but this field. This goes one step further than the trace size limits in the ingesters. The ingesters keep track of the historical trace size only for the lifetime of the headblock, and that means long-running traces can eventually append more data. This goes one step further and maintains the historical trace size for as long as the trace is active (continues to send spans).

Which issue(s) this PR fixes:
Fixes #

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

Copy link
Contributor

@zalegrala zalegrala left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple comments, but overall looks reasonable to me.

modules/generator/processor/localblocks/traceSizes.go Outdated Show resolved Hide resolved
modules/generator/processor/localblocks/livetraces.go Outdated Show resolved Hide resolved
Copy link
Contributor

@zalegrala zalegrala left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@mdisibio mdisibio merged commit e96c371 into grafana:main Jan 17, 2024
14 checks passed
mdisibio added a commit to mdisibio/tempo that referenced this pull request Jan 22, 2024
* Keep track of trace sizes for the lifetime of the headblock, add metrics

* lint

* Comment

* Fix invalid assumption that all batches have the same trace id. Undo variable name change, review comments

* changelog
@mdisibio mdisibio mentioned this pull request Jan 22, 2024
3 tasks
mdisibio added a commit that referenced this pull request Jan 22, 2024
* Keep track of trace sizes for the lifetime of the headblock, add metrics

* lint

* Comment

* Fix invalid assumption that all batches have the same trace id. Undo variable name change, review comments

* changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants