Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a new poller thread pool usage metric #1275

Merged
merged 4 commits into from
Oct 10, 2023

Conversation

timl3136
Copy link
Contributor

@timl3136 timl3136 commented Oct 8, 2023

Create a new poller thread pool usage metric for the amount of buffer left in the poller channel. If there are non-remaining, then polling will halt.

What changed?
Added a new metric regarding the usage and remaining capacity of the poller channel

Why?
We are aiming to understand current poller utilizations and improve the overall utilization as a result. This metric allows us to determine whether there exists a need to tune the amount of buffer of the channel for high traffic customers.

How did you test it?
Tested on development environment

Potential risks
No risks considering that is only a new metric

…ric meant the amount of buffer left in the poller channel. If there are non-remaining, then polling will halt.
@timl3136 timl3136 marked this pull request as ready for review October 9, 2023 16:53
internal/common/metrics/constants.go Outdated Show resolved Hide resolved
internal/internal_worker_base.go Outdated Show resolved Hide resolved
@timl3136 timl3136 merged commit 9909396 into uber-go:master Oct 10, 2023
9 checks passed
@timl3136 timl3136 deleted the threadpool_usage branch October 10, 2023 17:31
timl3136 added a commit that referenced this pull request Nov 4, 2023
Create new poller thread pool usage metrics. ConcurrentTaskQuota is the number of buffer in poller thread channel and ConcurrentTaskRunning is current utilization of that channel.
If ConcurrentTaskRunning is exceeding ConcurrentTaskQuota, polling will halt and result in under utilization and backlog as a result.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants