-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Configure split-bundle task interval different than loadReportGenerationTask-interval #183
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it possible to make it working for any config values? I haven't checked the code there but maybe there's a way to prevent both tasks from running st the same time.
I think we can remove |
Wouldn't it be easier to chain the 2 tasks in the same thread? Compute the load report and then check for bundles to be split. Though, my concern is that the exception in #172 could happen anyway, cause a bundle could be unloaded after the report was generated. We should just ignore that bundle and move on at that point. |
Make sense. I will make the change. |
7a728cf
to
5dfd223
Compare
updated PR by merging loadReportGeneration and splitBundleTask. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
@rdhabalia Anything else for 1.16 ? |
* Support Pulsar 2.6.1 * Fix unit test error of testOffsetCommittedBacklogCleared
Motivation
If
loadBalancerReportUpdateMaxIntervalMinutes
is same asloadBalancerNamespaceBundleSplitIntervalMinutes
(by default = 15 mins) then splitBundleTask may read staleList of Bundles
and it will end up splitting invalid bundles which cause #172Modifications
Keep different interval value for :
loadBalancerReportUpdateMaxIntervalMinutes
andloadBalancerNamespaceBundleSplitIntervalMinutes
, to avoid stale-read of bundle data.Result
It will fix #172