Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

draft: added support incremental rebalance in one session #2962

Conversation

Sergey-Belyakov
Copy link

The idea is to get rid of stop the world during rebalancing without changing the main consumer interfaces. During the response from the heartbeat ErrRebalanceInProgress, the execution of fetch requests continues. In parallel, the reading from the departed partitions is closed.

tests is coming

@Sergey-Belyakov Sergey-Belyakov force-pushed the incremental-rebalance-support branch from 3044ac6 to ecf3d43 Compare August 14, 2024 09:47
@Sergey-Belyakov Sergey-Belyakov changed the title added support incremental rebalance in one session draft: added support incremental rebalance in one session Aug 14, 2024
@Sergey-Belyakov Sergey-Belyakov marked this pull request as draft August 14, 2024 09:47
@Sergey-Belyakov Sergey-Belyakov force-pushed the incremental-rebalance-support branch from ecf3d43 to 2ea5122 Compare August 14, 2024 10:24
Signed-off-by: Sergey Belyakov <sbsphp@gmail.com>
@Sergey-Belyakov Sergey-Belyakov force-pushed the incremental-rebalance-support branch from 2ea5122 to b4beb63 Compare August 14, 2024 10:46
@prestona
Copy link
Member

Hi @Sergey-Belyakov - thanks for opening this PR. I wanted to check if you are aware of #2608, which also proposes changes to the re-balance strategy?

@Sergey-Belyakov
Copy link
Author

Hi @Sergey-Belyakov - thanks for opening this PR. I wanted to check if you are aware of #2608, which also proposes changes to the re-balance strategy?

Hi! I have seen this MP, but I wanted to offer an incremental rebalancing option without changing the main interfaces of the consumer

Copy link

Thank you for your contribution! However, this pull request has not had any activity in the past 90 days and will be closed in 30 days if no updates occur.
If you believe the changes are still valid then please verify your branch has no conflicts with main and rebase if needed. If you are awaiting a (re-)review then please let us know.

@github-actions github-actions bot added the stale Issues and pull requests without any recent activity label Nov 13, 2024
@github-actions github-actions bot closed this Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale Issues and pull requests without any recent activity
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants