Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shared mode consumer priority #134

Closed
DongbinNie opened this issue Dec 2, 2016 · 4 comments
Closed

Shared mode consumer priority #134

DongbinNie opened this issue Dec 2, 2016 · 4 comments
Labels
type/feature The PR added a new feature or issue requested a new feature
Milestone

Comments

@DongbinNie
Copy link

Shared mode consumer priority, the messages will only goes to the consumers with higher priority if there's permit, otherwise the message can also be pushed to the consumers with lower priority.

[merlimat]
Good idea. This should be relatively easy to implement.

[DongbinNie]
:-)

@rdhabalia
Copy link
Contributor

  • can you describe your usecase where this feature can be helpful?
  • and in that usecase: what could be the variables based on which user assign priority level of each consumer? Is it based on machine's capacity or configuration?

@DongbinNie
Copy link
Author

DongbinNie commented Dec 2, 2016

the consumer may be assigned different priority based on the machine's capacity or location(e.g. rack or idc).
we would like the consumers in the master application cluster to consume the whole message as most as possible, if the master application cluster crash totally, the consumers in the other cluster can continue to consume the messages, but with different costing.

@merlimat
Copy link
Contributor

merlimat commented Dec 3, 2016

That was what I had in mind as well.

My other question would be: would anyone need in practice more that 2 priorities (High and Low)?

@merlimat merlimat added the type/feature The PR added a new feature or issue requested a new feature label Dec 3, 2016
@merlimat merlimat changed the title [Feature Proposal] Shared mode consumer priority Shared mode consumer priority Dec 3, 2016
@DongbinNie
Copy link
Author

DongbinNie commented Dec 3, 2016

would anyone need in practice more that 2 priorities (High and Low)?

Currently we only require 2 priorities in the applications, but I think it's better to have the ability to have multiple priorities.

@merlimat merlimat added this to the 1.17 milestone Feb 26, 2017
sijie pushed a commit to sijie/pulsar that referenced this issue Mar 4, 2018
* adding user acking and fixing bugs

* cleaning up
hrsakai pushed a commit to hrsakai/pulsar that referenced this issue Dec 10, 2020
hangc0276 pushed a commit to hangc0276/pulsar that referenced this issue May 26, 2021
optimize for apache#134 including the following aspects:

recordToEntry paralleled
publish message to bookie asynchronous
In our environment, produce delay is about one-fifth of the previous
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/feature The PR added a new feature or issue requested a new feature
Projects
None yet
Development

No branches or pull requests

3 participants