Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possibly update Kafka-related doc about enable.idempotence default change by Kafka #7189

Open
tjquinno opened this issue Jul 13, 2023 · 1 comment
Assignees
Labels
2.x Issues for 2.x version branch 3.x Issues for 3.x version branch 4.x Version 4.x docs messaging Reactive Messaging
Milestone

Comments

@tjquinno
Copy link
Member

tjquinno commented Jul 13, 2023

Environment Details

  • Helidon Version: 2.x, 3.x, 4.x
  • Helidon SE or Helidon MP
  • JDK version:
  • OS:
  • Docker version (if applicable):

Problem Description

Kafka has changed the default value of enable.idempotence from false to true between (seemingly) releases 3.0 and 3.0.1. This can cause the Kafka error

org.apache.kafka.common.errors.UnsupportedVersionException: The broker does not support INIT_PRODUCER_ID

Explicitly setting enable.idempotence to false avoids this problem.

We might consider updating our messaging doc to alert users to this.

But, that can lead to another related error:

INFO  o.a.k.c.c.i.ConsumerCoordinator - [Consumer clientId=consumer-workspace-manager-async-publish-1, groupId=workspace-manager-async-publish] Request joining group due to: rebalance failed due to 'The session timeout is not within the range allowed by the broker (as configured by group.min.session.timeout.ms and group.max.session.timeout.ms).' (InvalidSessionTimeoutException)

Because the default timeout value has also changed, apparently from 10000 to 45000.

Explicitly configuring the value to 10000 works around this second issue.

The enable.idempotence issue was reported on our internal Slack channel and as well by other platforms: https://github.com/spring-projects/spring-boot/wiki/Spring-Boot-2.6-Release-Notes#kafka-30

@tjquinno tjquinno added docs messaging Reactive Messaging triage labels Jul 13, 2023
@m0mus m0mus added 2.x Issues for 2.x version branch 3.x Issues for 3.x version branch 4.x Version 4.x and removed triage labels Jul 20, 2023
@m0mus m0mus added this to the 3.2.3 milestone Jul 20, 2023
@danielkec
Copy link
Contributor

#6718

@barchetta barchetta modified the milestones: 3.2.3, 3.2.4, 3.x Nov 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2.x Issues for 2.x version branch 3.x Issues for 3.x version branch 4.x Version 4.x docs messaging Reactive Messaging
Projects
Status: Normal priority
Development

No branches or pull requests

5 participants