Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: use instead forked rskafka to support limited retry #1005

Merged
merged 4 commits into from
Jun 20, 2023

Conversation

Rachelint
Copy link
Contributor

@Rachelint Rachelint commented Jun 20, 2023

Rationale

Part of #799
We use rskafka as our kafka client.
However I found it will retry without limit even though kafka service is unavailable...
(see influxdata/rskafka#65)
Worse, I found rskafka is almostis no longer maintained...

For quick fix, I forked it to support limited retry.

Detailed Changes

  • Use the instead forked rskafka(supporting limited retry).
  • Add more logs in recovery path for better debugging.

Test Plan

Test manually.

@Rachelint Rachelint mentioned this pull request Jun 16, 2023
12 tasks
Copy link
Member

@ShiKaiWi ShiKaiWi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

analytic_engine/src/manifest/details.rs Outdated Show resolved Hide resolved
analytic_engine/src/manifest/details.rs Outdated Show resolved Hide resolved
@Rachelint Rachelint force-pushed the use-the-instead-forked-rskafka branch from b31ee26 to d54f4c9 Compare June 20, 2023 08:46
@Rachelint Rachelint force-pushed the use-the-instead-forked-rskafka branch from d54f4c9 to c590027 Compare June 20, 2023 08:47
@Rachelint Rachelint merged commit e3b4009 into apache:main Jun 20, 2023
5 checks passed
dust1 pushed a commit to dust1/ceresdb that referenced this pull request Aug 9, 2023
)

## Rationale
Part of apache#799 
We use `rskafka` as our kafka client.
However I found it will retry without limit even though kafka service is
unavailable...
(see
[influxdata/rskafka#65)
Worse, I found `rskafka` is almostis no longer maintained...

For quick fix, I forked it to support limited retry.

## Detailed Changes
+ Use the instead forked `rskafka`(supporting limited retry).
+ Add more logs in recovery path for better debugging.

## Test Plan
Test manually.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants