Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

stuck check can still make some mistake reports #9736

Closed
hicqu opened this issue Sep 13, 2023 · 0 comments · Fixed by #9742
Closed

stuck check can still make some mistake reports #9736

hicqu opened this issue Sep 13, 2023 · 0 comments · Fixed by #9742
Assignees
Labels
affects-6.5 affects-7.1 area/ticdc Issues or PRs related to TiCDC. severity/moderate type/bug The issue is confirmed as a bug.

Comments

@hicqu
Copy link
Contributor

hicqu commented Sep 13, 2023

What did you do?

Start one TiCDC instance, and run a changefeed with 30 tables. Then

  1. pause the changefeed, and prepare some data in the upstream cluster;
  2. inject a latency into the sink;
  3. resume the changefeed;
  4. after a while, we can get the log "stuck too long".

Why "stuck too long" happens?

It's because the table is the last one to finish incremental scan. There are already 29 tables scheduled into sink. After the last table gets scheduled, its resolvedTs has been updated, but its checkpoint can only be advanced after all other tables
pending data has been consumed. So, the stuck check is triggered, which is unexpected.

What did you expect to see?

No response

What did you see instead?

As decribed above.

Versions of the cluster

Master branch.

@hicqu hicqu added type/bug The issue is confirmed as a bug. area/ticdc Issues or PRs related to TiCDC. labels Sep 13, 2023
@hicqu hicqu self-assigned this Sep 13, 2023
ti-chi-bot bot pushed a commit that referenced this issue Sep 14, 2023
hicqu added a commit to ti-chi-bot/tiflow that referenced this issue Sep 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-6.5 affects-7.1 area/ticdc Issues or PRs related to TiCDC. severity/moderate type/bug The issue is confirmed as a bug.
Projects
Development

Successfully merging a pull request may close this issue.

1 participant