Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cdc/sink: mysql sink manage checkpoint per table #3645

Merged
merged 80 commits into from
Dec 9, 2021
Merged

cdc/sink: mysql sink manage checkpoint per table #3645

merged 80 commits into from
Dec 9, 2021

Commits on Nov 25, 2021

  1. refine Sink interface

    @sdojjy
    sdojjy committed Nov 25, 2021
    Configuration menu
    Copy the full SHA
    ba2c2fd View commit details
    Browse the repository at this point in the history

  2. fix ut

    @sdojjy
    sdojjy committed Nov 25, 2021
    Configuration menu
    Copy the full SHA
    26070d9 View commit details
    Browse the repository at this point in the history

  3. fix lint

    @sdojjy
    sdojjy committed Nov 25, 2021
    Configuration menu
    Copy the full SHA
    f388718 View commit details
    Browse the repository at this point in the history

  4. fix lint

    @sdojjy
    sdojjy committed Nov 25, 2021
    Configuration menu
    Copy the full SHA
    51b754a View commit details
    Browse the repository at this point in the history

  5. sink manager manage checkpointTs per table

    @sdojjy
    sdojjy committed Nov 25, 2021
    Configuration menu
    Copy the full SHA
    112b4e0 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into sink-manager-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Nov 25, 2021
    Configuration menu
    Copy the full SHA
    bf10cc1 View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2021

  1. buffer sink manage checkpointTs per table

    @sdojjy
    sdojjy committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    ce8598f View commit details
    Browse the repository at this point in the history

  2. buffer sink manage checkpointTs per table

    @sdojjy
    sdojjy committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    aaa2a9d View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/sink-manager-manage-checkpoint-p… 

    …er-table' into sink-manager-manage-checkpoint-per-table
    @sdojjy
    sdojjy committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    6bccf2f View commit details
    Browse the repository at this point in the history

  4. sink manager manage checkpointTs per table

    @sdojjy
    sdojjy committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    dbd09d3 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'sink-manager-manage-checkpoint-per-table' into buffer_s… 

    …ink_manage_checkpointTs_per_table
    @sdojjy
    sdojjy committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    1fd207d View commit details
    Browse the repository at this point in the history

  6. buffer sink manage checkpointTs per table

    @sdojjy
    sdojjy committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    e189647 View commit details
    Browse the repository at this point in the history

  7. sink manager manage checkpointTs per table

    @sdojjy
    sdojjy committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    fc0d687 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' into sink-manager-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Nov 26, 2021
    Configuration menu
    Copy the full SHA
    4008fce View commit details
    Browse the repository at this point in the history

  9. Merge branch 'sink-manager-manage-checkpoint-per-table' into buffer_s… 

    …ink_manage_checkpointTs_per_table
    @sdojjy
    sdojjy committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    e938ba9 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2021

  1. mysql sink manage checkpoint per table

    @sdojjy
    sdojjy committed Nov 27, 2021
    Configuration menu
    Copy the full SHA
    edee7b1 View commit details
    Browse the repository at this point in the history

  2. fix lint

    @sdojjy
    sdojjy committed Nov 27, 2021
    Configuration menu
    Copy the full SHA
    5f8b18f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Nov 27, 2021
    Configuration menu
    Copy the full SHA
    0ac647d View commit details
    Browse the repository at this point in the history

  4. fix lint

    @sdojjy
    sdojjy committed Nov 27, 2021
    Configuration menu
    Copy the full SHA
    9667dc1 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2021

  1. fix lint

    @sdojjy
    sdojjy committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    3421986 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2021

  1. Merge branch 'master' into sink-manager-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Nov 30, 2021
    Configuration menu
    Copy the full SHA
    594593e View commit details
    Browse the repository at this point in the history

  2. address comment

    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    78f2628 View commit details
    Browse the repository at this point in the history

  3. address comment

    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    d87f6e7 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into sink-manager-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Nov 30, 2021
    Configuration menu
    Copy the full SHA
    6e34487 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into buffer_sink_manage_checkpointTs_per_table

    @sdojjy
    sdojjy authored Nov 30, 2021
    Configuration menu
    Copy the full SHA
    8bfacd1 View commit details
    Browse the repository at this point in the history

  6. fix ut

    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    d3444c1 View commit details
    Browse the repository at this point in the history

  7. fix ut

    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    6cd2eaa View commit details
    Browse the repository at this point in the history

  8. fix ut

    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    2227e75 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Nov 30, 2021
    Configuration menu
    Copy the full SHA
    c827eee View commit details
    Browse the repository at this point in the history

  10. fix ut

    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    0683408 View commit details
    Browse the repository at this point in the history

  11. Merge remote-tracking branch 'upstream/master' into sink-manager-mana… 

    …ge-checkpoint-per-table

# Conflicts:
#	cdc/processor/processor_test.go
    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    e75d9d0 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'sink-manager-manage-checkpoint-per-table' into buffer_s… 

    …ink_manage_checkpointTs_per_table
    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    fefb6bf View commit details
    Browse the repository at this point in the history

  13. fix ut

    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    537456a View commit details
    Browse the repository at this point in the history

  14. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Nov 30, 2021
    Configuration menu
    Copy the full SHA
    f21a91f View commit details
    Browse the repository at this point in the history

  15. Merge branch 'master' into buffer_sink_manage_checkpointTs_per_table

    @sdojjy
    sdojjy authored Nov 30, 2021
    Configuration menu
    Copy the full SHA
    9af09b3 View commit details
    Browse the repository at this point in the history

  16. Merge remote-tracking branch 'upstream/master' into mysql-sink-manage… 

    …-checkpoint-per-table

# Conflicts:
#	cdc/sink/manager.go
    @sdojjy
    sdojjy committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    8e3d3c9 View commit details
    Browse the repository at this point in the history

  17. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Nov 30, 2021
    Configuration menu
    Copy the full SHA
    237aeea View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2021

  1. update buffer sink global checkpointTs

    @sdojjy
    sdojjy committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    e243794 View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2021

  1. fix sink_hang integration test

    @sdojjy
    sdojjy committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    07d0c99 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into buffer_sink_manage_checkpointTs_per_table

    @sdojjy
    sdojjy authored Dec 2, 2021
    Configuration menu
    Copy the full SHA
    853dd30 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'buffer_sink_manage_checkpointTs_per_table' of github.co… 

    …m:sdojjy/ticdc into buffer_sink_manage_checkpointTs_per_table
    @sdojjy
    sdojjy committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    a9f8020 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'buffer_sink_manage_checkpointTs_per_table' into mysql-s… 

    …ink-manage-checkpoint-per-table

# Conflicts:
#	cdc/sink/manager.go
    @sdojjy
    sdojjy committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    0356822 View commit details
    Browse the repository at this point in the history

  5. fix ut

    @sdojjy
    sdojjy committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    0657cd2 View commit details
    Browse the repository at this point in the history

  6. fix ut

    @sdojjy
    sdojjy committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    e23efca View commit details
    Browse the repository at this point in the history

  7. fix checkpoint

    @sdojjy
    sdojjy committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    cf8efd7 View commit details
    Browse the repository at this point in the history

  8. fix lint

    @sdojjy
    sdojjy committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    1f17ed3 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 2, 2021
    Configuration menu
    Copy the full SHA
    275cab5 View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2021

  1. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 3, 2021
    Configuration menu
    Copy the full SHA
    0b4d728 View commit details
    Browse the repository at this point in the history

  2. flush resolvedTs per table

    @sdojjy
    sdojjy committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    746a5c7 View commit details
    Browse the repository at this point in the history

  3. address comment

    @sdojjy
    sdojjy committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    b554602 View commit details
    Browse the repository at this point in the history

  4. address comment

    @sdojjy
    sdojjy committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    05f29aa View commit details
    Browse the repository at this point in the history

  5. fix integration test

    @sdojjy
    sdojjy committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    c3346e2 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 3, 2021
    Configuration menu
    Copy the full SHA
    a418e5a View commit details
    Browse the repository at this point in the history

  7. add ut test

    @sdojjy
    sdojjy committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    adefd60 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'origin/mysql-sink-manage-checkpoint-per… 

    …-table' into mysql-sink-manage-checkpoint-per-table
    @sdojjy
    sdojjy committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    dd14d12 View commit details
    Browse the repository at this point in the history

  9. fix lint

    @sdojjy
    sdojjy committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    800174b View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2021

  1. Merge branch 'master' into buffer_sink_manage_checkpointTs_per_table

    @sdojjy
    sdojjy authored Dec 4, 2021
    Configuration menu
    Copy the full SHA
    06ad1d8 View commit details
    Browse the repository at this point in the history

  2. add ut cases

    @sdojjy
    sdojjy committed Dec 4, 2021
    Configuration menu
    Copy the full SHA
    0b67675 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2021

  1. Merge branch 'buffer_sink_manage_checkpointTs_per_table' into mysql-s… 

    …ink-manage-checkpoint-per-table
    @sdojjy
    sdojjy committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    40a64e0 View commit details
    Browse the repository at this point in the history

  2. add ut case

    @sdojjy
    sdojjy committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    025a96e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 6, 2021
    Configuration menu
    Copy the full SHA
    5b69e4a View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 6, 2021
    Configuration menu
    Copy the full SHA
    46abbe0 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2021

  1. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 7, 2021
    Configuration menu
    Copy the full SHA
    204a9e2 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2021

  1. Update cdc/sink/mysql.go 

    Co-authored-by: Neil Shen <overvenus@gmail.com>
    @sdojjy @overvenus
    sdojjy and overvenus authored Dec 8, 2021
    Configuration menu
    Copy the full SHA
    89af4a9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 8, 2021
    Configuration menu
    Copy the full SHA
    1268e1d View commit details
    Browse the repository at this point in the history

  3. address comment

    @sdojjy
    sdojjy committed Dec 8, 2021
    Configuration menu
    Copy the full SHA
    b559140 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @ti-chi-bot
    ti-chi-bot authored Dec 8, 2021
    Configuration menu
    Copy the full SHA
    48b51cc View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @ti-chi-bot
    ti-chi-bot authored Dec 8, 2021
    Configuration menu
    Copy the full SHA
    b99a8c1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @ti-chi-bot
    ti-chi-bot authored Dec 8, 2021
    Configuration menu
    Copy the full SHA
    175643f View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @ti-chi-bot
    ti-chi-bot authored Dec 8, 2021
    Configuration menu
    Copy the full SHA
    971f3fc View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2021

  1. kafka consumer flush resovedTs with table ID

    @sdojjy
    sdojjy committed Dec 9, 2021
    Configuration menu
    Copy the full SHA
    1f78944 View commit details
    Browse the repository at this point in the history

  2. kafka consumer flush resovedTs with table ID

    @sdojjy
    sdojjy committed Dec 9, 2021
    Configuration menu
    Copy the full SHA
    c4d2ed7 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 9, 2021
    Configuration menu
    Copy the full SHA
    77b9755 View commit details
    Browse the repository at this point in the history

  4. kafka consumer flush resovedTs with table ID

    @sdojjy
    sdojjy committed Dec 9, 2021
    Configuration menu
    Copy the full SHA
    8e65f06 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/mysql-sink-manage-checkpoint-per… 

    …-table' into mysql-sink-manage-checkpoint-per-table
    @sdojjy
    sdojjy committed Dec 9, 2021
    Configuration menu
    Copy the full SHA
    0368bc7 View commit details
    Browse the repository at this point in the history

  6. kafka consumer flush resovedTs with table ID

    @sdojjy
    sdojjy committed Dec 9, 2021
    Configuration menu
    Copy the full SHA
    e330b60 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @sdojjy
    sdojjy authored Dec 9, 2021
    Configuration menu
    Copy the full SHA
    c87c972 View commit details
    Browse the repository at this point in the history

  8. kafka consumer flush resovedTs with table ID

    @sdojjy
    sdojjy committed Dec 9, 2021
    Configuration menu
    Copy the full SHA
    40161f5 View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'origin/mysql-sink-manage-checkpoint-per… 

    …-table' into mysql-sink-manage-checkpoint-per-table
    @sdojjy
    sdojjy committed Dec 9, 2021
    Configuration menu
    Copy the full SHA
    a614acf View commit details
    Browse the repository at this point in the history

  10. Merge branch 'master' into mysql-sink-manage-checkpoint-per-table

    @ti-chi-bot
    ti-chi-bot authored Dec 9, 2021
    Configuration menu
    Copy the full SHA
    da216bd View commit details
    Browse the repository at this point in the history