Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

reduce the long tail of full backup #52534

Closed
Leavrth opened this issue Apr 12, 2024 · 0 comments · Fixed by #53341
Closed

reduce the long tail of full backup #52534

Leavrth opened this issue Apr 12, 2024 · 0 comments · Fixed by #53341
Labels
component/br This issue is related to BR of TiDB. type/enhancement The issue or PR belongs to an enhancement.

Comments

@Leavrth
Copy link
Contributor

Leavrth commented Apr 12, 2024

Enhancement

  1. The BackupRequest contains the key range of index or small partition, whose kv data is only distributed in few regions.
  2. When a backup task failed, the retry approach should let the TiKV has enough backup task to continue instead of being idle.
@Leavrth Leavrth added type/enhancement The issue or PR belongs to an enhancement. component/br This issue is related to BR of TiDB. labels Apr 12, 2024
@Leavrth Leavrth mentioned this issue Apr 12, 2024
Merged
13 tasks
ti-chi-bot bot pushed a commit that referenced this issue May 7, 2024
@Leavrth
br: send backup request in batch (#52535)
81da4f8 
ref #52534
@3pointer 3pointer mentioned this issue May 7, 2024
Merged
13 tasks
ti-chi-bot bot pushed a commit that referenced this issue May 16, 2024
@3pointer
backup: implement store based backup to solve the long tail issue (#5…
835ea04 
…3081)

ref #52534
@3pointer 3pointer mentioned this issue May 17, 2024
Merged
13 tasks
terry1purcell pushed a commit to terry1purcell/tidb that referenced this issue May 17, 2024
@Leavrth @terry1purcell
br: send backup request in batch (pingcap#52535)
d704003 
ref pingcap#52534
terry1purcell pushed a commit to terry1purcell/tidb that referenced this issue May 17, 2024
@3pointer @terry1purcell
backup: implement store based backup to solve the long tail issue (pi…
33f1c6e 
…ngcap#53081)

ref pingcap#52534
RidRisR pushed a commit to RidRisR/tidb that referenced this issue May 23, 2024
@Leavrth @RidRisR
br: send backup request in batch (pingcap#52535)
f8257b8 
ref pingcap#52534
RidRisR pushed a commit to RidRisR/tidb that referenced this issue May 23, 2024
@3pointer @RidRisR
backup: implement store based backup to solve the long tail issue (pi…
378e37d 
…ngcap#53081)

ref pingcap#52534
ti-chi-bot bot pushed a commit that referenced this issue Jun 6, 2024
@3pointer
backup: watch store state and retry backup immediately (#53341)
dcadcde 
close #52534
This was referenced Jun 11, 2024
Merged
Merged
ti-chi-bot bot pushed a commit that referenced this issue Jun 17, 2024
@3pointer
backup: fix the missing first store state during backup (#53920)
3e180e2 
ref #52534
@3pointer 3pointer mentioned this issue Jun 20, 2024
Merged
13 tasks
ti-chi-bot bot pushed a commit that referenced this issue Jun 20, 2024
@3pointer
backup: add version checker for store based backup (#54131)
c5ddf0d 
ref #52534
@3pointer 3pointer mentioned this issue Jun 24, 2024
Merged
13 tasks
ti-chi-bot bot pushed a commit that referenced this issue Jun 25, 2024
@3pointer
Backup: split batch store backup requests (#54151)
99abc28 
ref #52534
@3pointer 3pointer mentioned this issue Jun 25, 2024
Merged
13 tasks
ti-chi-bot bot pushed a commit that referenced this issue Jun 25, 2024
@3pointer
backup: use tombstone instead of offline during CheckStoreLiveness (#…
b3ed886 
…54196)

ref #52534
@ti-chi-bot ti-chi-bot mentioned this issue Jul 8, 2024
Closed
13 tasks
This was referenced Jul 29, 2024
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
component/br This issue is related to BR of TiDB. type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

backup: watch store state and retry backup immediately 3pointer/tidb
1 participant
@Leavrth