Skip to content
This repository has been archived by the owner on Jul 24, 2024. It is now read-only.

restore: make split and restore pipelined. #427

Merged
merged 36 commits into from
Oct 9, 2020
Merged

restore: make split and restore pipelined. #427

merged 36 commits into from
Oct 9, 2020

Commits on Jul 16, 2020

  1. restore: make split and restore pipelined. 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    bc6224c View commit details
    Browse the repository at this point in the history

  2. restore: adapt the unit test. 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    fb6880c View commit details
    Browse the repository at this point in the history

  3. restore: disable concurrent split for now 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    781e634 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2020

  1. restore: remove concurrency limit, fixed checksum time summary 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    d63e437 View commit details
    Browse the repository at this point in the history

  2. restore: handle a error has been omitted past 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    5f1449a View commit details
    Browse the repository at this point in the history

  3. restore: abstract sink type 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    32197cd View commit details
    Browse the repository at this point in the history

  4. restore: change some log level 

    remove reject stores sometime always grow too huge and provides little useful information, move it to DEBUG.
add a log when any file is fully restored, which is useful troubleshooting when some restore goes slow.

Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    yujuncen committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    f24b5ab View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Jul 17, 2020
    Configuration menu
    Copy the full SHA
    e350877 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2020

  1. restore: add log when file backed up 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 20, 2020
    Configuration menu
    Copy the full SHA
    683dbdf View commit details
    Browse the repository at this point in the history

  2. restore: unexport some private fields 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 20, 2020
    Configuration menu
    Copy the full SHA
    9946b3e View commit details
    Browse the repository at this point in the history

  3. restore: grow the restore channel size 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 20, 2020
    Configuration menu
    Copy the full SHA
    7b34f2b View commit details
    Browse the repository at this point in the history

  4. restore: grow all channel size 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 20, 2020
    Configuration menu
    Copy the full SHA
    b457a96 View commit details
    Browse the repository at this point in the history

  5. restore: move some synchronous logic to async, call leave on tables w… 

    …hen exit

Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Jul 20, 2020
    Configuration menu
    Copy the full SHA
    c0fe56c View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2020

  1. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Jul 21, 2020
    Configuration menu
    Copy the full SHA
    e4c9073 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2020

  1. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Jul 22, 2020
    Configuration menu
    Copy the full SHA
    55fc7f4 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2020

  1. restore: fix conflicted merge

    Hillium committed Jul 24, 2020
    Configuration menu
    Copy the full SHA
    6df57bd View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2020

  1. Merge branch 'master' into pipelined-split

    @3pointer
    3pointer authored Aug 13, 2020
    Configuration menu
    Copy the full SHA
    41095e7 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2020

  1. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Aug 31, 2020
    Configuration menu
    Copy the full SHA
    2353785 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2020

  1. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Sep 2, 2020
    Configuration menu
    Copy the full SHA
    64c9c88 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2020

  1. *: Merge master 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Sep 3, 2020
    Configuration menu
    Copy the full SHA
    d9bf89d View commit details
    Browse the repository at this point in the history

  2. restore: do clean work in a not closed context 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Sep 3, 2020
    Configuration menu
    Copy the full SHA
    8de1774 View commit details
    Browse the repository at this point in the history

  3. restore: fix CI 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Sep 3, 2020
    Configuration menu
    Copy the full SHA
    79a249e View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2020

  1. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Sep 18, 2020
    Configuration menu
    Copy the full SHA
    d51c923 View commit details
    Browse the repository at this point in the history

  2. restore: remove tiflash-relative code 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Sep 18, 2020
    Configuration menu
    Copy the full SHA
    6a29f7f View commit details
    Browse the repository at this point in the history

  3. fix CI 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Sep 18, 2020
    Configuration menu
    Copy the full SHA
    8aee5d6 View commit details
    Browse the repository at this point in the history

  4. restore: fix a malformed printf 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Sep 18, 2020
    Configuration menu
    Copy the full SHA
    461f40c View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Sep 18, 2020
    Configuration menu
    Copy the full SHA
    0f7af92 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Sep 18, 2020
    Configuration menu
    Copy the full SHA
    a8f0f26 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2020

  1. Merge branch 'master' of https://github.com/pingcap/br into pipelined… 

    …-split
    Hillium committed Sep 21, 2020
    Configuration menu
    Copy the full SHA
    7308cba View commit details
    Browse the repository at this point in the history

  2. Merge branch 'pipelined-split' of https://github.com/YuJuncen/br into… 

    … pipelined-split
    Hillium committed Sep 21, 2020
    Configuration menu
    Copy the full SHA
    cd40878 View commit details
    Browse the repository at this point in the history

  3. restore: pass context to RestoreFiles

    Hillium committed Sep 21, 2020
    Configuration menu
    Copy the full SHA
    038e37d View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2020

  1. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Sep 27, 2020
    Configuration menu
    Copy the full SHA
    b2c01fc View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Sep 27, 2020
    Configuration menu
    Copy the full SHA
    273fca1 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2020

  1. Merge branch 'master' into pipelined-split

    @YuJuncen
    YuJuncen authored Oct 9, 2020
    Configuration menu
    Copy the full SHA
    c5fe188 View commit details
    Browse the repository at this point in the history

  2. restore: reset unexpectedly moved to outside 

    Signed-off-by: Hillium <maruruku@stu.csust.edu.cn>
    Hillium committed Oct 9, 2020
    Configuration menu
    Copy the full SHA
    1cb094a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into pipelined-split

    @3pointer
    3pointer authored Oct 9, 2020
    Configuration menu
    Copy the full SHA
    baa2c7e View commit details
    Browse the repository at this point in the history