Skip to content
This repository has been archived by the owner on Dec 8, 2021. It is now read-only.

restore: Try to create tables in parallel #502

Merged
merged 57 commits into from
Jan 6, 2021
Merged

restore: Try to create tables in parallel #502

merged 57 commits into from
Jan 6, 2021

Commits on Dec 3, 2020

  1. restore: try to create tables in parallel

    @hidehalo
    hidehalo committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    d7ce306 View commit details
    Browse the repository at this point in the history

  2. glue: fix error condition test for db close

    @hidehalo
    hidehalo committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    886908d View commit details
    Browse the repository at this point in the history

  3. restore, glue: remove duplicate db pool implementation

    @hidehalo
    hidehalo committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    fd8a5de View commit details
    Browse the repository at this point in the history

  4. restore: try to prevent db connection too early

    @hidehalo
    hidehalo committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    5f91c56 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2020

  1. restore: try to prevent db connection too early

    @hidehalo
    hidehalo committed Dec 8, 2020
    Configuration menu
    Copy the full SHA
    18eb88c View commit details
    Browse the repository at this point in the history

  2. restore: try to make restore schema run parallel totally

    @hidehalo
    hidehalo committed Dec 8, 2020
    Configuration menu
    Copy the full SHA
    c5b48a4 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'test-434' into issue-434

    @hidehalo
    hidehalo committed Dec 8, 2020
    Configuration menu
    Copy the full SHA
    75a5baa View commit details
    Browse the repository at this point in the history

  4. restore: remove impl&test of tidb#InitSchema

    @hidehalo
    hidehalo committed Dec 8, 2020
    Configuration menu
    Copy the full SHA
    92699bd View commit details
    Browse the repository at this point in the history

  5. restore: make restore schema run parallelly

    @hidehalo
    hidehalo committed Dec 8, 2020
    Configuration menu
    Copy the full SHA
    c7f0420 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2020

  1. restore: remove db connection control

    @hidehalo
    hidehalo committed Dec 9, 2020
    Configuration menu
    Copy the full SHA
    8a4118c View commit details
    Browse the repository at this point in the history

  2. restore: a little change of restore schema schedule

    @hidehalo
    hidehalo committed Dec 9, 2020
    Configuration menu
    Copy the full SHA
    5d07779 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2020

  1. Merge branch 'master' into issue-434

    @lance6716
    lance6716 authored Dec 11, 2020
    Configuration menu
    Copy the full SHA
    d751937 View commit details
    Browse the repository at this point in the history

  2. wip

    @hidehalo
    hidehalo committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    af5a19b View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2020

  1. restore: keep restore schema job hold the same session(DB connection)

    @hidehalo
    hidehalo committed Dec 13, 2020
    Configuration menu
    Copy the full SHA
    4331dca View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into issue-434

    @hidehalo
    hidehalo authored Dec 13, 2020
    Configuration menu
    Copy the full SHA
    a4c41e1 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2020

  1. restore: fix log message error

    @hidehalo
    hidehalo committed Dec 14, 2020
    Configuration menu
    Copy the full SHA
    4491add View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into issue-434

    @glorv
    glorv authored Dec 14, 2020
    Configuration menu
    Copy the full SHA
    8567813 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2020

  1. restore: remove purpose array for restoreSchemaWorker 

    more details pingcap#502 (comment)
    @hidehalo
    hidehalo committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    8bce7fc View commit details
    Browse the repository at this point in the history

  2. restore: remove useless sql mode set code 

    for more pingcap#502 (comment)
    @hidehalo
    hidehalo committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    494f67c View commit details
    Browse the repository at this point in the history

  3. restore: restore view statements run after database|table created 

    for more: pingcap#502 (comment)
    @hidehalo
    hidehalo committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    25aea0d View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'pingcap/master' into issue-434

    @hidehalo
    hidehalo committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    74f9025 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'issue-434' of https://github.com/hidehalo/tidb-lightning … 

    …into issue-434
    @hidehalo
    hidehalo committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    fee4594 View commit details
    Browse the repository at this point in the history

  6. restore: interrupt job producing when error happens

    @hidehalo
    hidehalo committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    0e315ca View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2020

  1. util: add SQLDriver interface

    @hidehalo
    hidehalo committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    3e2cc16 View commit details
    Browse the repository at this point in the history

  2. restore: make sure single restore schema job vs. single db session

    @hidehalo
    hidehalo committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    52168fc View commit details
    Browse the repository at this point in the history

  3. restore: run restore view schema statements in txn

    @hidehalo
    hidehalo committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    1dd9152 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2020

  1. glue: add checkpoints.Session implementation(sqlConnSession)

    @hidehalo
    hidehalo committed Dec 17, 2020
    Configuration menu
    Copy the full SHA
    8d01745 View commit details
    Browse the repository at this point in the history

  2. restore: close whole database connections after restore schema done

    @hidehalo
    hidehalo committed Dec 17, 2020
    Configuration menu
    Copy the full SHA
    09d06d4 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2020

  1. restore: revert remove of InitSchema 

    for more: pingcap#502 (comment)
    @hidehalo
    hidehalo committed Dec 18, 2020
    Configuration menu
    Copy the full SHA
    90e9305 View commit details
    Browse the repository at this point in the history

  2. glue: return a new error when sqlConnSesson.CommitTxn called

    @hidehalo
    hidehalo committed Dec 18, 2020
    Configuration menu
    Copy the full SHA
    bc32cf8 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2020

  1. Revert "util: add SQLDriver interface" 

    This reverts commit 3e2cc16.
    @hidehalo
    hidehalo committed Dec 21, 2020
    Configuration menu
    Copy the full SHA
    a9c00ca View commit details
    Browse the repository at this point in the history

  2. glue: update GetSession(context.Context) for Glue interface

    @hidehalo
    hidehalo committed Dec 21, 2020
    Configuration menu
    Copy the full SHA
    dafcf31 View commit details
    Browse the repository at this point in the history

  3. glue: disable more methods of sqlConnSession

    @hidehalo
    hidehalo committed Dec 21, 2020
    Configuration menu
    Copy the full SHA
    2539b7d View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'pingcap/master' into issue-434

    @hidehalo
    hidehalo committed Dec 21, 2020
    Configuration menu
    Copy the full SHA
    3ee2e97 View commit details
    Browse the repository at this point in the history

  5. restore: disable implicit initiation of sync.WaitGroup

    @hidehalo
    hidehalo committed Dec 21, 2020
    Configuration menu
    Copy the full SHA
    1542e52 View commit details
    Browse the repository at this point in the history

  6. restore: cancel nil error throw when restore schema done

    @hidehalo
    hidehalo committed Dec 21, 2020
    Configuration menu
    Copy the full SHA
    9a27c33 View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'pingcap/master' into issue-434

    @hidehalo
    hidehalo committed Dec 21, 2020
    Configuration menu
    Copy the full SHA
    cdc2ae9 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' into issue-434

    @lance6716
    lance6716 authored Dec 21, 2020
    Configuration menu
    Copy the full SHA
    983d913 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2020

  1. restore: replace session map to pool

    @hidehalo
    hidehalo committed Dec 22, 2020
    Configuration menu
    Copy the full SHA
    b35b26e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'issue-434' of https://github.com/hidehalo/tidb-lightning … 

    …into issue-434
    @hidehalo
    hidehalo committed Dec 22, 2020
    Configuration menu
    Copy the full SHA
    c0e6692 View commit details
    Browse the repository at this point in the history

  3. restore: keep restore table statements ordered

    @hidehalo
    hidehalo committed Dec 22, 2020
    Configuration menu
    Copy the full SHA
    b376656 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2020

  1. restore: assign single session to restoreSchemaWorker#doJob's gorou… 

    …tine
    @hidehalo
    hidehalo committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    e2cf8e7 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'pingcap/master' into issue-434

    @hidehalo
    hidehalo committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    48195f8 View commit details
    Browse the repository at this point in the history

  3. restore: add log for restoreSchema

    @hidehalo
    hidehalo committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    9fea8d0 View commit details
    Browse the repository at this point in the history

  4. restore: add quit case when error thrown blocked

    @hidehalo
    hidehalo committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    5bd96c8 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2020

  1. restore: Improve the robustness of concurrency pattern

    @hidehalo
    hidehalo committed Dec 30, 2020
    Configuration menu
    Copy the full SHA
    336fe52 View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2020

  1. restore: fix channel send/recv logic to avoid blocked forever occurs.

    @hidehalo
    hidehalo committed Dec 31, 2020
    Configuration menu
    Copy the full SHA
    8eed047 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'pingcap/master' into issue-434

    @hidehalo
    hidehalo committed Dec 31, 2020
    Configuration menu
    Copy the full SHA
    1690e4a View commit details
    Browse the repository at this point in the history

  3. restore: sync.WaitGroup#Add first when restoreSchemaWorker#appendJob

    @hidehalo
    hidehalo committed Dec 31, 2020
    Configuration menu
    Copy the full SHA
    42f46b7 View commit details
    Browse the repository at this point in the history

  4. restore: add impl of schemaStmtType#String

    @hidehalo
    hidehalo committed Dec 31, 2020
    Configuration menu
    Copy the full SHA
    911440e View commit details
    Browse the repository at this point in the history

  5. restore: avoid to wait whole jobs done forever when goroutine of `doJ… 

    …ob` exit unnormal
    @hidehalo
    hidehalo committed Dec 31, 2020
    Configuration menu
    Copy the full SHA
    e914004 View commit details
    Browse the repository at this point in the history

Commits on Jan 1, 2021

  1. restore: call cancel function when makeJobs exit

    @hidehalo
    hidehalo committed Jan 1, 2021
    Configuration menu
    Copy the full SHA
    d123a85 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2021

  1. restore: a few improvement

    @hidehalo
    hidehalo committed Jan 5, 2021
    Configuration menu
    Copy the full SHA
    e2c2022 View commit details
    Browse the repository at this point in the history

  2. test: add unit tests of RestoreController#restoreSchema()

    @hidehalo
    hidehalo committed Jan 5, 2021
    Configuration menu
    Copy the full SHA
    1fcc9df View commit details
    Browse the repository at this point in the history

  3. Merge branch 'issue-434' of https://github.com/hidehalo/tidb-lightning … 

    …into issue-434
    @hidehalo
    hidehalo committed Jan 5, 2021
    Configuration menu
    Copy the full SHA
    ef85de8 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'pingcap/master' into issue-434

    @hidehalo
    hidehalo committed Jan 5, 2021
    Configuration menu
    Copy the full SHA
    08acbc1 View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2021

  1. Merge branch 'master' into issue-434

    @glorv
    glorv authored Jan 6, 2021
    Configuration menu
    Copy the full SHA
    e02a4a7 View commit details
    Browse the repository at this point in the history