Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM's dm-worker can't support pull exceeded 4GB binlog. #5102

Open
superlzs0476 opened this issue Sep 4, 2020 · 0 comments
Open

DM's dm-worker can't support pull exceeded 4GB binlog. #5102

superlzs0476 opened this issue Sep 4, 2020 · 0 comments
Labels
area/dm Issues or PRs related to DM. type/feature Issues about a new feature

Comments

@superlzs0476
Copy link

Bug Report

Please answer these questions before submitting your issue. Thanks!

  1. What did you do? If possible, provide a recipe for reproducing the error.

As the source of MySQL produces exceeded 4GB Binlogs, DM-work will be abort and wait for the operator manual redo this task that Binlogs from the source platform to target dm-worker of rely-dir.

  1. What did you expect to see?

Dm-worker supports pull exceeded 4GB Binlog from source Mysql.

  1. What did you see instead?

https://docs.pingcap.com/tidb-data-migration/v2.0/error-handling#solutions-1

  1. Versions of the cluster

    • DM version (run dmctl -V or dm-worker -V or dm-master -V):

      (paste DM version here, and you must ensure versions of dmctl, DM-worker and DM-master are same)
      

All of DM version

- Upstream MySQL/MariaDB server version:

    ```
    (paste upstream MySQL/MariaDB server version here)
    ```

- Downstream TiDB cluster version (execute `SELECT tidb_version();` in a MySQL client):

    ```
    (paste TiDB cluster version here)
    ```

- How did you deploy DM: DM-Ansible or manually?

    ```
    (leave DM-Ansible or manually here)
    ```

- Other interesting information (system version, hardware config, etc):

    >
    >
  1. current status of DM cluster (execute query-status in dmctl)

  2. Operation logs

    • Please upload dm-worker.log for every DM-worker instance if possible
    • Please upload dm-master.log if possible
    • Other interesting logs
    • Output of dmctl's commands with problems
  3. Configuration of the cluster and the task

    • dm-worker.toml for every DM-worker instance if possible
    • dm-master.toml for DM-master if possible
    • task config, like task.yaml if possible
    • inventory.ini if deployed by DM-Ansible
  4. Screenshot/exported-PDF of Grafana dashboard or metrics' graph in Prometheus for DM if possible

@superlzs0476 superlzs0476 changed the title DM's dm-worker can't support pull more than 4GB binlog. DM's dm-worker can't support pull exceeded 4GB binlog. Sep 4, 2020
@scsldb scsldb added feature/accept type/feature-request Categorizes issue or PR as related to a new feature. priority/normal labels Sep 4, 2020
@lance6716 lance6716 transferred this issue from pingcap/dm Apr 2, 2022
@lance6716 lance6716 added area/dm Issues or PRs related to DM. type/feature Issues about a new feature and removed priority/normal type/feature-request Categorizes issue or PR as related to a new feature. feature/accept labels Apr 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/dm Issues or PRs related to DM. type/feature Issues about a new feature
Projects
None yet
Development

No branches or pull requests

3 participants