From 219998e57bdf067e6bdc1760a16adfee23f25a2f Mon Sep 17 00:00:00 2001 From: Ryan Kuo Date: Wed, 16 Oct 2024 13:09:38 -0400 Subject: [PATCH] add Fetch best practices --- src/current/molt/molt-fetch.md | 2 ++ src/current/v24.2/migration-overview.md | 6 +++--- src/current/v24.3/migration-overview.md | 6 +++--- 3 files changed, 8 insertions(+), 6 deletions(-) diff --git a/src/current/molt/molt-fetch.md b/src/current/molt/molt-fetch.md index 11bf890dcde..e1488e2f6bf 100644 --- a/src/current/molt/molt-fetch.md +++ b/src/current/molt/molt-fetch.md @@ -82,6 +82,8 @@ Complete the following items before using MOLT Fetch: - When using [`IMPORT INTO`](#data-movement) to load tables into CockroachDB, if the fetch task terminates before the import job completes, the hanging import job on the target database will keep the table offline. To make this table accessible again, [manually resume or cancel the job]({% link {{site.current_cloud_version}}/import-into.md %}#view-and-control-import-jobs). Then resume `molt fetch` using [continuation](#fetch-continuation), or restart the task from the beginning. +- Ensure that the machine running MOLT Fetch is large enough to handle the amount of data being migrated. Fetch performance can sometimes be limited by available resources, but should always be making progress. To identify possible resource constraints, set `--logging debug` and observe the [metrics endpoint](#metrics). + ## Security recommendations Cockroach Labs **strongly** recommends the following: diff --git a/src/current/v24.2/migration-overview.md b/src/current/v24.2/migration-overview.md index 11b648d064a..ca18ae2f4b5 100644 --- a/src/current/v24.2/migration-overview.md +++ b/src/current/v24.2/migration-overview.md @@ -221,9 +221,9 @@ You can use the following [MOLT (Migrate Off Legacy Technology) tools]({% link m First, convert your database schema to an equivalent CockroachDB schema: -- Use the [Schema Conversion Tool]({% link cockroachcloud/migrations-page.md %}) to convert your schema line-by-line. This requires a free [CockroachDB {{ site.data.products.cloud }} account]({% link cockroachcloud/create-an-account.md %}). The tool will convert the syntax, identify [unimplemented features and syntax incompatibilities](#unimplemented-features-and-syntax-incompatibilities) in the schema, and suggest edits according to CockroachDB [best practices](#schema-design-best-practices). - {{site.data.alerts.callout_info}} - The Schema Conversion Tool accepts `.sql` files from PostgreSQL, MySQL, Oracle, and Microsoft SQL Server. +- Use the [Schema Conversion Tool]({% link cockroachcloud/migrations-page.md %}) to convert your schema line-by-line. The Schema Conversion Tool accepts `.sql` files from PostgreSQL, MySQL, Oracle, and Microsoft SQL Server. This requires a free [CockroachDB {{ site.data.products.cloud }} account]({% link cockroachcloud/create-an-account.md %}). The tool will convert the syntax, identify [unimplemented features and syntax incompatibilities](#unimplemented-features-and-syntax-incompatibilities) in the schema, and suggest edits according to CockroachDB [best practices](#schema-design-best-practices). + {{site.data.alerts.callout_success}} + If the Schema Conversion Tool is not an option when migrating from PostgreSQL, you can enable automatic schema creation when [loading data](#load-test-data) with MOLT Fetch. The [`--table-handling drop-on-target-and-recreate`]({% link molt/molt-fetch.md %}#target-table-handling) option creates a one-to-one mapping between PostgreSQL and CockroachDB, and works well when the PostgreSQL schema is well-defined. For additional help, contact your account team. {{site.data.alerts.end}} - Alternatively, manually convert the schema according to our [schema design best practices](#schema-design-best-practices){% comment %}and data type mappings{% endcomment %}. You can also [export a partially converted schema]({% link cockroachcloud/migrations-page.md %}#export-the-schema) from the Schema Conversion Tool to finish the conversion manually. diff --git a/src/current/v24.3/migration-overview.md b/src/current/v24.3/migration-overview.md index 11b648d064a..ca18ae2f4b5 100644 --- a/src/current/v24.3/migration-overview.md +++ b/src/current/v24.3/migration-overview.md @@ -221,9 +221,9 @@ You can use the following [MOLT (Migrate Off Legacy Technology) tools]({% link m First, convert your database schema to an equivalent CockroachDB schema: -- Use the [Schema Conversion Tool]({% link cockroachcloud/migrations-page.md %}) to convert your schema line-by-line. This requires a free [CockroachDB {{ site.data.products.cloud }} account]({% link cockroachcloud/create-an-account.md %}). The tool will convert the syntax, identify [unimplemented features and syntax incompatibilities](#unimplemented-features-and-syntax-incompatibilities) in the schema, and suggest edits according to CockroachDB [best practices](#schema-design-best-practices). - {{site.data.alerts.callout_info}} - The Schema Conversion Tool accepts `.sql` files from PostgreSQL, MySQL, Oracle, and Microsoft SQL Server. +- Use the [Schema Conversion Tool]({% link cockroachcloud/migrations-page.md %}) to convert your schema line-by-line. The Schema Conversion Tool accepts `.sql` files from PostgreSQL, MySQL, Oracle, and Microsoft SQL Server. This requires a free [CockroachDB {{ site.data.products.cloud }} account]({% link cockroachcloud/create-an-account.md %}). The tool will convert the syntax, identify [unimplemented features and syntax incompatibilities](#unimplemented-features-and-syntax-incompatibilities) in the schema, and suggest edits according to CockroachDB [best practices](#schema-design-best-practices). + {{site.data.alerts.callout_success}} + If the Schema Conversion Tool is not an option when migrating from PostgreSQL, you can enable automatic schema creation when [loading data](#load-test-data) with MOLT Fetch. The [`--table-handling drop-on-target-and-recreate`]({% link molt/molt-fetch.md %}#target-table-handling) option creates a one-to-one mapping between PostgreSQL and CockroachDB, and works well when the PostgreSQL schema is well-defined. For additional help, contact your account team. {{site.data.alerts.end}} - Alternatively, manually convert the schema according to our [schema design best practices](#schema-design-best-practices){% comment %}and data type mappings{% endcomment %}. You can also [export a partially converted schema]({% link cockroachcloud/migrations-page.md %}#export-the-schema) from the Schema Conversion Tool to finish the conversion manually.