Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MOLT Fetch failback mode #18990

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

MOLT Fetch failback mode #18990

wants to merge 5 commits into from

Conversation

Copy link

netlify bot commented Oct 4, 2024

Deploy Preview for cockroachdb-interactivetutorials-docs canceled.

Name Link
🔨 Latest commit 9c8271d
🔍 Latest deploy log https://app.netlify.com/sites/cockroachdb-interactivetutorials-docs/deploys/6711809f199ac4000843d793

Copy link

netlify bot commented Oct 4, 2024

Deploy Preview for cockroachdb-api-docs canceled.

Name Link
🔨 Latest commit 9c8271d
🔍 Latest deploy log https://app.netlify.com/sites/cockroachdb-api-docs/deploys/6711809f5dfa7f00087207f8

Copy link

github-actions bot commented Oct 4, 2024

Files changed:

Copy link

netlify bot commented Oct 4, 2024

Deploy Preview for cockroachdb-docs failed. Why did it fail? →

Name Link
🔨 Latest commit 5ee36f5
🔍 Latest deploy log https://app.netlify.com/sites/cockroachdb-docs/deploys/670042c0fc8f7e0009c6cb9d

Copy link

netlify bot commented Oct 4, 2024

Netlify Preview

Name Link
🔨 Latest commit 9c8271d
🔍 Latest deploy log https://app.netlify.com/sites/cockroachdb-docs/deploys/6711809ff807fd0008baf472
😎 Deploy Preview https://deploy-preview-18990--cockroachdb-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@taroface
Copy link
Contributor Author

@ryanluu12345 Friendly ping for review!

--mode import-only
~~~

#### Fail back to source database

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: are we using "fail back" or "failback" as two or one word(s) respectively?

Copy link
Contributor Author

@taroface taroface Oct 15, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Fail back" is the verb and "failback" is the noun for the operation, e.g., "you fail back by performing a failback operation". Does that make sense? ("Failback operation" is also redundant as we can just say "perform failback".)

#### Fail back to source database

{{site.data.alerts.callout_info}}
`failback` mode supports MySQL 8.0 and later.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Super nit: "mode only supports MySQL 8.0". Although with pending work this may change. So keep an eye out for 5.7 support that we're working on. We'll keep you posted.

`failback` mode supports MySQL 8.0 and later.
{{site.data.alerts.end}}

If you encounter issues after moving data to CockroachDB, you can use `failback` to replicate changes on CockroachDB back to the initial source database. In case you need to roll back the migration, this ensures that data is consistent on the source.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rohan-joshi this is not the only case where customers fail back right? Sometimes, folks want to write data back just as a backup or if they want to keep their original DB up to date just in case right? Not only during failures.

src/current/molt/molt-fetch.md Outdated Show resolved Hide resolved
--table-filter 'employees, payments'
~~~

`failback` mode creates a [CockroachDB changefeed]({% link {{ site.current_cloud_version }}/change-data-capture-overview.md %}) that passes change events from CockroachDB to a [webhook sink]({% link {{ site.current_cloud_version }}/changefeed-sinks.md %}#webhook-sink). However, if there is already a running CockroachDB changefeed with the same webhook sink URL (excluding query parameters) and [watched rows]({% link {{ site.current_cloud_version }}/changefeed-sinks.md %}), the existing changefeed is used for `failback`.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also it's not "watched rows", it's "watched tables". We match on same tables + same URL

Copy link
Contributor Author

@taroface taroface Oct 15, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm using our CDC term "watched rows" which seems to mean the same thing. The rows being watched are the ones in the specified table names. See: https://www.cockroachlabs.com/docs/stable/change-data-capture-overview

Do you think this is too confusing? I assumed it was a standard CDC term. cc @rohan-joshi

src/current/molt/molt-fetch.md Outdated Show resolved Hide resolved
src/current/molt/molt-fetch.md Outdated Show resolved Hide resolved
@taroface
Copy link
Contributor Author

@ryanluu12345 Updated. PTAL!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants