Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add monetate_crc32 multi-column vindex. #1

Merged
merged 1 commit into from
Sep 24, 2023

Conversation

jjpersch
Copy link

@jjpersch jjpersch commented Sep 21, 2023

Why?

Enable migration from existing application layer sharding implementation to Vitess.

What?

Compute multi-column vindex compatible with existing application layer sharding.
Supports integer, varchar, and varbinary columns.

Given vindex on multiple columns such as:

"columns": ["a", "b", "c"]

computes 20 bit virtual shard id matching

CRC32(CONCAT(a, '/', b, '/', c)) % 1048576

@jjpersch jjpersch changed the base branch from main to monetate-v0.17.2 September 21, 2023 13:26
@jjpersch jjpersch force-pushed the monetate-crc32-sharding branch from 0b6cad9 to 3287156 Compare September 21, 2023 13:32
@jjpersch jjpersch changed the title monetate crc32 sharding Add monetate_crc32 multi-column vindex. Sep 21, 2023
@jjpersch jjpersch deleted the branch monetate-v17.0.2 September 22, 2023 18:14
@jjpersch jjpersch closed this Sep 22, 2023
@jjpersch jjpersch reopened this Sep 22, 2023
@jjpersch jjpersch changed the base branch from monetate-v0.17.2 to monetate-v17.0.2 September 22, 2023 18:26
@jjpersch jjpersch force-pushed the monetate-crc32-sharding branch from 3287156 to fbba958 Compare September 22, 2023 18:41
Compute multi-column vindex compatible with existing application layer sharding.
Supports integer, varchar, and varbinary columns.

Signed-off-by: Jeffrey J. Persch <jjpersch@monetate.com>
@jjpersch jjpersch force-pushed the monetate-crc32-sharding branch from fbba958 to 78aa9f7 Compare September 22, 2023 21:14
@jjpersch jjpersch merged commit 234d6ed into monetate-v17.0.2 Sep 24, 2023
@jjpersch jjpersch deleted the monetate-crc32-sharding branch September 24, 2023 00:28
jjpersch added a commit that referenced this pull request Dec 21, 2023
Compute multi-column vindex compatible with existing application layer sharding.
Supports integer, varchar, and varbinary columns.

Signed-off-by: Jeffrey J. Persch <jjpersch@monetate.com>
jjpersch added a commit that referenced this pull request Mar 10, 2024
Compute multi-column vindex compatible with existing application layer sharding.
Supports integer, varchar, and varbinary columns.

Signed-off-by: Jeffrey J. Persch <jjpersch@monetate.com>
jjpersch added a commit that referenced this pull request Mar 14, 2024
Compute multi-column vindex compatible with existing application layer sharding.
Supports integer, varchar, and varbinary columns.

Signed-off-by: Jeffrey J. Persch <jjpersch@monetate.com>
jjpersch added a commit that referenced this pull request Jun 28, 2024
Compute multi-column vindex compatible with existing application layer sharding.
Supports integer, varchar, and varbinary columns.

Signed-off-by: Jeffrey J. Persch <jjpersch@monetate.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant