Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace record checkpoint field with registry log index #171

Merged
merged 4 commits into from
Jul 24, 2023

Conversation

lann
Copy link
Collaborator

@lann lann commented Jul 21, 2023

Prior to this commit, every published record is associated with the first checkpoint created after the record was added to the registry log. While this does aid clients in verifying the inclusion of a record, it is more information than necessary and forces the registry to hold on to all checkpoints indefinitely. It also requires additional bookkeeping just to track this partially-unnecessary information.

This removes that per-record checkpoint and instead associates each record with its index in the registry log. This is still enough information to aid inclusion proofs and reduces the overall complexity of the server.

@lann lann changed the base branch from main to core-svc-refactor July 21, 2023 16:50
Base automatically changed from core-svc-refactor to main July 21, 2023 20:36
@lann lann force-pushed the record-checkpoint-to-registry-index branch from 75a702a to 73da454 Compare July 21, 2023 21:00
@lann lann changed the title Record checkpoint to registry index Replace record checkpoint field with registry log index Jul 21, 2023
@lann lann force-pushed the record-checkpoint-to-registry-index branch from 73da454 to 4de55aa Compare July 21, 2023 21:08
@lann lann force-pushed the record-checkpoint-to-registry-index branch from 4de55aa to 08e9d29 Compare July 21, 2023 21:23
@lann lann marked this pull request as ready for review July 21, 2023 21:23
@lann lann requested a review from peterhuene July 21, 2023 21:23
Copy link
Member

@peterhuene peterhuene left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Really great work! This both simplified things a bit and eliminated that restart checkpoint bug I mentioned earlier.

Just a few nit comments.

crates/server/src/lib.rs Show resolved Hide resolved
crates/server/src/lib.rs Outdated Show resolved Hide resolved
crates/server/src/lib.rs Show resolved Hide resolved
crates/server/src/lib.rs Show resolved Hide resolved
crates/server/src/lib.rs Show resolved Hide resolved
@lann lann merged commit 1cbd8d5 into main Jul 24, 2023
6 checks passed
@lann lann deleted the record-checkpoint-to-registry-index branch July 24, 2023 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants