Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove datastore, fetch latest block #928

Merged
merged 77 commits into from
Nov 26, 2024
Merged

Conversation

volovyks
Copy link
Collaborator

@volovyks volovyks commented Nov 7, 2024

  • Remove DataStore and all related code
  • Add Redis storage manager for persistent in app data (for now only latest processed block)
  • Do not pass latest block in Terraform, we often forget to update those values, not a good practice
  • Fetch latest block using RPC client and use it or use latest processed block (check the logic for more details)

@volovyks volovyks marked this pull request as ready for review November 8, 2024 19:26
@volovyks volovyks requested a review from auto-mausx November 8, 2024 22:44
@volovyks
Copy link
Collaborator Author

volovyks commented Nov 8, 2024

@kmaus-near reverted changes in mpc recovery

This was linked to issues Nov 18, 2024
@volovyks volovyks requested a review from auto-mausx November 18, 2024 13:06
chain-signatures/node/src/indexer.rs Outdated Show resolved Hide resolved
chain-signatures/node/src/storage/app_data_storage.rs Outdated Show resolved Hide resolved
Comment on lines +9 to +10
const APP_DATA_PREFIX: &str = "app_data";
const APP_DATA_STORAGE_VERSION: &str = "v1";
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

these configs should live in the contract config

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should change them in case of a breaking change in storage. It may be useful for hotfixes, like resetting all triples, but I do not want to add it now.

chain-signatures/node/src/storage/app_data_storage.rs Outdated Show resolved Hide resolved
chain-signatures/node/src/indexer.rs Outdated Show resolved Hide resolved
chain-signatures/node/src/indexer.rs Show resolved Hide resolved
infra/multichain-dev/variables.tf Outdated Show resolved Hide resolved
@volovyks volovyks requested a review from ppca November 25, 2024 21:01
Copy link
Contributor

@ppca ppca left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm. Please wait for @ChaoticTempest 's review since he wrote a lot of the indexer logic.

@volovyks
Copy link
Collaborator Author

@ppca I will merge it now, @ChaoticTempest saw it before and is having issues with his laptop. We must test how it affects our stability and speed before the release.
@ChaoticTempest please, review it anyway once you have a chance. I will address them in a separate PR.

@volovyks volovyks merged commit 90e1b92 into develop Nov 26, 2024
3 checks passed
@volovyks volovyks deleted the serhii/remove-datastore branch November 26, 2024 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove Datastore Fetch current block heihgt on node start.
5 participants