Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flat storage read MVP mainnet release #8827

Closed
4 tasks done
Tracked by #8893
Longarithm opened this issue Mar 28, 2023 · 4 comments
Closed
4 tasks done
Tracked by #8893

Flat storage read MVP mainnet release #8827

Longarithm opened this issue Mar 28, 2023 · 4 comments
Labels
A-storage Area: storage and databases

Comments

@Longarithm
Copy link
Member

Longarithm commented Mar 28, 2023 •
edited
Loading

Subj. Flat storage code for reads is ready, we mostly need to merge stabilization PR.

Items
@Longarithm Longarithm added the A-storage Area: storage and databases label Mar 28, 2023
@Longarithm Longarithm changed the title Ensure flat storage reads goes to mainnet Ensure flat storage reads going to mainnet Mar 28, 2023
@Longarithm Longarithm mentioned this issue Mar 28, 2023
Closed
26 tasks
@Longarithm Longarithm changed the title Ensure flat storage reads going to mainnet Initiative: Stabilize FS read on Mainnet with improved performance Apr 6, 2023
@Longarithm Longarithm changed the title Initiative: Stabilize FS read on Mainnet with improved performance Flat storage read MVP mainnet release Apr 6, 2023
@Longarithm Longarithm mentioned this issue Apr 6, 2023
Closed
4 tasks
@pugachAG pugachAG mentioned this issue Apr 18, 2023
Merged
near-bulldozer bot pushed a commit that referenced this issue Apr 18, 2023
@pugachAG
Add flat_storage_creation_enabled config flag (#8923)
62921b9 
Part of #8827.

Adds `flat_storage_creation_enabled` config flag to enable/disable flat storage creation. The default value is `true`.

This is needed for SREs to be able to manually enable/disable flat storage creation when taking state backup.
nikurt pushed a commit that referenced this issue Apr 18, 2023
@pugachAG @nikurt
Add flat_storage_creation_enabled config flag (#8923)
dd80642 
Part of #8827.

Adds `flat_storage_creation_enabled` config flag to enable/disable flat storage creation. The default value is `true`.

This is needed for SREs to be able to manually enable/disable flat storage creation when taking state backup.
@Longarithm
Copy link
Member Author

nikurt pushed a commit that referenced this issue Apr 25, 2023
@pugachAG @nikurt
Add flat_storage_creation_enabled config flag (#8923)
d43d012 
Part of #8827.

Adds `flat_storage_creation_enabled` config flag to enable/disable flat storage creation. The default value is `true`.

This is needed for SREs to be able to manually enable/disable flat storage creation when taking state backup.
nikurt pushed a commit that referenced this issue Apr 28, 2023
@pugachAG @nikurt
Add flat_storage_creation_enabled config flag (#8923)
dbc8c78 
Part of #8827.

Adds `flat_storage_creation_enabled` config flag to enable/disable flat storage creation. The default value is `true`.

This is needed for SREs to be able to manually enable/disable flat storage creation when taking state backup.
@Longarithm
Copy link
Member Author

Testnet release including flat storage for reads has been cut: https://github.com/near/nearcore/releases/tag/1.34.0-rc.1

@Longarithm
Copy link
Member Author

Longarithm commented Jun 1, 2023 •
edited
Loading

Flat storage is announced in mainnet release https://github.com/near/nearcore/releases/tag/1.34.0, we are waiting for voting on 12 June. If everything goes well, we can close the issue.

Several issues we were working on:
https://near.zulipchat.com/#narrow/stream/308695-pagoda.2Fprivate/topic/Flat.20storage.20crash.20on.20SIGTERM.201.2E34-RC1/near/358803319 - #9070 mitigates it
https://near.zulipchat.com/#narrow/stream/308695-pagoda.2Fprivate/topic/Testnet.201.2E34.20protocol.20upgrade.20happens.20today/near/360208563 - some monitoring of BP time

@Longarithm
Copy link
Member Author

Longarithm commented Jun 13, 2023 •
edited
Loading

The final step, flat storage protocol upgrade on mainnet, happened today: https://nearinc.grafana.net/d/zzGDUdcnk/debug-metrics?orgId=1&from=1686612374810&to=1686653511328&var-chain_id=mainnet&var-role=All&var-node_type=All&var-node_id=All&var-shard_id=All

Block rate dropped, because several nodes didn't upgrade and were kicked out. It happens each time.
If there are no specific performance issues, I will close this one after a week.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-storage Area: storage and databases
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Longarithm