Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make validators restartable #299

Closed
3 tasks done
aeyakovenko opened this issue Jun 1, 2018 · 8 comments
Closed
3 tasks done

Make validators restartable #299

aeyakovenko opened this issue Jun 1, 2018 · 8 comments
Assignees
@rob-solana
Milestone
v0.7.0

Comments

@aeyakovenko
Copy link
Member

aeyakovenko commented Jun 1, 2018 •
edited by rob-solana
Loading

  • Leader writes to a log file, all the validators rsync this file (with --append, maybe)
  • After validators boot up and run the log file through their banking stage, they need to sync any additional entries that were added since the log was synced. This should happen automatically as part of repairing the window.
  • connect to network without needing leader's full config
@garious garious assigned mvines and unassigned mvines Jun 3, 2018
@garious garious changed the title testnet checklist Make fullnodes restartable Jun 4, 2018
@garious garious changed the title Make fullnodes restartable Make validators restartable Jun 4, 2018
@garious garious added this to the v0.7.0 milestone Jun 12, 2018
@rob-solana
Copy link
Contributor

why can validators assume that generators only append to genesis.log?
validator.sh doesn't use rsync --append, but should as part of this issue?

@garious
Copy link
Contributor

garious commented Jun 14, 2018

Validators can assume the transaction log is append-only if the leader either:

  1. Postpones writing to the log until after the election results are in
  2. Never outputs invalid transactions

At the time of this writing, we're on path 2. There's an open ticket for path 1 assigned to the v0.8.0 milestone.

Correct, validator.sh currently doesn't use rsync --append. We believe that it should, but do whatever you think is best.

@aeyakovenko
Copy link
Member Author

Even with 2, should be ok. Validators could simply skip invalid transactions, assume the leader snuck in some spam if the invalid transactions have been finalized. The only case we need to worry about is invalid transactions at the tail end, then this validator needs to make a decision to finalize or go to the next leader.

@garious
Copy link
Contributor

garious commented Jun 14, 2018

For v0.7.0, we'll hold the leader role, so no concern of it inserting spam. If a validator spots an invalid transaction on the log, it's because there's a bug in either the leader or validator. I'm aware of one such bug. I'll buy you a beer if you can spot it. :)

@garious
Copy link
Contributor

garious commented Jun 14, 2018

Two beers if you add the missing testcase to bank.rs (hint).

@aeyakovenko
Copy link
Member Author

The sync should happen automatically as part of repairing the window.

@aeyakovenko aeyakovenko mentioned this issue Jun 23, 2018
Closed
@garious garious mentioned this issue Jun 25, 2018
Closed
@rob-solana
Copy link
Contributor

left to do on this (I think):

  1. a persistent ledger (not stdin+stdout), based on Entry height (aka blob index)
  2. leader and validator support for repairing from the persistent ledger (i.e. an infinite window)

@rob-solana rob-solana mentioned this issue Jul 9, 2018
Merged
rob-solana added a commit to rob-solana/solana that referenced this issue Jul 9, 2018
@rob-solana
fixes issue solana-labs#299
1d597c7
rob-solana added a commit that referenced this issue Jul 9, 2018
@rob-solana
fixes issue #299
90a4ab7
@rob-solana
Copy link
Contributor

completed with #524

vkomenda pushed a commit to vkomenda/solana that referenced this issue Aug 29, 2021
@dankelleher
Fix an issue in do.sh where the 'all' argument didn't work, e.g. for …
b355a95 
…do.sh build all (solana-labs#299)
lijunwangs pushed a commit to lijunwangs/solana that referenced this issue Mar 18, 2024
@mergify
v1.17: Make the quic server connection table use an async lock, reduc…
29c004c 
…ing thrashing (backport of solana-labs#293) (solana-labs#299)

Make the quic server connection table use an async lock
willhickey pushed a commit that referenced this issue Mar 23, 2024
@mergify @willhickey
v1.17: Make the quic server connection table use an async lock, reduc…
3b327c6 
…ing thrashing (backport of #293) (#299)

Make the quic server connection table use an async lock
godmodegalactus pushed a commit to blockworks-foundation/solana that referenced this issue Jun 10, 2024
@buffalu
jito patch
47a347d 
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step
- More release fixes

Fix release process

Backports solana-labs#595: correctly initialize account overrides (solana-labs#596)

Fix: Ensure set contact info to UDP port instead of QUIC (Backport solana-labs#601 to v1.18) (solana-labs#602)

Buffer bundles that exceed processing time and make the allowed processing time longer (solana-labs#610)
vovkman pushed a commit to helius-labs/solana that referenced this issue Jun 13, 2024
@buffalu
jito patch
70a8ff9 
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step
- More release fixes

Fix release process

Backports solana-labs#595: correctly initialize account overrides (solana-labs#596)

Fix: Ensure set contact info to UDP port instead of QUIC (Backport solana-labs#601 to v1.18) (solana-labs#602)

Buffer bundles that exceed processing time and make the allowed processing time longer (solana-labs#610)
ruuda pushed a commit to ChorusOne/solana that referenced this issue Jul 15, 2024
@buffalu
jito patch
31e2b12 
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step
- More release fixes

Fix release process

Backports solana-labs#595: correctly initialize account overrides (solana-labs#596)

Fix: Ensure set contact info to UDP port instead of QUIC (Backport solana-labs#601 to v1.18) (solana-labs#602)

Buffer bundles that exceed processing time and make the allowed processing time longer (solana-labs#610)

update jito-programs submodule
Szymongib pushed a commit to ChorusOne/solana that referenced this issue Jul 29, 2024
@buffalu
jito patch
2953352 
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step
- More release fixes

Fix release process

Backports solana-labs#595: correctly initialize account overrides (solana-labs#596)

Fix: Ensure set contact info to UDP port instead of QUIC (Backport solana-labs#601 to v1.18) (solana-labs#602)

Buffer bundles that exceed processing time and make the allowed processing time longer (solana-labs#610)

update jito-programs submodule
vovkman pushed a commit to helius-labs/solana that referenced this issue Aug 20, 2024
@buffalu
jito patch
93fa888 
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step

Add more release fixes (solana-labs#585)

Fix more release urls (solana-labs#588)

[JIT-1812] Fix blocking mutexs (solana-labs#495)

 [JIT-1711] Compare the unprocessed transaction storage BundleStorage against a constant instead of VecDeque::capacity() (solana-labs#587)

Automatically rebase Jito-Solana on a periodic basis. Send message on slack during any failures or success.

Fix periodic rebase solana-labs#594

Fixes the following bugs in the periodic rebase:
Sends multiple messages on failure instead of one
Cancels entire job if one branch fails

Ignore buildkite curl errors for rebasing and try to keep curling until job times out (solana-labs#597)

Sleep longer waiting for buildkite to start (solana-labs#598)

correctly initialize account overrides (solana-labs#595)

Fix: Ensure set contact info to UDP port instead of QUIC (solana-labs#603)

Add fast replay branch to daily rebase (solana-labs#607)

take a snapshot of all bundle accounts before sim (solana-labs#13) (solana-labs#615)

update jito-programs submodule
techiepriyansh pushed a commit to ChorusOne/solana that referenced this issue Oct 2, 2024
@buffalu
jito patch
025f00e 
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step

Add more release fixes (solana-labs#585)

Fix more release urls (solana-labs#588)

[JIT-1812] Fix blocking mutexs (solana-labs#495)

 [JIT-1711] Compare the unprocessed transaction storage BundleStorage against a constant instead of VecDeque::capacity() (solana-labs#587)

Automatically rebase Jito-Solana on a periodic basis. Send message on slack during any failures or success.

Fix periodic rebase solana-labs#594

Fixes the following bugs in the periodic rebase:
Sends multiple messages on failure instead of one
Cancels entire job if one branch fails

Ignore buildkite curl errors for rebasing and try to keep curling until job times out (solana-labs#597)

Sleep longer waiting for buildkite to start (solana-labs#598)

correctly initialize account overrides (solana-labs#595)

Fix: Ensure set contact info to UDP port instead of QUIC (solana-labs#603)

Add fast replay branch to daily rebase (solana-labs#607)

take a snapshot of all bundle accounts before sim (#13) (solana-labs#615)

update jito-programs submodule
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rob-solana rob-solana

Labels
None yet
Projects
None yet
Milestone
v0.7.0
Development

No branches or pull requests
5 participants
@garious @sakridge @aeyakovenko @mvines @rob-solana