feat: create DDProvider config #1679
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
nonsense
approved these changes
Sep 7, 2023
nonsense
added a commit
that referenced
this pull request
Oct 5, 2023
* add dummy direct deals provider * add initial `import-direct` cmd * updated make gen and make docsgen * direct deals provider * steps to onboard direct data * sql table; direct data entry state; ORM * scaffolding up to Filecoin.SectorAddPieceToAny * rename DirectData to DirectDeal * remove docker-tc * fix AllocationId type to uint64 * remove VerifiedDeal field in DirectDeal table * update ifaces to add fast-retrieval and skip-ipni-announce * fast-retrieval becomes remove-unsealed-copy * add checkpoints to direct deal model * initial state into local db * add extra fields * feat: add `boost allocate` and `boost get-allocations` command (#1632) * add allocate & get-allocations command * comment out fullNode dependent lines * clarify error * update lotus, uncomment check code * go mod tidy * bump FFI, fix EthCall * docsgen * direct data onboarding: refactor/extract commp, use checkpoints for retries, retries on startup (#1650) * extract and refactor commp for direct deals * split Import into Import and Process, and Process all deals on startup * update Process with checkpoints check * handle commp size * devnet support for filplus (#1655) * comment * add signers and notaries * fixup * fixup * get allocation * lock lotus version * lock lotus to latest PR version * fill PieceDealInfo * bump up datacap * check for nil allocation; set ClientAddress and ProviderAddress in sqlitedb * take actor ID for a wallet from state * fixup * add start and end epoch * add startEpochSealingBuffer and compare startEpoch against chain head * comments and fixup * commpcalc; listActive * fix: doc gen * Web UI: direct deals list (#1665) * feat: ui - direct deals list * feat: direct deals ui - direct deal detail page (#1669) * fix: test compilation * fix: cbor gen * refactor: simplify db code * feat: ui - add direct deals link to menu * fix: direct deals menu item * feat: add more deal logs * feat: user defined allocation policy (#1668) * user defined allocation policy * refactor flags * fix typo * fix devnet LID, fix flag names * refactor: extract piece reading code into common function * feat: add deal to sector with retry * feat: add retryability to direct deals (#1670) * fix nil ptr exception due to missing datacap * fix: allocation bug, refactor func()s (#1673) * fix allocation bug, refactor func()s * fix lint err * feat: make retry / fail resolvers work with direct deals (#1675) * create DDProvider config (#1679) * add itest for direct data onboarding (#1684) * feat: add itest for direct data onboarding * refactor: move datacap code from ddo test function into itest framework * Watch sealing state until finalized (#1687) * feat: watch sealing state until finalized * fix: dont check deal id when watching sealing state for direct deals * fix: checking sealing sector state * refactor: use common commp throttle for direct and regular deals (#1695) * feat: watch sealing state until finalized * fix: dont check deal id when watching sealing state for direct deals * fix: checking sealing sector state * refactor: use common commp throttle for direct and regular deals * feat: add tests for direct deals db (#1700) * feat: index and announce direct deals (#1696) * index and announce * add IsDirectDeal to LID * fix new column type * add keyspace to cql * rm keyspace from add column * Use UUID for idxProv context * apply suggestions * add column in migration * fix lint err * update ipni announce log line * revert to lotus version without ddo * go.mod from main * comment out ddo-related code; revert itest framework * comment out itest for direct deals * cleanup * Update node/impl/boost.go Co-authored-by: LexLuthr <88259624+LexLuthr@users.noreply.github.com> * fix commented out direct deals component * comment out direct deals cmd * fix cbor-gen --------- Co-authored-by: LexLuthr <88259624+LexLuthr@users.noreply.github.com> Co-authored-by: Dirk McCormick <dirkmdev@gmail.com> Co-authored-by: LexLuthr <lexluthr@protocol.ai>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR creates a new Config struct for direct deal provider and injects the values from boost config