Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/change ipld block sze #21

Merged
merged 8 commits into from
Sep 12, 2024

Conversation

tarassh
Copy link
Collaborator

@tarassh tarassh commented Sep 12, 2024

No description provided.

@tarassh tarassh merged commit 2649295 into feat/pinner-fetch-new-cid Sep 12, 2024
@tarassh tarassh deleted the feat/change-ipld-block-sze branch September 12, 2024 16:47
tarassh added a commit that referenced this pull request Sep 12, 2024
* initial commit

* move data fetch to separate package

* add default routing

* add config params

* refactoring

* add parallel download

* draft version for data recostruction.

* return data

* add more logs

* Fix cell decoder

* Fix block extraction

* Refactoring

* Change of the terminology: row -> blob, column -> cell

* refactoring

* add workers to download the data

* Feat/change ipld block sze (#21)

* stack cells into groups

* Fix for returned results

* Parallel data recovery

* parallel Blob fetch

* new sampling prototype

* add some time logging

* update sampling fn

* Update verifier

* add legacy download endpoint

* Update readme
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant