feat: support non sharded IPFS block paths #541
Conversation
When migrating from IPFS there are two possible directory structures, a sharded and a non sharded form. This change now supports both defaulting to the sharded form.
nathanielc
requested review from
AaronGoldman
and removed request for
a team
nathanielc
temporarily deployed
to
github-tests-2024
GitHub Actions
Inactive
| /// Sharded paths are organized into a two character prefix directories. | ||
| #[arg(long, env = "CERAMIC_ONE_NON_SHARDED_PATHS", default_value_t = false)] | ||
| non_sharded_paths: bool, |
There was a problem hiding this comment.
FWIW, the sharding/key transformations are a configurable property of the blockstore and not a binary choice. But this should cover the "didn't actively configure sharding" case, and the most common option I guess.
https://github.com/ipfs/kubo/blob/master/docs/datastores.md
There was a problem hiding this comment.
This is probably fine for now. These are the two most likely configs, doubt someone has some other setup, and we could easily change this if someone else does something different.
| /// Sharded paths are organized into a two character prefix directories. | ||
| #[arg(long, env = "CERAMIC_ONE_NON_SHARDED_PATHS", default_value_t = false)] | ||
| non_sharded_paths: bool, |
There was a problem hiding this comment.
This is probably fine for now. These are the two most likely configs, doubt someone has some other setup, and we could easily change this if someone else does something different.
When migrating from IPFS there are two possible directory structures, a sharded and a non sharded form. This change now supports both defaulting to the sharded form.