Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Opening a big HAMT-directory takes forever #1997

Open
Tracked by #113
lidel opened this issue Aug 1, 2022 · 0 comments
Open
Tracked by #113

Opening a big HAMT-directory takes forever #1997

lidel opened this issue Aug 1, 2022 · 0 comments
Labels
area/screen/files Issues related to Files screen effort/days Estimated to take multiple days, but less than a week exp/intermediate Prior experience is likely helpful help wanted Seeking public contribution on this issue kind/bug A bug in existing code (including security flaws) P1 High: Likely tackled by core team if no one steps up starmaps

Comments

@lidel
Copy link
Member

lidel commented Aug 1, 2022

/ipns/en.wikipedia-on-ipfs.org/wiki/ is an UnixFS HAMT-sharded directory with 20M of files.

Currently, ipfs-webui tries to open it as it would any other directory, and it ends up with spinner/loader animation looped forever:

2022-08-01_22-07

How to solve this? Need more analysis and UX design.

  • Files screen could have special handling for HAMT-directories
    • Minimal fix is to refuse to open HAMT-sharded dirs, informing user the directory is too big to be rendered, and suggest using CLI.
    • Proper fix, add better API to Kubo, allowing for streaming dir items with some sort of pagination (Gateway directory listings should be paginated kubo#8455)
@lidel lidel added need/triage Needs initial labeling and prioritization kind/bug A bug in existing code (including security flaws) help wanted Seeking public contribution on this issue exp/intermediate Prior experience is likely helpful P1 High: Likely tackled by core team if no one steps up area/screen/files Issues related to Files screen effort/days Estimated to take multiple days, but less than a week and removed need/triage Needs initial labeling and prioritization labels Aug 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/screen/files Issues related to Files screen effort/days Estimated to take multiple days, but less than a week exp/intermediate Prior experience is likely helpful help wanted Seeking public contribution on this issue kind/bug A bug in existing code (including security flaws) P1 High: Likely tackled by core team if no one steps up starmaps
Projects
No open projects
Status: UX Design Needed
Development

No branches or pull requests

2 participants