Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Stream files into the local store while capturing them #12563

Merged
merged 4 commits into from
Aug 14, 2021
Merged

Stream files into the local store while capturing them #12563

merged 4 commits into from
Aug 14, 2021

Commits on Aug 14, 2021

  1. Add Store::store_file, which streams from a Read instance into LMDB (… 

    …in two passes).

[ci skip-build-wheels]
    @stuhood
    stuhood committed Aug 14, 2021
    Configuration menu
    Copy the full SHA
    f8b2f1a View commit details
    Browse the repository at this point in the history

  2. Use Store::store_file for Snapshot capture and memoized Digest calcul… 

    …ation via Node.

[ci skip-build-wheels]
    @stuhood
    stuhood committed Aug 14, 2021
    Configuration menu
    Copy the full SHA
    fd63fc5 View commit details
    Browse the repository at this point in the history

  3. Fix benchmarks for new parameters. 

    [ci skip-build-wheels]
    @stuhood
    stuhood committed Aug 14, 2021
    Configuration menu
    Copy the full SHA
    b070d4b View commit details
    Browse the repository at this point in the history

  4. Review feedback. 

    # Building wheels and fs_util will be skipped. Delete if not intended.
[ci skip-build-wheels]
    @stuhood
    stuhood committed Aug 14, 2021
    Configuration menu
    Copy the full SHA
    2e87455 View commit details
    Browse the repository at this point in the history