Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Performance] allow for multithreaded channel extraction #101

Merged
merged 11 commits into from
Sep 9, 2024
Merged

[Performance] allow for multithreaded channel extraction #101

merged 11 commits into from
Sep 9, 2024

Commits on Sep 8, 2024

  1. Update benchmarks to additionall benchmark the file extraction speeds

    @EmilDohne
    EmilDohne committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    2b07358 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Make channel extraction multithreaded giving us ~5x speedups

    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    c4e528d View commit details
    Browse the repository at this point in the history

  2. Modify code to accomodate performance changes

    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    a04db82 View commit details
    Browse the repository at this point in the history

  3. Update benchmark util to allow for benchmarking without taking into a… 

    …ccount e.g. time taken to dealloc temporary data
    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    472b1c7 View commit details
    Browse the repository at this point in the history

  4. bump chunk size back up to 8MB for better read/write performance at t… 

    …he slight cost of 8-bit extraction speeds
    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    d134e13 View commit details
    Browse the repository at this point in the history

  5. Update documentation images

    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    d087e00 View commit details
    Browse the repository at this point in the history

  6. parallelize channel extraction further for 2.5-5x gains

    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    52a1877 View commit details
    Browse the repository at this point in the history

  7. fix spelling error in glacius name

    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    7ac9a9a View commit details
    Browse the repository at this point in the history

  8. make logging thread-safe

    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    6c15380 View commit details
    Browse the repository at this point in the history

  9. fix deprecated signature

    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    2479c33 View commit details
    Browse the repository at this point in the history

  10. correctly unwind exception stack from threads

    @EmilDohne
    EmilDohne committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    c3aa7df View commit details
    Browse the repository at this point in the history