Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add --X-trie-log subcommand #6303

Merged
merged 27 commits into from
Jan 8, 2024
Merged

Add --X-trie-log subcommand #6303

merged 27 commits into from
Jan 8, 2024

Commits on Dec 15, 2023

  1. Add x-trie-log subcommand for one-off backlog prune 

    Signed-off-by: Simon Dudley <simon.dudley@consensys.net>
Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @siladu @gfukushima
    siladu authored and gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    16c0a49 View commit details
    Browse the repository at this point in the history

  2. long -> int 

    Signed-off-by: Simon Dudley <simon.dudley@consensys.net>

Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @siladu @gfukushima
    siladu authored and gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    7dd4928 View commit details
    Browse the repository at this point in the history

  3. Removed banned method 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    bf2b098 View commit details
    Browse the repository at this point in the history

  4. Preload process stream in parallel 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    e67ae51 View commit details
    Browse the repository at this point in the history

  5. Drop unwanted trielogs and keep reatain layers only 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    9b4e0c9 View commit details
    Browse the repository at this point in the history

  6. Add output to user and cleanup refactor 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    0b9fe83 View commit details
    Browse the repository at this point in the history

  7. small tweak to display cf that had reference dropped by RocksDbSegmen… 

    …tIdentifier.reset()

Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    426848e View commit details
    Browse the repository at this point in the history

  8. spotless 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    7401b59 View commit details
    Browse the repository at this point in the history

  9. Fix classes that changed package 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    1b7fb72 View commit details
    Browse the repository at this point in the history

  10. spotless 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    11e6b05 View commit details
    Browse the repository at this point in the history

  11. Code review 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    f2d01e2 View commit details
    Browse the repository at this point in the history

  12. Only clear DB when we have the exact amount of trie logs we want in m… 

    …emory

Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    04f1aaa View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. Trielogs stream to and from file to avoid possibly OOM 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    2f01c5a View commit details
    Browse the repository at this point in the history

  2. Process trie logs in chunks to avoid OOM 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    56e4c8e View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2023

  1. save and read in batches to handle edge cases 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    78561b0 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. save and read files to/from database dir 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    42c72cf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into x-trie-log-subcommand-2

    @gfukushima
    gfukushima committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    9961fc2 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2023

  1. add unit tests and PR review fixes 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    9389540 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into x-trie-log-subcommand-2

    @gfukushima
    gfukushima committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    e3d4fbc View commit details
    Browse the repository at this point in the history

  3. spdx 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    c7144fe View commit details
    Browse the repository at this point in the history

  4. Fix unit tests directory creation and deletion 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    20b0ba5 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. Merge branch 'main' into x-trie-log-subcommand-2

    @gfukushima
    gfukushima authored Jan 3, 2024
    Configuration menu
    Copy the full SHA
    e7d175c View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2024

  1. PR review 

    Signed-off-by: Gabriel Fukushima <gabrielfukushima@gmail.com>
    @gfukushima
    gfukushima committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    b214bf2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into x-trie-log-subcommand-2

    @gfukushima
    gfukushima committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    aa75348 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/x-trie-log-subcommand-2' into x-… 

    …trie-log-subcommand-2
    @gfukushima
    gfukushima committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    2bc0732 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. Merge branch 'main' into x-trie-log-subcommand-2

    @gfukushima
    gfukushima authored Jan 8, 2024
    Configuration menu
    Copy the full SHA
    deec021 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into x-trie-log-subcommand-2

    @gfukushima
    gfukushima authored Jan 8, 2024
    Configuration menu
    Copy the full SHA
    5d7b68e View commit details
    Browse the repository at this point in the history