Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Merged by Bors] - Speed up ATX cache warmup #6241

Closed
wants to merge 4 commits into from
Closed

Conversation

poszu
Copy link
Contributor

@poszu poszu commented Aug 12, 2024

Motivation

Speeding up the in-memory ATX cache warmup that is especially slow on HDDs.

Description

  • filter epochs in SQL instead of in the code,
  • separate reading ATXs from reading malfeasance

Test Plan

Existing tests pass

TODO

  • Explain motivation or link existing issue(s)
  • Test changes and document test plan
  • Update documentation as needed
  • Update changelog as needed

Copy link

codecov bot commented Aug 12, 2024

Codecov Report

Attention: Patch coverage is 76.78571% with 13 lines in your changes missing coverage. Please review.

Project coverage is 82.1%. Comparing base (16d8ac9) to head (b111c1a).

Files Patch % Lines
atxsdata/warmup.go 66.6% 5 Missing and 4 partials ⚠️
node/node.go 75.0% 2 Missing and 2 partials ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##           develop   #6241   +/-   ##
=======================================
  Coverage     82.1%   82.1%           
=======================================
  Files          308     308           
  Lines        34123   34138   +15     
=======================================
+ Hits         28026   28043   +17     
+ Misses        4321    4319    -2     
  Partials      1776    1776           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@poszu poszu marked this pull request as ready for review August 12, 2024 11:32
@poszu poszu changed the title separate warming up atxs from malfeasance Speed up ATX cache warmup Aug 12, 2024
@pigmej pigmej self-requested a review August 12, 2024 12:14
)
if err != nil {
return err
{
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why these braces?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To add scope for local variables

@poszu
Copy link
Contributor Author

poszu commented Aug 12, 2024

bors merge

spacemesh-bors bot pushed a commit that referenced this pull request Aug 12, 2024
## Motivation

Speeding up the in-memory ATX cache warmup that is especially slow on HDDs.



Co-authored-by: Jedrzej Nowak <pigmej@gmail.com>
@spacemesh-bors
Copy link

Build failed:

@poszu
Copy link
Contributor Author

poszu commented Aug 12, 2024

bors merge

spacemesh-bors bot pushed a commit that referenced this pull request Aug 12, 2024
## Motivation

Speeding up the in-memory ATX cache warmup that is especially slow on HDDs.



Co-authored-by: Jedrzej Nowak <pigmej@gmail.com>
@spacemesh-bors
Copy link

Build failed:

@fasmat
Copy link
Member

fasmat commented Aug 12, 2024

bors merge

spacemesh-bors bot pushed a commit that referenced this pull request Aug 12, 2024
## Motivation

Speeding up the in-memory ATX cache warmup that is especially slow on HDDs.



Co-authored-by: Jedrzej Nowak <pigmej@gmail.com>
@spacemesh-bors
Copy link

Pull request successfully merged into develop.

Build succeeded:

@spacemesh-bors spacemesh-bors bot changed the title Speed up ATX cache warmup [Merged by Bors] - Speed up ATX cache warmup Aug 12, 2024
@spacemesh-bors spacemesh-bors bot closed this Aug 12, 2024
@spacemesh-bors spacemesh-bors bot deleted the fix/long-warmup branch August 12, 2024 16:52
fasmat pushed a commit that referenced this pull request Aug 12, 2024
## Motivation

Speeding up the in-memory ATX cache warmup that is especially slow on HDDs.



Co-authored-by: Jedrzej Nowak <pigmej@gmail.com>
fasmat added a commit that referenced this pull request Aug 12, 2024
* Speed up ATX cache warmup (#6241)

## Motivation

Speeding up the in-memory ATX cache warmup that is especially slow on HDDs.



Co-authored-by: Jedrzej Nowak <pigmej@gmail.com>

* Update CHANGELOG

* Fix compiler error

---------

Co-authored-by: Bartosz Różański <bartek.roza@gmail.com>
Co-authored-by: Jedrzej Nowak <pigmej@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants