Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up AOF rewrite test case #1093

Merged
merged 1 commit into from
Sep 30, 2024

Conversation

zuiderkwast
Copy link
Contributor

These two test cases run in a loop:

  • AOF rewrite during write load: RDB preamble=yes
  • AOF rewrite during write load: RDB preamble=no

Both of the test cases build up a lot of data (3-4 million keys when I run locally) so we should empty the data before the second test case. Otherwise, the second test cases adds keys on top of the keys added in the first test case, resulting in the double number of keys and takes more time.

Before this commit:

[ok]: AOF rewrite during write load: RDB preamble=yes (18225 ms)
[ok]: AOF rewrite during write load: RDB preamble=no (37249 ms)

After:

[ok]: AOF rewrite during write load: RDB preamble=yes (18777 ms)
[ok]: AOF rewrite during write load: RDB preamble=no (19940 ms)

These two test cases run in a loop:

* AOF rewrite during write load: RDB preamble=yes
* AOF rewrite during write load: RDB preamble=no

Both of the test cases build up a lot of data (3-4 million keys
when I run locally) so we should empty the data before the second
test case. Otherwise, the second test cases adds keys on top of
the keys added in the first test case, resulting in the double
number of keys and takes more time.

Before this commit:

[ok]: AOF rewrite during write load: RDB preamble=yes (18225 ms)
[ok]: AOF rewrite during write load: RDB preamble=no (37249 ms)

After:

[ok]: AOF rewrite during write load: RDB preamble=yes (18777 ms)
[ok]: AOF rewrite during write load: RDB preamble=no (19940 ms)

Signed-off-by: Viktor Söderqvist <viktor.soderqvist@est.tech>
Copy link

codecov bot commented Sep 30, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.44%. Comparing base (bb57dfe) to head (1296c5f).
Report is 3 commits behind head on unstable.

Additional details and impacted files
@@             Coverage Diff              @@
##           unstable    #1093      +/-   ##
============================================
- Coverage     70.61%   70.44%   -0.17%     
============================================
  Files           114      114              
  Lines         61694    61694              
============================================
- Hits          43564    43462     -102     
- Misses        18130    18232     +102     

see 15 files with indirect coverage changes

@zuiderkwast zuiderkwast merged commit 69eddb4 into valkey-io:unstable Sep 30, 2024
46 checks passed
@zuiderkwast zuiderkwast deleted the aofrw-test-faster branch September 30, 2024 17:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants