-
Notifications
You must be signed in to change notification settings - Fork 923
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(eds/store): store.GetDAH
#1511
feat(eds/store): store.GetDAH
#1511
Conversation
@distractedm1nd, It seems like we would have to fully access the shard-avoiding cache in GetCar to solve the issue. The Seeker is fine, but it does not work when multiple requests for the same car happen at the same time. Readers must be exclusive. Pretty embarrassing that I didn't catch it earlier. The optimization using the same mmap file works only for the multiple blockstore accessors because it has internal mutex protection. We can try to make similar synchronization and make the same mmap file work over simultaneous GetCar, but in fact, this would be sequential instead of parallel, though it has only one CAR copy in mem, rather than the amount of requests amount. The simplest solution right now is just to avoid cache in GetCar and further, we can optimize memory usage by making multiple Readers over the same mmap, rather than multiple Reders with personal mmap |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice!
Unit test failed :
|
Note about updating the ADR |
Co-authored-by: Viacheslav <viacheslavgonkivskyi@gmail.com>
Codecov Report
@@ Coverage Diff @@
## main #1511 +/- ##
==========================================
- Coverage 55.49% 55.23% -0.26%
==========================================
Files 203 210 +7
Lines 12126 12866 +740
==========================================
+ Hits 6729 7107 +378
- Misses 4730 5038 +308
- Partials 667 721 +54
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM 🚀
store.GetDAH
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, a q and a nit
Co-authored-by: Vlad <13818348+walldiss@users.noreply.github.com>
4478305
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
utACK
Overview
Closes #1509
Checklist