Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Separate read and write storage backend for mirror #2512

Merged
merged 1 commit into from
Feb 15, 2024

Conversation

masih
Copy link
Member

@masih masih commented Feb 13, 2024

Allow district read side and write side configuration for ad mirror.

This enables a storage backend to be passively populated from a retrieval backend since ingest will attempt to store all processed ads regardless of their retrieval origin.

@masih masih requested a review from gammazero February 13, 2024 10:42
@codecov-commenter
Copy link

codecov-commenter commented Feb 13, 2024

Codecov Report

Attention: 26 lines in your changes are missing coverage. Please review.

Comparison is base (8a2176d) 45.71% compared to head (0a64140) 45.64%.

Files Patch % Lines
internal/ingest/mirror.go 33.33% 12 Missing and 2 partials ⚠️
filestore/s3.go 0.00% 12 Missing ⚠️

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2512      +/-   ##
==========================================
- Coverage   45.71%   45.64%   -0.08%     
==========================================
  Files          85       85              
  Lines       10767    10777      +10     
==========================================
- Hits         4922     4919       -3     
- Misses       5251     5267      +16     
+ Partials      594      591       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@masih masih force-pushed the masih/mirror-read-write-separate branch 2 times, most recently from c7afafd to 86e78c4 Compare February 14, 2024 10:46
filestore/s3.go Show resolved Hide resolved
filestore/s3.go Show resolved Hide resolved
@masih masih force-pushed the masih/mirror-read-write-separate branch from 800d017 to 9161736 Compare February 15, 2024 15:30
@masih masih force-pushed the masih/mirror-read-write-separate branch from 153b575 to a14eed0 Compare February 15, 2024 17:01
Allow district read side and write side configuration for ad mirror.

This enables a storage backend to be passively populated from a
retrieval backend since ingest will attempt to store all processed ads
regardless of their retrieval origin.
@masih masih force-pushed the masih/mirror-read-write-separate branch from a14eed0 to 0a64140 Compare February 15, 2024 17:09
@masih masih merged commit be919f2 into main Feb 15, 2024
7 of 9 checks passed
@masih masih deleted the masih/mirror-read-write-separate branch February 15, 2024 17:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants