-
Notifications
You must be signed in to change notification settings - Fork 4.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CRC: Always Structured Message #44955
CRC: Always Structured Message #44955
Conversation
|
||
namespace Azure.Storage.Shared; | ||
|
||
internal class StructuredMessagePrecalculatedCrcWrapperStream : Stream |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Any way to share some logic between this and the regular encode stream? If it's not fairly easy, it may not be worth it but thought I'd ask.
I didn't look at the implementation too closely because I assumed it was similar and mainly only different with the checksum.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I tried and it wasn't great to get working. Weird bugs I never managed to track down. This is a simplified version of the normal one with only one segment in the whole stream and the provided CRC pasted in.
API change check API changes are not detected in this pull request. |
4 similar comments
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
4 similar comments
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
This is building fine locally idk what's up
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
9 similar comments
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
this is causing too many problems. skipping macos tests for now. They'll run when this feature branch merges into main. This reverts commit 29e87b4.
API change check API changes are not detected in this pull request. |
8 similar comments
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
API change check API changes are not detected in this pull request. |
6231eb5
into
Azure:feature/storage/ContentValidation
* blockblob working * revert testing change * page/append * datalake file * testfix * bug fixes | test fixes * disable new API for presenting CRC from structured message * fix nunit * whitespace * fix/test-proxy * csproj * more csproj removeals This is building fine locally idk what's up * Trigger Fresh Build * fileshare testproxy * fix mock * Update macos image from 11 to latest (Azure#44607) * Update macos image from 11 to latest * Update eng/pipelines/templates/jobs/ci.mgmt.yml Co-authored-by: Ben Broderick Phillips <ben@benbp.net> --------- Co-authored-by: Ben Broderick Phillips <ben@benbp.net> * Revert "Update macos image from 11 to latest (Azure#44607)" this is causing too many problems. skipping macos tests for now. They'll run when this feature branch merges into main. This reverts commit 29e87b4. --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
* Structured Message Decode Stream (#42079) * Initial implementation and basic test * seek/write tests * fix test param * fix exceptions * Content validation update spec (#42191) * enum rename and footer read/write methods * align encode/decode tests | update encoding stream * decode stream footer * rename * decode tests & bugfixes (#42256) * decode tests & bugfixes * roundtrip tests * more tests * better errors | remove duplicate test * test coverage | exception message (#42363) * Structured Message Decode: Validate Content Length (#42370) * validate stream length * tests * stageblock | appendblock | putpages StructuredMessage (#42699) * regenerate and stage block uses structured message * page and append * testproxy * cleanup * fix datalake/share tests * testproxy * testproxy * re-add null-safe access * GET Blob Structured Message (#42959) * download range structured message * testproxy * throw when service fails to give back structured message * test * testproxy * PUT Blob Structured Message (#43130) * putblob structured message * testproxy * fixes * Structured Message: DataLake Append (#43275) * datalake append * null fix * fixes * Retriable decode (#44155) * retriable decode * rewind mock test * bugfix * bugfix * tests * Download retriable stream structured message (#44176) * blobs retriable structured message download * test proxy * testproxy * remove commented code * CRC: Always Structured Message (#44955) * blockblob working * revert testing change * page/append * datalake file * testfix * bug fixes | test fixes * disable new API for presenting CRC from structured message * fix nunit * whitespace * fix/test-proxy * csproj * more csproj removeals This is building fine locally idk what's up * Trigger Fresh Build * fileshare testproxy * fix mock * Update macos image from 11 to latest (#44607) * Update macos image from 11 to latest * Update eng/pipelines/templates/jobs/ci.mgmt.yml Co-authored-by: Ben Broderick Phillips <ben@benbp.net> --------- Co-authored-by: Ben Broderick Phillips <ben@benbp.net> * Revert "Update macos image from 11 to latest (#44607)" this is causing too many problems. skipping macos tests for now. They'll run when this feature branch merges into main. This reverts commit 29e87b4. --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Ben Broderick Phillips <ben@benbp.net> * Enable fileshare crc (#45124) * impl * testproxy * shares fix * testproxy * block blob fix (#45129) * block blob fix * testproxy * rename and validation (#45160) * rename and validation * fix * crc tracking converted to longs (#45307) * Crc reporting pt2 (#45447) * expose crc from structured message * testproxy * undo typo * exportapi * testproxy * remove unused parameter * add `ExpectTrailingDetails` to download response * fix test inconsistency * fix auto --------- Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com> Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
Due to limitations of the files service, changing CRC behavior to always use structured message.