[Storage] Version Level Worm #13527

seanmcc-msft · 2021-03-19T20:38:52Z

MSFT employees can try out our new experience at OpenAPI Hub - one location for using our validation tools and finding your workflow.

Changelog

Please ensure to add changelog with this PR by answering the following questions.

What's the purpose of the update?
- new service onboarding
- new API version
- update existing version for new feature
- update existing version to fix swagger quality issue in s360
- Other, please clarify
When you are targeting to deploy new service/feature to public regions? Please provide date, or month to public if date is not available yet.
When you expect to publish swagger? Please provide date, or month to public if date is not available yet.
If it's an update to existing version, please select SDKs of specific language and CLIs that require refresh after swagger is published.
- SDK of .NET (need service team to ensure code readiness)
- SDK of Python
- SDK of Java
- SDK of Js
- SDK of Go
- PowerShell
- CLI
- Terraform
- No, no need to refresh for updates in this PR

Contribution checklist:

I commit to follow the Breaking Change Policy of "no breaking changes"
I have reviewed the documentation for the workflow.
Validation tools were run on swagger spec(s) and errors have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.

ARM API Review Checklist

Ensure to check this box if one of the following scenarios meet updates in the PR, so that label “WaitForARMFeedback” will be added automatically to involve ARM API Review. Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs, all “removals” and “adding a new property” no more require ARM API review.
- Adding new API(s)
- Adding a new API version
- Ensure to copy the existing version into new directory structure for first commit (including refactoring) and then push new changes including version updates in separate commits. This is required to review the changes efficiently.
- Adding a new service
Please ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.
If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist

If there are following updates in the PR, ensure to request an approval from Breaking Change Review Board as defined in the Breaking Change Policy.

Removing API(s) in stable version
Removing properties in stable version
Removing API version(s) in stable version
Updating API in stable or public preview version with Breaking Change Validation errors
Updating API(s) in public preview over 1 year (refer to Retirement of Previews)

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.

Please follow the link to find more details on PR review process.

…LevelWorm

openapi-workflow-bot · 2021-03-19T20:38:55Z

Hi, @seanmcc-msft Thanks for your PR. I am workflow bot for review process. Here are some small tips.

Please ensure to do self-check against checklists in first PR comment.

PR assignee is the person auto-assigned and responsible for your current PR reviewing and merging.

For specs comparison cross API versions, Use API Specs Comparison Report Generator

If there is CI failure(s), to fix CI error(s) is mandatory for PR merging; or you need to provide justification in PR comment for explanation. How to fix?

Any feedback about review process or workflow bot, pls contact swagger and tools team. vsswagger@microsoft.com

openapi-pipeline-app · 2021-03-19T20:38:56Z

Swagger pipeline restarted successfully, please wait for status update in this comment.

openapi-pipeline-app · 2021-03-19T20:38:56Z

Swagger pipeline restarted successfully, please wait for status update in this comment.

tasherif-msft

Generation was good on Python side and besides these nits everything looks good. I tried to catch all of them so you can just commit them.

specification/storage/data-plane/Microsoft.BlobStorage/preview/2020-06-12/blob.json

tasherif-msft · 2021-03-29T23:23:02Z

specification/storage/data-plane/Microsoft.BlobStorage/preview/2020-06-12/blob.json

+              "x-ms-immutability-policy-mode": {
+                "x-ms-client-name": "ImmutabilityPolicyMode",
+                "type": "string",
+                "description": "Indicates immutability poliy mode."


Suggested change

"description": "Indicates immutability poliy mode."

"description": "Indicates immutability policy mode."

specification/storage/data-plane/Microsoft.BlobStorage/preview/2020-06-12/blob.json

specification/storage/data-plane/Microsoft.BlobStorage/preview/2020-08-04/blob.json

gapra-msft

I need to generate in Java to make sure this is good, but looks good to me

…/2020-06-12/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

…/2020-06-12/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

* Storage Dataplane Preview (#7027) * Adding Azure Storage Dataplane REST API Specs These are all Preview swagger specs and we do expect to make changes. - Add readme.md files to suppress --azure-validator rules - Fix trivial error about an x-ms-client-name mathing a name that won't change the code generation - We'll need to fix the semantic/avocado pipeline issues and get this properly reviewed before merging from the `storage-dataplane-preview` fork into `master`. * Fixed blob swagger for CPK (#7045) * Fixed blob swagger for CPK * Add share permission body to storage files (#7081) * Add share permission body to storage files * Add produces to getPermission * Move response body from create to get * Adding SAS Error Codes (#7322) * [Fix]Addressing the Things Below (#7304) 1. create of Page Blob is missing tier parameter. 2. For upload_pages_from_url of Page Blob, the generated code doesn’t extract header encryption-key-sha256 from raw response, which resulted in the response to client doesn’t have encryption-key-sha256 info. 3. For append_block_from_url of Append Blob, currently the generated code is not extracting the response header request-server-encrypted from raw response(server returned response) which resulted in client doesn’t have request-server-encrypted info. 4. get_permission of Storage File has file_permission_key parameter which should be required instead of optional * Remove delimiter from list blob flat segment response (#7376) Resolves #7350 * Updated DataLake swagger (#7408) * Additional DataLake swagger updates (#7445) * Additional DataLake swagger updates * refactored fileSystemResource param and added md5 to pathHttpHeaders (#7525) * Updated ContentMD5 parameter in DataLake swagger (#7534) * Updated ContentMD5 parameter in DataLake swagger * separated contentMD5 from transactionalContentMD5 * Add transactional md5 support for blockBlobUpload (#7553) * Added File Storage 2019-07-07 service version (#7825) * Added premium share properties to File Shares (#7826) * Added x-ms-number-of-handles-failed to File and Directory ForceCloseHandles (#7833) * Added new FileCopy() headers (#7837) * Added File Lease (#7845) * [Blob] Added missing headers for copy blob from URL (#7820) * Added 2019-07-07 Blobs Swagger (#7849) * Added additional FileLease parameters (#7892) * Added additional File Lease request and response headers (#7910) * Added encryption scopes to Blob Storage (#7929) * Storage/features/more cpk n (#7940) * Added previous snapshot url header to PageBlob.GetPageRangeDiff (#7951) * Made LeaseId optional on File Break Lease (#7952) * Added EncryptionScope and DenyDefaultEncryptionScopeOverride to ContainerProperties (#8001) * Added rest parity attributes to start copy response (#8009) * Modified swagger to fix some descriptions (#8014) * undid rest parity start copy response (#8016) * Added new ErrorCode (#8071) * Added FileSystem Get/SetAccessControl and SetPermissions (#8081) * Revert "Added FileSystem Get/SetAccessControl and SetPermissions (#8081)" (#8134) This reverts commit 855877c. * Renamed DenyEncryptionScopeOverride -> PreventEncryptionScopeOverride (#8245) * Renamed denyEncryptionScopeOverride to preventEncryptionScopeOverride (#8247) * Added 2019-12-12 storage service version (#8396) * make AccessPolicy's fields optional in blob and queue (#7992) * Updated swagger to include Quick Query (#8407) * Removed '&' from comment in 2019-12-12 blobs swagger (#8510) * Minor Quick Query update (#8523) * Another quick query update (#8549) * Added DataLake 2019-12-12 swagger file (#8594) * Changed name of hasHeaders to headersPresent (#8612) * [Storage][Blob]Blob Versioning (#8515) * Storage/feature/recursive acl (#8666) * added set acl recursive operation * added set acl recursive operation * added set acl recursive operation * remove invalid parameters * rename mode enum and strip list entry per review feedback (#8698) * [Storage][Blob]Blob Versioning: listBlobs add include {versions} and undo set metadata (#8735) * [Blob Versioning] listBlobs add include {versions} and undo set metadata * add response headers to syncCopyFromURL and abortCopyFromURL * undo abortCopyFromURL * Revert "undo abortCopyFromURL" This reverts commit 886c9a3. * add versionId to setMetaData and incrementalCopy's response headers * [Storage][Blob]Blob Versioning Update (#8762) Undo abortCopyFromURL and pageBlob incrementalCopy * [Storage] add version headers for get blob properties (#8775) * [Storage] add version headers for get blob properties * dot * add versionId to getBlob response headers (#8786) Co-authored-by: Lin Jian <ljian3377@gmail.com> * [Storage][Recursive ACL] Tweak mode enum to allow hiding it in transforms (#8789) * added x-ms-client-name tot DataLakeStorageError's inner error (#8739) * block can be now up to 4000MB (#8912) * Undid breaking change (#8939) * Fixed typo (#8941) * Feature/storage/blob tags (#8936) * Fixing Tags swagger (#8948) * minor tags update (#8950) * Added container soft delete (#9013) * Added Share Soft Delete (#9015) * Added Append Blob Seal (#9016) * Minor addition to Append Seal (#9039) * More Append Seal stuff (#9059) * Removed contentLength from setTags (#9061) * Feature/storage/set expiry (#9079) * Added Snapshot and Version to Blob Set Tier (#9086) * Object Replication update to swagger (update from James OR branch) (#9024) * Object Replication update to swagger (update from James OR branch) * Adding object replication to code 206 * Adding in x-ms-or-policy-id header * Blob tags serialization fix (#9087) * Blob tags serialization fix (#9142) * Removed contentLength from setTags (#9061) * Fixed BlobTags serialization * Added tag count to properties returned on listing * Renaming BlobProperties to BlobPropertiesInternal (#9183) * Rename ObjectReplicationRuleStatus to ObjectReplicationRules (#9186) * Remove snapshot from set tags (#9184) * Removed contentLength from setTags (#9061) * Fixed BlobTags serialization * Added tag count to properties returned on listing * Removed snapshot from setTags * Renamed quick query to query (#9504) * x-ms-client-name to DataLakeStorageError's inner error (#9506) * Added Set Expiry to Data Lake (#9620) * Update CODEOWNERS * Feature/storage/blob conditional headers (#9695) * list blobs ors (#9698) * Added x-ms-source-if-tags to Blob Async Copy (#9744) * fix typo in comments (#9758) Co-authored-by: Lin Jian <ljian3377@gmail.com> * fix typo in comments (#9783) Co-authored-by: Lin Jian <ljian3377@gmail.com> * remove TagValue (#9830) * Revert "remove TagValue (#9830)" This reverts commit 6af58bf. * Adding STG74 2020-02-02 swagger for DataLake (#9915) * Adding STG74 2020-02-02 swagger * Adding forceflag for recursive acl in datalake (#9916) * Added support for Get/SetBlobServiceProperties StaticWebsite.DefaultIndexDocumentPath (#9940) * Added RehydratePriority response header to GetBlobProperties and ListBlobs (#9951) * Fixed bug where AccountKind was missing BlockBlobStorage and FileStorage (#9961) * Fixed Enum values (#9970) * Added new swagger files for STG 74 (#10074) * Storage/add if tags to set tier (#10092) * removed source if tags from start copy from url (#10093) Co-authored-by: Gauri Prasad <gapra@microsoft.com> * Storage/sealblob (#10201) * Added back source ifTags (#10206) * Added tag to storage readme (#10218) * add iftags for clearPage, incrementalcopy, resize, UpdateSequenceNumber and query (#10238) Co-authored-by: Lin Jian <ljian3377@gmail.com> * Concurrent Append (#10279) * Inital commit for Concurrent Append swagger * another update * PR comments * make queue message body optional (#10477) * Added Get File Range Diff (#10399) * [Storage] Make message required for enqueue. (#10480) * make queue message body optional * require queue message for post * colons * SMB Multichannel (#10329) * Changed setAclRecursiveMode to be a method param (#10509) * Feature/storage/share lease (#10351) * Removed Concurrent Append (#10544) * Feature/storage/new quick query features (#10571) * Added Last Access Time (#10339) * [Storage][DataLake]Update API Version (#10663) * Added missing error code (#10744) * [storage-blob] fix typo "laster" -> "later" (#10751) * fix typo laster * fix 4tb file documentation Co-authored-by: Lin Jian <ljian3377@gmail.com> * Renamed SmbSettings and ProtocolSettings, Removed lease duration headers. (#10835) * Removed lease duration from response headers for all lease APIs except break lease * Modified names according to arch board review Co-authored-by: Gauri Prasad <gapra@microsoft.com> * Fixed FileClient.GetRangeListDiff (#10896) * Set File Tier (#10368) * Added swagger files for new Storage service version (#11031) * Added include leased to DeleteSnapshots (#11108) * Added 2020-06-12 blob swagger (#11445) * Added DataLake 2020-06-12 file (#11446) * fix description of enqueue message's visibilityTimeout (#11459) * don't rename (#11461) * Feature/storage/blob tags75 (#11305) * Permanent Delete (#11359) * Feature/storage/put blob from url (#11197) * Feature/storage/share enable protocol share squash root (#11304) * added source content MD5 (#11715) * Applied 2020-04-08 blob changes to 2020-06-12 (#11786) * minor fix (#11804) * Add "x-ms-is-hns-enabled" to ServiceGetAccountInfoResponse (#11871) * Renamed IsHnsEnabled (#11904) * added enum for api version (#12164) * added enum for api version * added version for all api versions * Added version id for DownloadBlob 206 response (#12193) * added version id for download blob 206 response * removed from versions prior to 2019-12-12 * added current version * Feature/storage/container rename (#11791) * Added container scoped batch (#11927) * Remove/move XML name mapping when ref is provided (#12341) * testing * removed more fileshare ignored xml names * fixed silly indents * fixed silly indents * Update DataLakeStorage.json (#13145) * GetBlockList returns long block sizes (#13188) * Added 2020-08-04 swagger file for Blob (#13526) * Fixed date (#13529) * Feature/storage/hns soft delete (#11741) * Added Quick Query Parquet (#13589) * added resource type header to list deleted paths (#13719) * added resource type header * added resource type header * [Storage] Version Level Worm (#13527) * Switched back to using BlobImmutabilityPolicy enum (#13753) Co-authored-by: Sean McCullough <=> * Added BlobErrorCode.BlobUsesCustomerSpecifiedEncryption (#13930) * Fix typo (#14081) * Fix typo * Update blob.json * Update queue.json * wip * Added 2020-10-02 blob swagger (#14193) * Added 2020-10-02 file swagger (#14207) * Updated swagger to reflect VLW changes (#14357) * Added Files 2020-06-12 service version (#14383) * [Storage] Oauth support for copy source (#14404) * List Delete Root Blob With Versions (#14195) * Added support for List File V2 (#14385) * Align with service and documentation where Blob Quick Query XML elements are optional instead of required (#14688) * Changed order of BlobImmutabilityPolicyMode (#14764) * Cleaned up Storage Swagger to get validation tools and CI green (#15015) * removed tags as a requirement (#15106) * Added 2020-12-06 service version for Data Lake (#15234) * Revert "Added 2020-12-06 service version for Data Lake (#15234)" (#15235) * Added new Data Lake swagger version (#15508) Co-authored-by: Sean McCullough <=> * Added Blob 2020-12-06 service version (#15519) * Added encryption scope to blob sync copy (#15521) * FileSystem.GetPaths() (#15534) * storage swaggers * sort * readded DL * Added queues * revert * revert Co-authored-by: tg-msft <tg-msft@users.noreply.github.com> Co-authored-by: Sean McCullough <44180881+seanmcc-msft@users.noreply.github.com> Co-authored-by: Jianghao Lu <jianghaolu@users.noreply.github.com> Co-authored-by: Amanda Nguyen <48961492+amnguye@users.noreply.github.com> Co-authored-by: Xiaoxi Fu <49707495+xiafu-msft@users.noreply.github.com> Co-authored-by: Jeremy Meng <yumeng@microsoft.com> Co-authored-by: Gauri Prasad <51212198+gapra-msft@users.noreply.github.com> Co-authored-by: Rick Ley <frley@microsoft.com> Co-authored-by: Ze Qian Zhang <zezha@microsoft.com> Co-authored-by: Lin Jian <ljian3377@gmail.com> Co-authored-by: Kamil Sobol <61715331+kasobol-msft@users.noreply.github.com> Co-authored-by: Lin Jian <1215122919@qq.com> Co-authored-by: iscai-msft <43154838+iscai-msft@users.noreply.github.com> Co-authored-by: Gauri Prasad <gapra@microsoft.com> Co-authored-by: Lin Jian <lijian2@microsoft.com> Co-authored-by: bharathsreenivas <bharathb@microsoft.com> Co-authored-by: James <41338290+jaschrep-msft@users.noreply.github.com>

* Storage Dataplane Preview (#7027) * Adding Azure Storage Dataplane REST API Specs These are all Preview swagger specs and we do expect to make changes. - Add readme.md files to suppress --azure-validator rules - Fix trivial error about an x-ms-client-name mathing a name that won't change the code generation - We'll need to fix the semantic/avocado pipeline issues and get this properly reviewed before merging from the `storage-dataplane-preview` fork into `master`. * Fixed blob swagger for CPK (#7045) * Fixed blob swagger for CPK * Add share permission body to storage files (#7081) * Add share permission body to storage files * Add produces to getPermission * Move response body from create to get * Adding SAS Error Codes (#7322) * [Fix]Addressing the Things Below (#7304) 1. create of Page Blob is missing tier parameter. 2. For upload_pages_from_url of Page Blob, the generated code doesn’t extract header encryption-key-sha256 from raw response, which resulted in the response to client doesn’t have encryption-key-sha256 info. 3. For append_block_from_url of Append Blob, currently the generated code is not extracting the response header request-server-encrypted from raw response(server returned response) which resulted in client doesn’t have request-server-encrypted info. 4. get_permission of Storage File has file_permission_key parameter which should be required instead of optional * Remove delimiter from list blob flat segment response (#7376) Resolves #7350 * Updated DataLake swagger (#7408) * Additional DataLake swagger updates (#7445) * Additional DataLake swagger updates * refactored fileSystemResource param and added md5 to pathHttpHeaders (#7525) * Updated ContentMD5 parameter in DataLake swagger (#7534) * Updated ContentMD5 parameter in DataLake swagger * separated contentMD5 from transactionalContentMD5 * Add transactional md5 support for blockBlobUpload (#7553) * Added File Storage 2019-07-07 service version (#7825) * Added premium share properties to File Shares (#7826) * Added x-ms-number-of-handles-failed to File and Directory ForceCloseHandles (#7833) * Added new FileCopy() headers (#7837) * Added File Lease (#7845) * [Blob] Added missing headers for copy blob from URL (#7820) * Added 2019-07-07 Blobs Swagger (#7849) * Added additional FileLease parameters (#7892) * Added additional File Lease request and response headers (#7910) * Added encryption scopes to Blob Storage (#7929) * Storage/features/more cpk n (#7940) * Added previous snapshot url header to PageBlob.GetPageRangeDiff (#7951) * Made LeaseId optional on File Break Lease (#7952) * Added EncryptionScope and DenyDefaultEncryptionScopeOverride to ContainerProperties (#8001) * Added rest parity attributes to start copy response (#8009) * Modified swagger to fix some descriptions (#8014) * undid rest parity start copy response (#8016) * Added new ErrorCode (#8071) * Added FileSystem Get/SetAccessControl and SetPermissions (#8081) * Revert "Added FileSystem Get/SetAccessControl and SetPermissions (#8081)" (#8134) This reverts commit 855877c. * Renamed DenyEncryptionScopeOverride -> PreventEncryptionScopeOverride (#8245) * Renamed denyEncryptionScopeOverride to preventEncryptionScopeOverride (#8247) * Added 2019-12-12 storage service version (#8396) * make AccessPolicy's fields optional in blob and queue (#7992) * Updated swagger to include Quick Query (#8407) * Removed '&' from comment in 2019-12-12 blobs swagger (#8510) * Minor Quick Query update (#8523) * Another quick query update (#8549) * Added DataLake 2019-12-12 swagger file (#8594) * Changed name of hasHeaders to headersPresent (#8612) * [Storage][Blob]Blob Versioning (#8515) * Storage/feature/recursive acl (#8666) * added set acl recursive operation * added set acl recursive operation * added set acl recursive operation * remove invalid parameters * rename mode enum and strip list entry per review feedback (#8698) * [Storage][Blob]Blob Versioning: listBlobs add include {versions} and undo set metadata (#8735) * [Blob Versioning] listBlobs add include {versions} and undo set metadata * add response headers to syncCopyFromURL and abortCopyFromURL * undo abortCopyFromURL * Revert "undo abortCopyFromURL" This reverts commit 886c9a3. * add versionId to setMetaData and incrementalCopy's response headers * [Storage][Blob]Blob Versioning Update (#8762) Undo abortCopyFromURL and pageBlob incrementalCopy * [Storage] add version headers for get blob properties (#8775) * [Storage] add version headers for get blob properties * dot * add versionId to getBlob response headers (#8786) Co-authored-by: Lin Jian <ljian3377@gmail.com> * [Storage][Recursive ACL] Tweak mode enum to allow hiding it in transforms (#8789) * added x-ms-client-name tot DataLakeStorageError's inner error (#8739) * block can be now up to 4000MB (#8912) * Undid breaking change (#8939) * Fixed typo (#8941) * Feature/storage/blob tags (#8936) * Fixing Tags swagger (#8948) * minor tags update (#8950) * Added container soft delete (#9013) * Added Share Soft Delete (#9015) * Added Append Blob Seal (#9016) * Minor addition to Append Seal (#9039) * More Append Seal stuff (#9059) * Removed contentLength from setTags (#9061) * Feature/storage/set expiry (#9079) * Added Snapshot and Version to Blob Set Tier (#9086) * Object Replication update to swagger (update from James OR branch) (#9024) * Object Replication update to swagger (update from James OR branch) * Adding object replication to code 206 * Adding in x-ms-or-policy-id header * Blob tags serialization fix (#9087) * Blob tags serialization fix (#9142) * Removed contentLength from setTags (#9061) * Fixed BlobTags serialization * Added tag count to properties returned on listing * Renaming BlobProperties to BlobPropertiesInternal (#9183) * Rename ObjectReplicationRuleStatus to ObjectReplicationRules (#9186) * Remove snapshot from set tags (#9184) * Removed contentLength from setTags (#9061) * Fixed BlobTags serialization * Added tag count to properties returned on listing * Removed snapshot from setTags * Renamed quick query to query (#9504) * x-ms-client-name to DataLakeStorageError's inner error (#9506) * Added Set Expiry to Data Lake (#9620) * Update CODEOWNERS * Feature/storage/blob conditional headers (#9695) * list blobs ors (#9698) * Added x-ms-source-if-tags to Blob Async Copy (#9744) * fix typo in comments (#9758) Co-authored-by: Lin Jian <ljian3377@gmail.com> * fix typo in comments (#9783) Co-authored-by: Lin Jian <ljian3377@gmail.com> * remove TagValue (#9830) * Revert "remove TagValue (#9830)" This reverts commit 6af58bf. * Adding STG74 2020-02-02 swagger for DataLake (#9915) * Adding STG74 2020-02-02 swagger * Adding forceflag for recursive acl in datalake (#9916) * Added support for Get/SetBlobServiceProperties StaticWebsite.DefaultIndexDocumentPath (#9940) * Added RehydratePriority response header to GetBlobProperties and ListBlobs (#9951) * Fixed bug where AccountKind was missing BlockBlobStorage and FileStorage (#9961) * Fixed Enum values (#9970) * Added new swagger files for STG 74 (#10074) * Storage/add if tags to set tier (#10092) * removed source if tags from start copy from url (#10093) Co-authored-by: Gauri Prasad <gapra@microsoft.com> * Storage/sealblob (#10201) * Added back source ifTags (#10206) * Added tag to storage readme (#10218) * add iftags for clearPage, incrementalcopy, resize, UpdateSequenceNumber and query (#10238) Co-authored-by: Lin Jian <ljian3377@gmail.com> * Concurrent Append (#10279) * Inital commit for Concurrent Append swagger * another update * PR comments * make queue message body optional (#10477) * Added Get File Range Diff (#10399) * [Storage] Make message required for enqueue. (#10480) * make queue message body optional * require queue message for post * colons * SMB Multichannel (#10329) * Changed setAclRecursiveMode to be a method param (#10509) * Feature/storage/share lease (#10351) * Removed Concurrent Append (#10544) * Feature/storage/new quick query features (#10571) * Added Last Access Time (#10339) * [Storage][DataLake]Update API Version (#10663) * Added missing error code (#10744) * [storage-blob] fix typo "laster" -> "later" (#10751) * fix typo laster * fix 4tb file documentation Co-authored-by: Lin Jian <ljian3377@gmail.com> * Renamed SmbSettings and ProtocolSettings, Removed lease duration headers. (#10835) * Removed lease duration from response headers for all lease APIs except break lease * Modified names according to arch board review Co-authored-by: Gauri Prasad <gapra@microsoft.com> * Fixed FileClient.GetRangeListDiff (#10896) * Set File Tier (#10368) * Added swagger files for new Storage service version (#11031) * Added include leased to DeleteSnapshots (#11108) * Added 2020-06-12 blob swagger (#11445) * Added DataLake 2020-06-12 file (#11446) * fix description of enqueue message's visibilityTimeout (#11459) * don't rename (#11461) * Feature/storage/blob tags75 (#11305) * Permanent Delete (#11359) * Feature/storage/put blob from url (#11197) * Feature/storage/share enable protocol share squash root (#11304) * added source content MD5 (#11715) * Applied 2020-04-08 blob changes to 2020-06-12 (#11786) * minor fix (#11804) * Add "x-ms-is-hns-enabled" to ServiceGetAccountInfoResponse (#11871) * Renamed IsHnsEnabled (#11904) * added enum for api version (#12164) * added enum for api version * added version for all api versions * Added version id for DownloadBlob 206 response (#12193) * added version id for download blob 206 response * removed from versions prior to 2019-12-12 * added current version * Feature/storage/container rename (#11791) * Added container scoped batch (#11927) * Remove/move XML name mapping when ref is provided (#12341) * testing * removed more fileshare ignored xml names * fixed silly indents * fixed silly indents * Update DataLakeStorage.json (#13145) * GetBlockList returns long block sizes (#13188) * Added 2020-08-04 swagger file for Blob (#13526) * Fixed date (#13529) * Feature/storage/hns soft delete (#11741) * Added Quick Query Parquet (#13589) * added resource type header to list deleted paths (#13719) * added resource type header * added resource type header * [Storage] Version Level Worm (#13527) * Switched back to using BlobImmutabilityPolicy enum (#13753) Co-authored-by: Sean McCullough <=> * Added BlobErrorCode.BlobUsesCustomerSpecifiedEncryption (#13930) * Fix typo (#14081) * Fix typo * Update blob.json * Update queue.json * wip * Added 2020-10-02 blob swagger (#14193) * Added 2020-10-02 file swagger (#14207) * Updated swagger to reflect VLW changes (#14357) * Added Files 2020-06-12 service version (#14383) * [Storage] Oauth support for copy source (#14404) * List Delete Root Blob With Versions (#14195) * Added support for List File V2 (#14385) * Align with service and documentation where Blob Quick Query XML elements are optional instead of required (#14688) * Changed order of BlobImmutabilityPolicyMode (#14764) * Cleaned up Storage Swagger to get validation tools and CI green (#15015) * removed tags as a requirement (#15106) * Added 2020-12-06 service version for Data Lake (#15234) * Revert "Added 2020-12-06 service version for Data Lake (#15234)" (#15235) * Added new Data Lake swagger version (#15508) Co-authored-by: Sean McCullough <=> * Added Blob 2020-12-06 service version (#15519) * Added encryption scope to blob sync copy (#15521) * FileSystem.GetPaths() (#15534) * storage swaggers * sort * readded DL * Added fileshare swagger * custom words * revert Co-authored-by: tg-msft <tg-msft@users.noreply.github.com> Co-authored-by: Sean McCullough <44180881+seanmcc-msft@users.noreply.github.com> Co-authored-by: Jianghao Lu <jianghaolu@users.noreply.github.com> Co-authored-by: Amanda Nguyen <48961492+amnguye@users.noreply.github.com> Co-authored-by: Xiaoxi Fu <49707495+xiafu-msft@users.noreply.github.com> Co-authored-by: Jeremy Meng <yumeng@microsoft.com> Co-authored-by: Gauri Prasad <51212198+gapra-msft@users.noreply.github.com> Co-authored-by: Rick Ley <frley@microsoft.com> Co-authored-by: Ze Qian Zhang <zezha@microsoft.com> Co-authored-by: Lin Jian <ljian3377@gmail.com> Co-authored-by: Kamil Sobol <61715331+kasobol-msft@users.noreply.github.com> Co-authored-by: Lin Jian <1215122919@qq.com> Co-authored-by: iscai-msft <43154838+iscai-msft@users.noreply.github.com> Co-authored-by: Gauri Prasad <gapra@microsoft.com> Co-authored-by: Lin Jian <lijian2@microsoft.com> Co-authored-by: bharathsreenivas <bharathb@microsoft.com> Co-authored-by: James <41338290+jaschrep-msft@users.noreply.github.com>

* Storage Dataplane Preview (#7027) * Adding Azure Storage Dataplane REST API Specs These are all Preview swagger specs and we do expect to make changes. - Add readme.md files to suppress --azure-validator rules - Fix trivial error about an x-ms-client-name mathing a name that won't change the code generation - We'll need to fix the semantic/avocado pipeline issues and get this properly reviewed before merging from the `storage-dataplane-preview` fork into `master`. * Fixed blob swagger for CPK (#7045) * Fixed blob swagger for CPK * Add share permission body to storage files (#7081) * Add share permission body to storage files * Add produces to getPermission * Move response body from create to get * Adding SAS Error Codes (#7322) * [Fix]Addressing the Things Below (#7304) 1. create of Page Blob is missing tier parameter. 2. For upload_pages_from_url of Page Blob, the generated code doesn’t extract header encryption-key-sha256 from raw response, which resulted in the response to client doesn’t have encryption-key-sha256 info. 3. For append_block_from_url of Append Blob, currently the generated code is not extracting the response header request-server-encrypted from raw response(server returned response) which resulted in client doesn’t have request-server-encrypted info. 4. get_permission of Storage File has file_permission_key parameter which should be required instead of optional * Remove delimiter from list blob flat segment response (#7376) Resolves #7350 * Updated DataLake swagger (#7408) * Additional DataLake swagger updates (#7445) * Additional DataLake swagger updates * refactored fileSystemResource param and added md5 to pathHttpHeaders (#7525) * Updated ContentMD5 parameter in DataLake swagger (#7534) * Updated ContentMD5 parameter in DataLake swagger * separated contentMD5 from transactionalContentMD5 * Add transactional md5 support for blockBlobUpload (#7553) * Added File Storage 2019-07-07 service version (#7825) * Added premium share properties to File Shares (#7826) * Added x-ms-number-of-handles-failed to File and Directory ForceCloseHandles (#7833) * Added new FileCopy() headers (#7837) * Added File Lease (#7845) * [Blob] Added missing headers for copy blob from URL (#7820) * Added 2019-07-07 Blobs Swagger (#7849) * Added additional FileLease parameters (#7892) * Added additional File Lease request and response headers (#7910) * Added encryption scopes to Blob Storage (#7929) * Storage/features/more cpk n (#7940) * Added previous snapshot url header to PageBlob.GetPageRangeDiff (#7951) * Made LeaseId optional on File Break Lease (#7952) * Added EncryptionScope and DenyDefaultEncryptionScopeOverride to ContainerProperties (#8001) * Added rest parity attributes to start copy response (#8009) * Modified swagger to fix some descriptions (#8014) * undid rest parity start copy response (#8016) * Added new ErrorCode (#8071) * Added FileSystem Get/SetAccessControl and SetPermissions (#8081) * Revert "Added FileSystem Get/SetAccessControl and SetPermissions (#8081)" (#8134) This reverts commit 855877c. * Renamed DenyEncryptionScopeOverride -> PreventEncryptionScopeOverride (#8245) * Renamed denyEncryptionScopeOverride to preventEncryptionScopeOverride (#8247) * Added 2019-12-12 storage service version (#8396) * make AccessPolicy's fields optional in blob and queue (#7992) * Updated swagger to include Quick Query (#8407) * Removed '&' from comment in 2019-12-12 blobs swagger (#8510) * Minor Quick Query update (#8523) * Another quick query update (#8549) * Added DataLake 2019-12-12 swagger file (#8594) * Changed name of hasHeaders to headersPresent (#8612) * [Storage][Blob]Blob Versioning (#8515) * Storage/feature/recursive acl (#8666) * added set acl recursive operation * added set acl recursive operation * added set acl recursive operation * remove invalid parameters * rename mode enum and strip list entry per review feedback (#8698) * [Storage][Blob]Blob Versioning: listBlobs add include {versions} and undo set metadata (#8735) * [Blob Versioning] listBlobs add include {versions} and undo set metadata * add response headers to syncCopyFromURL and abortCopyFromURL * undo abortCopyFromURL * Revert "undo abortCopyFromURL" This reverts commit 886c9a3. * add versionId to setMetaData and incrementalCopy's response headers * [Storage][Blob]Blob Versioning Update (#8762) Undo abortCopyFromURL and pageBlob incrementalCopy * [Storage] add version headers for get blob properties (#8775) * [Storage] add version headers for get blob properties * dot * add versionId to getBlob response headers (#8786) Co-authored-by: Lin Jian <ljian3377@gmail.com> * [Storage][Recursive ACL] Tweak mode enum to allow hiding it in transforms (#8789) * added x-ms-client-name tot DataLakeStorageError's inner error (#8739) * block can be now up to 4000MB (#8912) * Undid breaking change (#8939) * Fixed typo (#8941) * Feature/storage/blob tags (#8936) * Fixing Tags swagger (#8948) * minor tags update (#8950) * Added container soft delete (#9013) * Added Share Soft Delete (#9015) * Added Append Blob Seal (#9016) * Minor addition to Append Seal (#9039) * More Append Seal stuff (#9059) * Removed contentLength from setTags (#9061) * Feature/storage/set expiry (#9079) * Added Snapshot and Version to Blob Set Tier (#9086) * Object Replication update to swagger (update from James OR branch) (#9024) * Object Replication update to swagger (update from James OR branch) * Adding object replication to code 206 * Adding in x-ms-or-policy-id header * Blob tags serialization fix (#9087) * Blob tags serialization fix (#9142) * Removed contentLength from setTags (#9061) * Fixed BlobTags serialization * Added tag count to properties returned on listing * Renaming BlobProperties to BlobPropertiesInternal (#9183) * Rename ObjectReplicationRuleStatus to ObjectReplicationRules (#9186) * Remove snapshot from set tags (#9184) * Removed contentLength from setTags (#9061) * Fixed BlobTags serialization * Added tag count to properties returned on listing * Removed snapshot from setTags * Renamed quick query to query (#9504) * x-ms-client-name to DataLakeStorageError's inner error (#9506) * Added Set Expiry to Data Lake (#9620) * Update CODEOWNERS * Feature/storage/blob conditional headers (#9695) * list blobs ors (#9698) * Added x-ms-source-if-tags to Blob Async Copy (#9744) * fix typo in comments (#9758) Co-authored-by: Lin Jian <ljian3377@gmail.com> * fix typo in comments (#9783) Co-authored-by: Lin Jian <ljian3377@gmail.com> * remove TagValue (#9830) * Revert "remove TagValue (#9830)" This reverts commit 6af58bf. * Adding STG74 2020-02-02 swagger for DataLake (#9915) * Adding STG74 2020-02-02 swagger * Adding forceflag for recursive acl in datalake (#9916) * Added support for Get/SetBlobServiceProperties StaticWebsite.DefaultIndexDocumentPath (#9940) * Added RehydratePriority response header to GetBlobProperties and ListBlobs (#9951) * Fixed bug where AccountKind was missing BlockBlobStorage and FileStorage (#9961) * Fixed Enum values (#9970) * Added new swagger files for STG 74 (#10074) * Storage/add if tags to set tier (#10092) * removed source if tags from start copy from url (#10093) Co-authored-by: Gauri Prasad <gapra@microsoft.com> * Storage/sealblob (#10201) * Added back source ifTags (#10206) * Added tag to storage readme (#10218) * add iftags for clearPage, incrementalcopy, resize, UpdateSequenceNumber and query (#10238) Co-authored-by: Lin Jian <ljian3377@gmail.com> * Concurrent Append (#10279) * Inital commit for Concurrent Append swagger * another update * PR comments * make queue message body optional (#10477) * Added Get File Range Diff (#10399) * [Storage] Make message required for enqueue. (#10480) * make queue message body optional * require queue message for post * colons * SMB Multichannel (#10329) * Changed setAclRecursiveMode to be a method param (#10509) * Feature/storage/share lease (#10351) * Removed Concurrent Append (#10544) * Feature/storage/new quick query features (#10571) * Added Last Access Time (#10339) * [Storage][DataLake]Update API Version (#10663) * Added missing error code (#10744) * [storage-blob] fix typo "laster" -> "later" (#10751) * fix typo laster * fix 4tb file documentation Co-authored-by: Lin Jian <ljian3377@gmail.com> * Renamed SmbSettings and ProtocolSettings, Removed lease duration headers. (#10835) * Removed lease duration from response headers for all lease APIs except break lease * Modified names according to arch board review Co-authored-by: Gauri Prasad <gapra@microsoft.com> * Fixed FileClient.GetRangeListDiff (#10896) * Set File Tier (#10368) * Added swagger files for new Storage service version (#11031) * Added include leased to DeleteSnapshots (#11108) * Added 2020-06-12 blob swagger (#11445) * Added DataLake 2020-06-12 file (#11446) * fix description of enqueue message's visibilityTimeout (#11459) * don't rename (#11461) * Feature/storage/blob tags75 (#11305) * Permanent Delete (#11359) * Feature/storage/put blob from url (#11197) * Feature/storage/share enable protocol share squash root (#11304) * added source content MD5 (#11715) * Applied 2020-04-08 blob changes to 2020-06-12 (#11786) * minor fix (#11804) * Add "x-ms-is-hns-enabled" to ServiceGetAccountInfoResponse (#11871) * Renamed IsHnsEnabled (#11904) * added enum for api version (#12164) * added enum for api version * added version for all api versions * Added version id for DownloadBlob 206 response (#12193) * added version id for download blob 206 response * removed from versions prior to 2019-12-12 * added current version * Feature/storage/container rename (#11791) * Added container scoped batch (#11927) * Remove/move XML name mapping when ref is provided (#12341) * testing * removed more fileshare ignored xml names * fixed silly indents * fixed silly indents * Update DataLakeStorage.json (#13145) * GetBlockList returns long block sizes (#13188) * Added 2020-08-04 swagger file for Blob (#13526) * Fixed date (#13529) * Feature/storage/hns soft delete (#11741) * Added Quick Query Parquet (#13589) * added resource type header to list deleted paths (#13719) * added resource type header * added resource type header * [Storage] Version Level Worm (#13527) * Switched back to using BlobImmutabilityPolicy enum (#13753) Co-authored-by: Sean McCullough <=> * Added BlobErrorCode.BlobUsesCustomerSpecifiedEncryption (#13930) * Fix typo (#14081) * Fix typo * Update blob.json * Update queue.json * wip * Added 2020-10-02 blob swagger (#14193) * Added 2020-10-02 file swagger (#14207) * Updated swagger to reflect VLW changes (#14357) * Added Files 2020-06-12 service version (#14383) * [Storage] Oauth support for copy source (#14404) * List Delete Root Blob With Versions (#14195) * Added support for List File V2 (#14385) * Align with service and documentation where Blob Quick Query XML elements are optional instead of required (#14688) * Changed order of BlobImmutabilityPolicyMode (#14764) * Cleaned up Storage Swagger to get validation tools and CI green (#15015) * removed tags as a requirement (#15106) * Added 2020-12-06 service version for Data Lake (#15234) * Revert "Added 2020-12-06 service version for Data Lake (#15234)" (#15235) * Added new Data Lake swagger version (#15508) Co-authored-by: Sean McCullough <=> * Added Blob 2020-12-06 service version (#15519) * Added encryption scope to blob sync copy (#15521) * FileSystem.GetPaths() (#15534) * storage swaggers * sort * Added Datalake Spec * revert custom words * readme path * moved datalake swagger and supressed warning * moved datalake swagger and supressed warning * fixing existing error * reverted Co-authored-by: tg-msft <tg-msft@users.noreply.github.com> Co-authored-by: Sean McCullough <44180881+seanmcc-msft@users.noreply.github.com> Co-authored-by: Jianghao Lu <jianghaolu@users.noreply.github.com> Co-authored-by: Amanda Nguyen <48961492+amnguye@users.noreply.github.com> Co-authored-by: Xiaoxi Fu <49707495+xiafu-msft@users.noreply.github.com> Co-authored-by: Jeremy Meng <yumeng@microsoft.com> Co-authored-by: Gauri Prasad <51212198+gapra-msft@users.noreply.github.com> Co-authored-by: Rick Ley <frley@microsoft.com> Co-authored-by: Ze Qian Zhang <zezha@microsoft.com> Co-authored-by: Lin Jian <ljian3377@gmail.com> Co-authored-by: Kamil Sobol <61715331+kasobol-msft@users.noreply.github.com> Co-authored-by: Lin Jian <1215122919@qq.com> Co-authored-by: iscai-msft <43154838+iscai-msft@users.noreply.github.com> Co-authored-by: Gauri Prasad <gapra@microsoft.com> Co-authored-by: Lin Jian <lijian2@microsoft.com> Co-authored-by: bharathsreenivas <bharathb@microsoft.com> Co-authored-by: James <41338290+jaschrep-msft@users.noreply.github.com>

Sean McCullough added 10 commits March 8, 2021 15:48

Added new request headers

9261336

Added BlobSetImmutabilityPolicy

05626fc

update

1666f69

update

dea5765

Update

25df70a

update

724b04c

update

60723d0

update

48d2edf

Merge branch 'storage-dataplane-preview' into feature/storage/version…

b740e4f

…LevelWorm

update

bd7131d

seanmcc-msft requested review from JasonYang-MSFT and kasobol-msft as code owners March 19, 2021 20:38

openapi-assignment-bot bot assigned jhendrixMSFT Mar 19, 2021

seanmcc-msft changed the title ~~Feature/storage/version level worm~~ [Storage] Version Level Worm Mar 19, 2021

update

459a2a6

tasherif-msft approved these changes Mar 29, 2021

View reviewed changes

gapra-msft approved these changes Mar 30, 2021

View reviewed changes

seanmcc-msft and others added 10 commits March 30, 2021 12:54

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

7c619ef

…/2020-06-12/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

2410f6d

…/2020-06-12/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

7d4c60c

…/2020-06-12/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

cc1d835

…/2020-06-12/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

07848de

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

e30499a

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

4a1b40e

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

160613f

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

008c53d

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

1dbf9ec

…/2020-06-12/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

seanmcc-msft and others added 3 commits March 30, 2021 12:55

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

f829a07

…/2020-06-12/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

9d0b727

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

Update specification/storage/data-plane/Microsoft.BlobStorage/preview…

bae54be

…/2020-08-04/blob.json Co-authored-by: tasherif-msft <69483382+tasherif-msft@users.noreply.github.com>

seanmcc-msft merged commit e2d4efa into Azure:storage-dataplane-preview Mar 30, 2021

seanmcc-msft deleted the feature/storage/versionLevelWorm branch March 30, 2021 19:01

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Storage] Version Level Worm #13527

[Storage] Version Level Worm #13527

seanmcc-msft commented Mar 19, 2021

openapi-workflow-bot bot commented Mar 19, 2021

openapi-pipeline-app bot commented Mar 19, 2021 •

edited

Loading

openapi-pipeline-app bot commented Mar 19, 2021 •

edited

Loading

tasherif-msft left a comment

tasherif-msft Mar 29, 2021

gapra-msft left a comment

	"description": "Indicates immutability poliy mode."
	"description": "Indicates immutability policy mode."

[Storage] Version Level Worm #13527

[Storage] Version Level Worm #13527

Conversation

seanmcc-msft commented Mar 19, 2021

Changelog

Contribution checklist:

ARM API Review Checklist

Breaking Change Review Checklist

openapi-workflow-bot bot commented Mar 19, 2021

openapi-pipeline-app bot commented Mar 19, 2021 • edited Loading

openapi-pipeline-app bot commented Mar 19, 2021 • edited Loading

tasherif-msft left a comment

Choose a reason for hiding this comment

tasherif-msft Mar 29, 2021

Choose a reason for hiding this comment

gapra-msft left a comment

Choose a reason for hiding this comment

openapi-pipeline-app bot commented Mar 19, 2021 •

edited

Loading

openapi-pipeline-app bot commented Mar 19, 2021 •

edited

Loading