updated Spark version from 2.4 to 3.3 #22238

saikumar-ms · 2023-01-19T02:17:57Z

updated Spark version from 2.4 to 3.3 in both dataplane and control plane examples. Spark version 2.4 is close to end of life.

updated Spark version from 2.4 to 3.3. Spark version 2.4 is close to end of life.

openapi-workflow-bot · 2023-01-19T02:18:00Z

Hi, @saikumar-ms Thanks for your PR. I am workflow bot for review process. Here are some small tips.

Please ensure to do self-check against checklists in first PR comment.

PR assignee is the person auto-assigned and responsible for your current PR reviewing and merging.

For specs comparison cross API versions, Use API Specs Comparison Report Generator

If there is CI failure(s), to fix CI error(s) is mandatory for PR merging; or you need to provide justification in PR comment for explanation. How to fix?

Any feedback about review process or workflow bot, pls contact swagger and tools team. vscswagger@microsoft.com

openapi-pipeline-app · 2023-01-19T02:18:02Z

Swagger Validation Report

️️✔️BreakingChange succeeded [Detail] [Expand]

There are no breaking changes.

️️✔️Breaking Change(Cross-Version) succeeded [Detail] [Expand]

There are no breaking changes.

️️✔️CredScan succeeded [Detail] [Expand]

There is no credential detected.

️️✔️LintDiff succeeded [Detail] [Expand]

Validation passes for LintDiff.

️⚠️Avocado: 1 Warnings warning [Detail]

Rule	Message
⚠️ MULTIPLE_API_VERSION	The default tag contains multiple API versions swaggers. readme: specification/synapse/resource-manager/readme.md tag: specification/synapse/resource-manager/readme.md#tag-package-composite-v2

️️✔️ApiReadinessCheck succeeded [Detail] [Expand]

️️✔️~[Staging] ServiceAPIReadinessTest succeeded [Detail] [Expand]

Validation passes for ServiceAPIReadinessTest.

️️✔️~[Staging] SwaggerAPIView succeeded [Detail] [Expand]

️️✔️~[Staging] CadlAPIView succeeded [Detail] [Expand]

️❌ModelValidation: 105 Errors, 0 Warnings failed [Detail]

Only 30 items are listed, please refer to log for more details.

Rule	Message
`❌` LRO_RESPONSE_HEADER	Long running operation should return Operation-Id or Operation-Location or azure-AsyncOperation in header but not provided Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L187:22 ExampleUrl: preview/2019-06-01-preview/examples/LinkedServices_Delete.json
`❌` LRO_RESPONSE_HEADER	Long running operation should return Operation-Id or Operation-Location or azure-AsyncOperation in header but not provided Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L236:22 ExampleUrl: preview/2019-06-01-preview/examples/LinkedServices_Rename.json
`❌` LRO_RESPONSE_HEADER	Long running operation should return Operation-Id or Operation-Location or azure-AsyncOperation in header but not provided Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L410:22 ExampleUrl: preview/2019-06-01-preview/examples/Datasets_Delete.json
`❌` LRO_RESPONSE_HEADER	Long running operation should return Operation-Id or Operation-Location or azure-AsyncOperation in header but not provided Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L459:22 ExampleUrl: preview/2019-06-01-preview/examples/Datasets_Rename.json
`❌` INVALID_TYPE	Expected type object but found type array Url: preview/2019-06-01-preview/entityTypes/Pipeline.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_ListByWorkspace.json#L44:35
`❌` INVALID_TYPE	Expected type object but found type array Url: preview/2019-06-01-preview/entityTypes/Pipeline.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_ListByWorkspace.json#L54:36
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_ListByWorkspace.json#L48:47
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_ListByWorkspace.json#L49:45
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_ListByWorkspace.json#L58:47
`❌` INVALID_TYPE	Expected type object but found type array Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Create.json#L6:17
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Create.json#L6:17
`❌` INVALID_TYPE	Expected type object but found type array Url: preview/2019-06-01-preview/entityTypes/Pipeline.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Create.json#L119:31
`❌` INVALID_TYPE	Expected type object but found type array Url: preview/2019-06-01-preview/entityTypes/Pipeline.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Create.json#L129:32
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Create.json#L123:43
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Create.json#L124:41
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Create.json#L133:43
`❌` INVALID_TYPE	Expected type object but found type array Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Update.json#L6:17
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Update.json#L6:17
`❌` INVALID_TYPE	Expected type object but found type array Url: preview/2019-06-01-preview/entityTypes/Pipeline.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Update.json#L107:31
`❌` INVALID_TYPE	Expected type object but found type array Url: preview/2019-06-01-preview/entityTypes/Pipeline.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Update.json#L117:32
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Update.json#L111:43
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Update.json#L112:41
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Update.json#L121:43
`❌` INVALID_TYPE	Expected type object but found type array Url: preview/2019-06-01-preview/entityTypes/Pipeline.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Get.json#L45:31
`❌` INVALID_TYPE	Expected type object but found type array Url: preview/2019-06-01-preview/entityTypes/Pipeline.json#L96:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Get.json#L55:32
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Get.json#L49:43
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Get.json#L50:41
`❌` INVALID_TYPE	Expected type object but found type string Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L3322:31 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Get.json#L59:43
`❌` LRO_RESPONSE_HEADER	Long running operation should return Operation-Id or Operation-Location or azure-AsyncOperation in header but not provided Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L633:22 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Delete.json
`❌` LRO_RESPONSE_HEADER	Long running operation should return Operation-Id or Operation-Location or azure-AsyncOperation in header but not provided Url: Microsoft.Synapse/preview/2019-06-01-preview/artifacts.json#L682:22 ExampleUrl: preview/2019-06-01-preview/examples/Pipelines_Rename.json

️️✔️SemanticValidation succeeded [Detail] [Expand]

Validation passes for SemanticValidation.

️️✔️PoliCheck succeeded [Detail] [Expand]

Validation passed for PoliCheck.

️️✔️PrettierCheck succeeded [Detail] [Expand]

Validation passes for PrettierCheck.

️️✔️SpellCheck succeeded [Detail] [Expand]

Validation passes for SpellCheck.

️️✔️Lint(RPaaS) succeeded [Detail] [Expand]

Validation passes for Lint(RPaaS).

️️✔️CadlValidation succeeded [Detail] [Expand]

Validation passes for CadlValidation.

️️✔️PR Summary succeeded [Detail] [Expand]

Validation passes for Summary.

_{Posted by Swagger Pipeline | How to fix these errors?}

openapi-pipeline-app · 2023-01-19T02:18:03Z

Swagger Generation Artifacts

️️✔️ApiDocPreview succeeded [Detail] [Expand]

️❌SDK Breaking Change Tracking failed [Detail]

Breaking Changes Tracking

❌azure-sdk-for-go - sdk/resourcemanager/synapse/armsynapse - 0.6.0

+	Field `Interface` of struct `BigDataPoolsClientDeleteResponse` has been removed
+	Field `Interface` of struct `IPFirewallRulesClientDeleteResponse` has been removed
+	Field `Interface` of struct `SQLPoolsClientDeleteResponse` has been removed
+	Field `Interface` of struct `SQLPoolsClientPauseResponse` has been removed
+	Field `Interface` of struct `SQLPoolsClientResumeResponse` has been removed
+	Field `Interface` of struct `WorkspacesClientDeleteResponse` has been removed
+	Operation `*SQLPoolOperationResultsClient.GetLocationHeaderResult` has been changed to LRO, use `*SQLPoolOperationResultsClient.BeginGetLocationHeaderResult` instead.
+	Operation `*SQLPoolsClient.Update` has been changed to LRO, use `*SQLPoolsClient.BeginUpdate` instead.
+	Type alias `ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentityActualState` has been removed
+	Type alias `ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentityDesiredState` has been removed
+	Type of `CmdkeySetupTypeProperties.TargetName` has been changed from `interface{}` to `any`
+	Type of `CmdkeySetupTypeProperties.UserName` has been changed from `interface{}` to `any`
+	Type of `ErrorAdditionalInfo.Info` has been changed from `interface{}` to `any`
+	Type of `IntegrationRuntime.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `IntegrationRuntimeComputeProperties.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `IntegrationRuntimeConnectionInfo.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `IntegrationRuntimeDataFlowProperties.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `IntegrationRuntimeNodeMonitoringData.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `IntegrationRuntimeSsisCatalogInfo.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `IntegrationRuntimeSsisProperties.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `IntegrationRuntimeStatus.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `IntegrationRuntimeVNetProperties.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `KekIdentityProperties.UseSystemAssignedIdentity` has been changed from `interface{}` to `any`
+	Type of `ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentity.ActualState` has been changed from `*ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentityActualState` to `*ActualState`
+	Type of `ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentity.DesiredState` has been changed from `*ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentityDesiredState` to `*DesiredState`
+	Type of `ManagedIntegrationRuntime.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `ManagedIntegrationRuntimeError.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `ManagedIntegrationRuntimeNode.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `ManagedIntegrationRuntimeOperationResult.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `ManagedIntegrationRuntimeStatus.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `Operation.Properties` has been changed from `interface{}` to `any`
+	Type of `OperationResource.Properties` has been changed from `interface{}` to `any`
+	Type of `SKUDescription.Restrictions` has been changed from `[]interface{}` to `[]any`
+	Type of `SelfHostedIntegrationRuntime.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `SelfHostedIntegrationRuntimeNode.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `SelfHostedIntegrationRuntimeStatus.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `WorkspaceProperties.ExtraProperties` has been changed from `map[string]interface{}` to `map[string]any`
+	Type of `WorkspaceProperties.Settings` has been changed from `map[string]interface{}` to `map[string]any`

❌azure-sdk-for-js - @azure/arm-synapse - 9.0.0-beta.1

+	Class SynapseManagementClient no longer has parameter privateLinkResources
+	Interface IntegrationRuntimeStatusResponse has a new required parameter type
+	Interface IntegrationRuntimeStatusResponse no longer has parameter properties
+	Interface SqlPoolSchemasListNextOptionalParams no longer has parameter filter
+	Interface SqlPoolSensitivityLabelsListCurrentNextOptionalParams no longer has parameter filter
+	Interface SqlPoolSensitivityLabelsListRecommendedNextOptionalParams no longer has parameter filter
+	Interface SqlPoolSensitivityLabelsListRecommendedNextOptionalParams no longer has parameter includeDisabledRecommendations
+	Interface SqlPoolSensitivityLabelsListRecommendedNextOptionalParams no longer has parameter skipToken
+	Interface SqlPoolTableColumnsListByTableNameNextOptionalParams no longer has parameter filter
+	Interface SqlPoolTablesListBySchemaNextOptionalParams no longer has parameter filter
+	Removed Enum KnownManagedIdentitySqlControlSettingsModelPropertiesGrantSqlControlToManagedIdentityActualState
+	Removed Enum KnownManagedIdentitySqlControlSettingsModelPropertiesGrantSqlControlToManagedIdentityDesiredState
+	Removed operation SqlPoolOperationResults.getLocationHeaderResult
+	Removed operation SqlPools.update
+	Removed operation group PrivateLinkResources
+	Type of parameter actualState of interface ManagedIdentitySqlControlSettingsModelPropertiesGrantSqlControlToManagedIdentity is changed from ManagedIdentitySqlControlSettingsModelPropertiesGrantSqlControlToManagedIdentityActualState to ActualState
+	Type of parameter desiredState of interface ManagedIdentitySqlControlSettingsModelPropertiesGrantSqlControlToManagedIdentity is changed from ManagedIdentitySqlControlSettingsModelPropertiesGrantSqlControlToManagedIdentityDesiredState to DesiredState

️️✔️ azure-sdk-for-net-track2 succeeded [Detail] [Expand]

️✔️Succeeded [Logs]Release - Generate from c1475c5. SDK Automation 14.0.0

command	pwsh ./eng/scripts/Automation-Sdk-Init.ps1 ../azure-sdk-for-net_tmp/initInput.json ../azure-sdk-for-net_tmp/initOutput.json
warn		specification/synapse/data-plane/readme.md skipped due to azure-sdk-for-net-track2 not found in swagger-to-sdk
command	pwsh ./eng/scripts/Invoke-GenerateAndBuildV2.ps1 ../azure-sdk-for-net_tmp/generateInput.json ../azure-sdk-for-net_tmp/generateOutput.json

️✔️Azure.ResourceManager.Synapse [View full logs] [Release SDK Changes]
- Azure.ResourceManager.Synapse.1.1.0-alpha.20230124.1.nupkg
```
info	[Changelog]
```

️❌ azure-sdk-for-js failed [Detail]

❌Code Generator Failed [Logs]Release - Generate from c1475c5. SDK Automation 14.0.0

command	sh .scripts/automation_init.sh ../azure-sdk-for-js_tmp/initInput.json ../azure-sdk-for-js_tmp/initOutput.json
warn	File azure-sdk-for-js_tmp/initOutput.json not found to read
warn		specification/synapse/data-plane/readme.md skipped due to azure-sdk-for-js not found in swagger-to-sdk
command	sh .scripts/automation_generate.sh ../azure-sdk-for-js_tmp/generateInput.json ../azure-sdk-for-js_tmp/generateOutput.json
cmderr	[automation_generate.sh] [ERROR] An error occurred while generating codes for readme file: "specification/synapse/resource-manager/readme.md":
cmderr	[automation_generate.sh] [ERROR] Err: Error: Command failed: autorest --version=3.9.3 --typescript --modelerfour.lenient-model-deduplication --azure-arm --head-as-boolean=true --license-header=MICROSOFT_MIT_NO_VERSION --generate-test --typescript-sdks-folder=/mnt/vss/_work/1/s/azure-sdk-for-js ../azure-rest-api-specs/specification/synapse/resource-manager/readme.md --use=@autorest/typescript@6.0.0-rc.5
cmderr	[automation_generate.sh] [ERROR] Stderr: "null"
cmderr	[automation_generate.sh] [ERROR] Stdout: "null"
cmderr	[automation_generate.sh] [ERROR] ErrorStack: "Error: Command failed: autorest --version=3.9.3 --typescript --modelerfour.lenient-model-deduplication --azure-arm --head-as-boolean=true --license-header=MICROSOFT_MIT_NO_VERSION --generate-test --typescript-sdks-folder=/mnt/vss/_work/1/s/azure-sdk-for-js ../azure-rest-api-specs/specification/synapse/resource-manager/readme.md --use=@autorest/typescript@6.0.0-rc.5
cmderr	[automation_generate.sh] [ERROR]     at checkExecSyncError (node:child_process:861:11)
cmderr	[automation_generate.sh] [ERROR]     at Object.execSync (node:child_process:932:15)
cmderr	[automation_generate.sh] [ERROR]     at Object.<anonymous> (/opt/hostedtoolcache/node/16.19.0/x64/lib/node_modules/@azure-tools/js-sdk-release-tools/dist/hlc/generateMgmt.js:39:33)
cmderr	[automation_generate.sh] [ERROR]     at Generator.next (<anonymous>)
cmderr	[automation_generate.sh] [ERROR]     at /opt/hostedtoolcache/node/16.19.0/x64/lib/node_modules/@azure-tools/js-sdk-release-tools/node_modules/tslib/tslib.js:115:75
cmderr	[automation_generate.sh] [ERROR]     at new Promise (<anonymous>)
cmderr	[automation_generate.sh] [ERROR]     at Object.__awaiter (/opt/hostedtoolcache/node/16.19.0/x64/lib/node_modules/@azure-tools/js-sdk-release-tools/node_modules/tslib/tslib.js:111:16)
cmderr	[automation_generate.sh] [ERROR]     at Object.generateMgmt (/opt/hostedtoolcache/node/16.19.0/x64/lib/node_modules/@azure-tools/js-sdk-release-tools/dist/hlc/generateMgmt.js:20:20)
cmderr	[automation_generate.sh] [ERROR]     at /opt/hostedtoolcache/node/16.19.0/x64/lib/node_modules/@azure-tools/js-sdk-release-tools/dist/autoGenerateInPipeline.js:43:34"
error	Script return with result [failed] code [1] signal [null] cwd [azure-sdk-for-js]: sh .scripts/automation_generate.sh
warn	Skip package processing as generation is failed

️️✔️ azure-sdk-for-java succeeded [Detail] [Expand]

️✔️Succeeded [Logs]Release - Generate from c1475c5. SDK Automation 14.0.0

command	./eng/mgmt/automation/init.sh ../azure-sdk-for-java_tmp/initInput.json ../azure-sdk-for-java_tmp/initOutput.json
warn		specification/synapse/data-plane/readme.md skipped due to azure-sdk-for-java not found in swagger-to-sdk
command	./eng/mgmt/automation/generate.py ../azure-sdk-for-java_tmp/generateInput.json ../azure-sdk-for-java_tmp/generateOutput.json

️✔️azure-resourcemanager-synapse [View full logs] [Release SDK Changes]

️⚠️ azure-sdk-for-python-track2 warning [Detail]

⚠️Warning [Logs]Release - Generate from c1475c5. SDK Automation 14.0.0

command	sh scripts/automation_init.sh ../azure-sdk-for-python_tmp/initInput.json ../azure-sdk-for-python_tmp/initOutput.json
cmderr	[automation_init.sh] WARNING: Skipping azure-nspkg as it is not installed.
warn		specification/synapse/data-plane/readme.md skipped due to azure-sdk-for-python-track2 not found in swagger-to-sdk
command	sh scripts/automation_generate.sh ../azure-sdk-for-python_tmp/generateInput.json ../azure-sdk-for-python_tmp/generateOutput.json
cmderr	[automation_generate.sh]
cmderr	[automation_generate.sh] npm notice New major version of npm available! 8.19.3 -> 9.3.1
cmderr	[automation_generate.sh] npm notice Changelog: <https://github.com/npm/cli/releases/tag/v9.3.1>
cmderr	[automation_generate.sh] npm notice Run `npm install -g npm@9.3.1` to update!
cmderr	[automation_generate.sh] npm notice

️✔️track2_azure-mgmt-synapse [View full logs] [Release SDK Changes]
- azure_mgmt_synapse-1.0.0b1-py3-none-any.whl
- azure-mgmt-synapse-1.0.0b1.zip
```
info	[Changelog] ### Features Added
info	[Changelog]
info	[Changelog]   - Added operation group GetOperations
```

️️✔️ azure-sdk-for-go succeeded [Detail] [Expand]

️✔️Succeeded [Logs]Release - Generate from c1475c5. SDK Automation 14.0.0

command	sh ./eng/scripts/automation_init.sh ../../../../../azure-sdk-for-go_tmp/initInput.json ../../../../../azure-sdk-for-go_tmp/initOutput.json
warn		specification/synapse/data-plane/readme.md skipped due to azure-sdk-for-go not found in swagger-to-sdk
command	generator automation-v2 ../../../../../azure-sdk-for-go_tmp/generateInput.json ../../../../../azure-sdk-for-go_tmp/generateOutput.json

️✔️sdk/resourcemanager/synapse/armsynapse [View full logs] [Release SDK Changes] Breaking Change Detected

info	[Changelog] ### Breaking Changes
info	[Changelog]
info	[Changelog] - Type of `CmdkeySetupTypeProperties.TargetName` has been changed from `interface{}` to `any`
info	[Changelog] - Type of `CmdkeySetupTypeProperties.UserName` has been changed from `interface{}` to `any`
info	[Changelog] - Type of `ErrorAdditionalInfo.Info` has been changed from `interface{}` to `any`
info	[Changelog] - Type of `IntegrationRuntime.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `IntegrationRuntimeComputeProperties.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `IntegrationRuntimeConnectionInfo.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `IntegrationRuntimeDataFlowProperties.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `IntegrationRuntimeNodeMonitoringData.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `IntegrationRuntimeSsisCatalogInfo.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `IntegrationRuntimeSsisProperties.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `IntegrationRuntimeStatus.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `IntegrationRuntimeVNetProperties.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `KekIdentityProperties.UseSystemAssignedIdentity` has been changed from `interface{}` to `any`
info	[Changelog] - Type of `ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentity.DesiredState` has been changed from `*ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentityDesiredState` to `*DesiredState`
info	[Changelog] - Type of `ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentity.ActualState` has been changed from `*ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentityActualState` to `*ActualState`
info	[Changelog] - Type of `ManagedIntegrationRuntime.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `ManagedIntegrationRuntimeError.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `ManagedIntegrationRuntimeNode.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `ManagedIntegrationRuntimeOperationResult.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `ManagedIntegrationRuntimeStatus.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `Operation.Properties` has been changed from `interface{}` to `any`
info	[Changelog] - Type of `OperationResource.Properties` has been changed from `interface{}` to `any`
info	[Changelog] - Type of `SKUDescription.Restrictions` has been changed from `[]interface{}` to `[]any`
info	[Changelog] - Type of `SelfHostedIntegrationRuntime.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `SelfHostedIntegrationRuntimeNode.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `SelfHostedIntegrationRuntimeStatus.AdditionalProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `WorkspaceProperties.Settings` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type of `WorkspaceProperties.ExtraProperties` has been changed from `map[string]interface{}` to `map[string]any`
info	[Changelog] - Type alias `ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentityActualState` has been removed
info	[Changelog] - Type alias `ManagedIdentitySQLControlSettingsModelPropertiesGrantSQLControlToManagedIdentityDesiredState` has been removed
info	[Changelog] - Operation `*SQLPoolOperationResultsClient.GetLocationHeaderResult` has been changed to LRO, use `*SQLPoolOperationResultsClient.BeginGetLocationHeaderResult` instead.
info	[Changelog] - Operation `*SQLPoolsClient.Update` has been changed to LRO, use `*SQLPoolsClient.BeginUpdate` instead.
info	[Changelog] - Field `Interface` of struct `BigDataPoolsClientDeleteResponse` has been removed
info	[Changelog] - Field `Interface` of struct `IPFirewallRulesClientDeleteResponse` has been removed
info	[Changelog] - Field `Interface` of struct `SQLPoolsClientDeleteResponse` has been removed
info	[Changelog] - Field `Interface` of struct `SQLPoolsClientPauseResponse` has been removed
info	[Changelog] - Field `Interface` of struct `SQLPoolsClientResumeResponse` has been removed
info	[Changelog] - Field `Interface` of struct `WorkspacesClientDeleteResponse` has been removed
info	[Changelog]
info	[Changelog] ### Features Added
info	[Changelog]
info	[Changelog] - New type alias `ActualState` with values `ActualStateDisabled`, `ActualStateDisabling`, `ActualStateEnabled`, `ActualStateEnabling`, `ActualStateUnknown`
info	[Changelog] - New type alias `DesiredState` with values `DesiredStateDisabled`, `DesiredStateEnabled`
info	[Changelog] - New type alias `WorkspaceStatus` with values `WorkspaceStatusFailed`, `WorkspaceStatusInProgress`, `WorkspaceStatusSucceeded`
info	[Changelog] - New function `NewGetClient(string, azcore.TokenCredential, *arm.ClientOptions) (*GetClient, error)`
info	[Changelog] - New function `*GetClient.IntegrationRuntimeEnableInteractivequery(context.Context, string, string, string, string, *GetClientIntegrationRuntimeEnableInteractivequeryOptions) (GetClientIntegrationRuntimeEnableInteractivequeryResponse, error)`
info	[Changelog] - New function `*GetClient.IntegrationRuntimeStart(context.Context, string, string, string, string, *GetClientIntegrationRuntimeStartOptions) (GetClientIntegrationRuntimeStartResponse, error)`
info	[Changelog] - New function `*GetClient.IntegrationRuntimeStop(context.Context, string, string, string, string, *GetClientIntegrationRuntimeStopOptions) (GetClientIntegrationRuntimeStopResponse, error)`
info	[Changelog] - New function `NewKustoPoolPrivateLinkResourcesClient(string, azcore.TokenCredential, *arm.ClientOptions) (*KustoPoolPrivateLinkResourcesClient, error)`
info	[Changelog] - New function `*KustoPoolPrivateLinkResourcesClient.NewListPager(string, string, string, *KustoPoolPrivateLinkResourcesClientListOptions) *runtime.Pager[KustoPoolPrivateLinkResourcesClientListResponse]`
info	[Changelog] - New struct `ErrorResponseAutoGenerated`
info	[Changelog] - New struct `GetClient`
info	[Changelog] - New struct `IntegrationRuntimeEnableinteractivequery`
info	[Changelog] - New struct `IntegrationRuntimeOperationStatus`
info	[Changelog] - New struct `IntegrationRuntimeStopOperationStatus`
info	[Changelog] - New struct `KustoPoolPrivateLinkResources`
info	[Changelog] - New struct `KustoPoolPrivateLinkResourcesClient`
info	[Changelog] - New struct `KustoPoolPrivateLinkResourcesClientListResponse`
info	[Changelog] - New struct `PrivateLinkResources`
info	[Changelog] - New struct `PrivateLinkResourcesProperties`
info	[Changelog] - New field `IsAutotuneEnabled` in struct `BigDataPoolResourceProperties`
info	[Changelog] - New anonymous field `BigDataPoolResourceInfo` in struct `BigDataPoolsClientDeleteResponse`
info	[Changelog] - New field `AADObjectID` in struct `ClusterPrincipalProperties`
info	[Changelog] - New field `AADObjectID` in struct `DatabasePrincipalProperties`
info	[Changelog] - New anonymous field `IPFirewallRuleInfo` in struct `IPFirewallRulesClientDeleteResponse`
info	[Changelog] - New anonymous field `SQLPool` in struct `SQLPoolOperationResultsClientGetLocationHeaderResultResponse`
info	[Changelog] - New anonymous field `SQLPool` in struct `SQLPoolsClientDeleteResponse`
info	[Changelog] - New anonymous field `SQLPool` in struct `SQLPoolsClientPauseResponse`
info	[Changelog] - New anonymous field `SQLPool` in struct `SQLPoolsClientResumeResponse`
info	[Changelog] - New field `ConfigMergeRule` in struct `SparkConfigurationInfo`
info	[Changelog] - New anonymous field `Workspace` in struct `WorkspacesClientDeleteResponse`
info	[Changelog]
info	[Changelog] Total 35 breaking change(s), 50 additive change(s).

️⚠️ azure-resource-manager-schemas warning [Detail]

⚠️Warning [Logs]Release - Generate from c1475c5. Schema Automation 14.0.0

command	.sdkauto/initScript.sh ../azure-resource-manager-schemas_tmp/initInput.json ../azure-resource-manager-schemas_tmp/initOutput.json
cmderr	[initScript.sh] npm WARN old lockfile
cmderr	[initScript.sh] npm WARN old lockfile The package-lock.json file was created with an old version of npm,
cmderr	[initScript.sh] npm WARN old lockfile so supplemental metadata must be fetched from the registry.
cmderr	[initScript.sh] npm WARN old lockfile
cmderr	[initScript.sh] npm WARN old lockfile This is a one-time fix-up, please be patient...
cmderr	[initScript.sh] npm WARN old lockfile
warn	File azure-resource-manager-schemas_tmp/initOutput.json not found to read
warn		specification/synapse/data-plane/readme.md skipped due to azure-resource-manager-schemas not found in swagger-to-sdk
command	.sdkauto/generateScript.sh ../azure-resource-manager-schemas_tmp/generateInput.json ../azure-resource-manager-schemas_tmp/generateOutput.json
warn	No file changes detected after generation

️✔️synapse [View full logs]

️❌ azure-powershell failed [Detail]

❌Failed [Logs]Release - Generate from c1475c5. SDK Automation 14.0.0

command	sh ./tools/SwaggerCI/init.sh ../azure-powershell_tmp/initInput.json ../azure-powershell_tmp/initOutput.json
warn		specification/synapse/data-plane/readme.md skipped due to azure-powershell not found in swagger-to-sdk
command	pwsh ./tools/SwaggerCI/psci.ps1 ../azure-powershell_tmp/generateInput.json ../azure-powershell_tmp/generateOutput.json

❌Az.synapse [View full logs] [Release SDK Changes]

_{Posted by Swagger Pipeline | How to fix these errors?}

ghost · 2023-01-19T02:18:04Z

Thank you for your contribution saikumar-ms! We will review the pull request and get back to you soon.

openapi-pipeline-app · 2023-01-19T02:18:04Z

Generated ApiView

Language	Package Name	ApiView Link
Go	sdk/resourcemanager/synapse/armsynapse	https://apiview.dev/Assemblies/Review/c4272c03fb924a4f823f5734b651ed14
Java	azure-resourcemanager-synapse	https://apiview.dev/Assemblies/Review/5654ba63b3044df2a024e25e465836f4
.Net	Azure.ResourceManager.Synapse	There is no API change compared with the previous version

openapi-workflow-bot · 2023-01-19T02:24:36Z

Hi @saikumar-ms, Your PR has some issues. Please fix the CI sequentially by following the order of Avocado, semantic validation, model validation, breaking change, lintDiff. If you have any questions, please post your questions in this channel https://aka.ms/swaggersupport.

Task	How to fix	Priority
Avocado	Fix-Avocado	High
Semantic validation	Fix-SemanticValidation-Error	High
Model validation	Fix-ModelValidation-Error	High
LintDiff	Fix-LintDiff	high

If you need further help, please feedback via swagger feedback.

updated Spark version from 2.4 to 3.3

f14ea23

updated Spark version from 2.4 to 3.3. Spark version 2.4 is close to end of life.

saikumar-ms requested review from wonner and yanjungao718 as code owners January 19, 2023 02:17

openapi-assignment-bot bot assigned lmazuel Jan 19, 2023

ghost added the customer-reported Issues that are reported by GitHub users external to the Azure organization. label Jan 19, 2023

ghost added the Synapses label Jan 19, 2023

AzureRestAPISpecReview added CI-FixRequiredOnFailure data-plane resource-manager labels Jan 19, 2023

azure-sdk mentioned this pull request Jan 19, 2023

[AutoPR sdk/resourcemanager/synapse/armsynapse] updated Spark version from 2.4 to 3.3 azure-sdk/azure-sdk-for-go#4029

Closed

openapi-pipeline-app bot added the CI-BreakingChange-Go label Jan 19, 2023

openapi-pipeline-app bot added the CI-BreakingChange-JavaScript label Jan 19, 2023

azure-sdk mentioned this pull request Jan 19, 2023

[AutoPR Az.synapse] updated Spark version from 2.4 to 3.3 azure-sdk/azure-powershell#3939

Closed

wonner approved these changes Jan 19, 2023

View reviewed changes

lmazuel approved these changes Jan 24, 2023

View reviewed changes

lmazuel merged commit c1475c5 into main Jan 24, 2023

lmazuel deleted the UpdateSparkVersionInExamples branch January 24, 2023 00:49

This was referenced Jan 24, 2023

[ReleasePR track2_azure-mgmt-synapse] Fix placeholder links causing 404s Azure/azure-sdk-for-python#24122

Closed

[ReleasePR Azure.ResourceManager.Synapse] Fix placeholder links causing 404s Azure/azure-sdk-for-net#32161

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

updated Spark version from 2.4 to 3.3 #22238

updated Spark version from 2.4 to 3.3 #22238

saikumar-ms commented Jan 19, 2023

openapi-workflow-bot bot commented Jan 19, 2023

openapi-pipeline-app bot commented Jan 19, 2023 •

edited

Loading

openapi-pipeline-app bot commented Jan 19, 2023 •

edited

Loading

Breaking Changes Tracking

ghost commented Jan 19, 2023

openapi-pipeline-app bot commented Jan 19, 2023 •

edited

Loading

openapi-workflow-bot bot commented Jan 19, 2023

updated Spark version from 2.4 to 3.3 #22238

updated Spark version from 2.4 to 3.3 #22238

Conversation

saikumar-ms commented Jan 19, 2023

openapi-workflow-bot bot commented Jan 19, 2023

openapi-pipeline-app bot commented Jan 19, 2023 • edited Loading

Swagger Validation Report

openapi-pipeline-app bot commented Jan 19, 2023 • edited Loading

Swagger Generation Artifacts

Breaking Changes Tracking

ghost commented Jan 19, 2023

openapi-pipeline-app bot commented Jan 19, 2023 • edited Loading

Generated ApiView

openapi-workflow-bot bot commented Jan 19, 2023

openapi-pipeline-app bot commented Jan 19, 2023 •

edited

Loading

openapi-pipeline-app bot commented Jan 19, 2023 •

edited

Loading

openapi-pipeline-app bot commented Jan 19, 2023 •

edited

Loading