Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add EnvironmentVariables in sparkjob #25814

Merged
merged 1 commit into from
Sep 18, 2023

add EnvironmentVariables in sparkjob

8241d2b
Select commit
Loading
Failed to load commit list.
Merged

add EnvironmentVariables in sparkjob #25814

add EnvironmentVariables in sparkjob
8241d2b
Select commit
Loading
Failed to load commit list.
openapi-pipeline-app / Breaking Change(Cross-Version) succeeded Sep 15, 2023 in 3m 33s

Breaking Change(Cross-Version) succeeded

CrossVersionBreakingChange
View more details.

Details

compared swaggers (via Oad v0.10.4)] new version base version
mfe.json 2023-08-01-preview(8241d2b) 2023-04-01(main)
mfe.json 2023-08-01-preview(8241d2b) 2023-06-01-preview(main)

The following breaking changes are detected by comparison with the latest stable version:

Rule Message
⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L12412:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L9389:5
⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L12475:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L9449:5
⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L12513:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L9484:5
⚠️ 1032 - DifferentAllOf The new version has a different 'allOf' property than the previous one.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L12610:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L9550:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosKeytab, KerberosPassword' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15384:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11247:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Hdfs, OneLake' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15352:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11224:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosPassword, KerberosKeytab' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15436:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11299:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Labeling, Spark' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L18848:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13462:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Custom' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L21781:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L14541:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Scheduled' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L18888:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13479:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'ModelDataCollector' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15504:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11359:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'ImportData, CreateMonitor' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L24320:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L15967:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosPassword, KerberosKeytab' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15436:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11299:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosKeytab, KerberosPassword' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15384:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11247:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Custom' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L21781:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L14541:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Direct' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L12089:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L9149:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Labeling, Spark' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L18848:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13462:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Scheduled' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L18888:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13479:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Hdfs, OneLake' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15352:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11224:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Hdfs, OneLake' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15352:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11224:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Hdfs, OneLake' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15352:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11224:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Hdfs, OneLake' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15352:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11224:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosPassword, KerberosKeytab' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15436:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11299:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosKeytab, KerberosPassword' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15384:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11247:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Ray' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15575:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11430:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Labeling, Spark' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L18848:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13462:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Scheduled' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L18888:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13479:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'ModelDataCollector' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L14350:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L10819:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosKeytab, KerberosPassword' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L14401:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L10839:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Direct' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L12089:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L9149:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Hdfs, OneLake' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15443:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11306:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Ray' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15586:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11441:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'ImportData, CreateMonitor' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L24320:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L15967:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'ImportData, CreateMonitor' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L24320:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L15967:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Scheduled' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L19260:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13822:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Labeling, Spark' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L19381:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13905:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Direct' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L12089:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L9149:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Direct' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L12089:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L9149:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Ray' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15575:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11430:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Custom' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L21792:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L14552:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosKeytab, KerberosPassword' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15384:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11247:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Direct' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L22515:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L14932:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Labeling, Spark' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L18848:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13462:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Scheduled' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L18888:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L13479:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'Ray' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15575:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11430:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosPassword, KerberosKeytab' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15436:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11299:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosKeytab, KerberosPassword' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15384:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11247:9
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'ImportData, CreateMonitor' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L24332:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L15979:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosPassword, KerberosKeytab' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L24524:5
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L16138:5
💬 1020 - AddedEnumValue The new version is adding enum value(s) 'KerberosPassword, KerberosKeytab' from the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L15436:9
Old: Microsoft.MachineLearningServices/stable/2023-04-01/mfe.json#L11299:9


The following breaking changes are detected by comparison with the latest preview version:

Rule Message
⚠️ 1005 - RemovedPath The new version is missing a path that was found in the old version. Was path '/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.MachineLearningServices/workspaces/{workspaceName}/featuresets/{name}/versions/{version}/listMaterializationJobs' removed or restructured?
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L7638:5
⚠️ 1017 - ReferenceRedirection The '$ref' property points to different models in the old and new versions.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L7641:13
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L7606:13
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'createdDate' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'displayName' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'duration' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'experimentId' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'featureWindow' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'jobId' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'status' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'tags' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1033 - RemovedProperty The new version is missing a property found in the old version. Was 'type' renamed or removed?
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
⚠️ 1046 - RemovedOptionalParameter The optional parameter 'includeJobInstructions' was removed in the new version.
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L9003:11
⚠️ 1046 - RemovedOptionalParameter The optional parameter 'includeLabelCategories' was removed in the new version.
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L9010:11
💬 1038 - AddedPath The new version is adding a path that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L11384:5
💬 1038 - AddedPath The new version is adding a path that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L11435:5
💬 1038 - AddedPath The new version is adding a path that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L11732:5
💬 1038 - AddedPath The new version is adding a path that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L11785:5
💬 1040 - AddedReadOnlyPropertyInResponse The new version has a new read-only property 'properties' in response that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L22808:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L22363:7
💬 1041 - AddedPropertyInResponse The new version has a new property 'jobIds' in response that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16734:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16139:7
💬 1043 - AddingOptionalParameter The optional parameter 'listViewType' was added in the new version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L6882:11
💬 1043 - AddingOptionalParameter The optional parameter 'pageSize' was added in the new version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L6909:11
💬 1043 - AddingOptionalParameter The optional parameter 'properties' was added in the new version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L8438:11
💬 1045 - AddedOptionalProperty The new version has a new optional property 'dataAvailabilityStatus' that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16675:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16272:7
💬 1045 - AddedOptionalProperty The new version has a new optional property 'jobId' that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16675:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16272:7
💬 1045 - AddedOptionalProperty The new version has a new optional property 'properties' that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L16675:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L16272:7
💬 1045 - AddedOptionalProperty The new version has a new optional property 'properties' that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L22713:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L22281:7
💬 1045 - AddedOptionalProperty The new version has a new optional property 'environmentVariables' that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L24904:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L24344:7
💬 1045 - AddedOptionalProperty The new version has a new optional property 'componentConfiguration' that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L25409:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L24836:7
💬 1045 - AddedOptionalProperty The new version has a new optional property 'resources' that was not found in the old version.
New: Microsoft.MachineLearningServices/preview/2023-08-01-preview/mfe.json#L25409:7
Old: Microsoft.MachineLearningServices/preview/2023-06-01-preview/mfe.json#L24836:7
View more details on openapi-pipeline-app