Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DataFactory]Support source sink level staging #13989

Merged
merged 1 commit into from
Aug 6, 2020
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions eng/mgmt/mgmtmetadata/datafactory_resource-manager.txt
Original file line number Diff line number Diff line change
Expand Up @@ -4,11 +4,11 @@ Commencing code generation
Generating CSharp code
Executing AutoRest command
cmd.exe /c autorest.cmd https://github.com/Azure/azure-rest-api-specs/blob/master/specification/datafactory/resource-manager/readme.md --csharp --version=v2 --reflect-api-versions --tag=package-2018-06 --csharp-sdks-folder=D:\Projects\azure-sdk-for-net\sdk
2020-07-30 05:05:28 UTC
2020-08-06 02:01:09 UTC
Azure-rest-api-specs repository information
GitHub fork: Azure
Branch: master
Commit: b8630cc7b5869fbb764eeca3a618b23141e612db
Commit: 9ea4dc2d936d8eaae61d507242771b1d6447a96e
AutoRest information
Requested version: v2
Bootstrapper version: autorest@2.0.4413
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@
- Added column delimiter for SAP Table/open hub
- Added azureCloudType for Aad Auth
- Added snapshot to Azure File Storage linked service
- Added source/sink level staging support in dataflow

## Version 4.10.0
### Feature Additions
Expand Down

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@
- Added column delimiter for SAP Table/open hub
- Added azureCloudType for Aad Auth
- Added snapshot to Azure File Storage linked service
- Added source/sink level staging support in dataflow
]]></PackageReleaseNotes>
</PropertyGroup>
<PropertyGroup>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -92,5 +92,51 @@ public class DataFlowJsonSamples : JsonSampleCollection<DataFlowJsonSamples>
}
}
";

[JsonSample]
public const string MappingDataFlowWithSourceSinkStaging = @"
{
""name"": ""exampleDataFlow"",
""properties"": {
""description"": ""Sample demo data flow to convert currencies showing usage of union, derive and conditional split transformation."",
""type"": ""MappingDataFlow"",
""typeProperties"": {
""sources"": [
{
""dataset"": {
""referenceName"": ""CurrencyDatasetUSD"",
""type"": ""DatasetReference""
},
""name"": ""USDCurrency"",
""staging"": {
""linkedService"": {
""referenceName"": ""blob_store_sasToken01"",
""type"": ""LinkedServiceReference""
},
""folderPath"":""testcontainer01""
}
}
],
""sinks"": [
{
""dataset"": {
""referenceName"": ""USDOutput"",
""type"": ""DatasetReference""
},
""name"": ""USDSink"",
""staging"": {
""linkedService"": {
""referenceName"": ""blob_store_sasToken02"",
""type"": ""LinkedServiceReference""
},
""folderPath"":""testcontainer02""
}
}
],
""script"": ""some script""
}
}
}
";
}
}