- the aim of this repo is to process and store
.xml
based training data from kettlerSJ10X SKYLON 5
- it comprises concurring approaches for processing:
azure-data-facory
,net-core-webapp
andpython
- for more analysis see jupyter-notebook
.xml
files are uploaded into theazure-data-facory
via azure blobs- pipeline transforms xml structures into sql tables
📦src
┣ 📂azure
┃ ┣ 📂dataflow
┃ ┃ ┣ 📜Spiro_dataflow.json
┃ ┃ ┗ 📜YT_flow.json
┃ ┣ 📂dataset
┃ ┃ ┣ 📜DatasetSqlOrders_out.json
┃ ┃ ┣ 📜DelimitedTextDataset_in.json
┃ ┃ ┣ 📜JsonTest.json
┃ ┃ ┣ 📜KettlerBlobRead.json