Start with parallel processing

[anikaweinmann]

• Parallel Ephemeral Processing
  • Importer
  • Stdout

TODO in other PR:

• Parallel Persistent Processing
• Parallel Ephemeral Processing - Exporter
• Parallel Ephemeral Processing - reuse of exporter in next PC

[mmacata]

Nice! Thanks a lot!
I made some review comments and additionally some general thoughts:

• for the database table fields and models, some attributes might not be needed
• It would be great to get rid off all Regeldatei / Rulefile occurances, as this schema is not used here
• Please re-check the copyright notes. I found Copyright (c) 2018-present at least once and also inconsistencies between the two header years
• I like the endpoint /api/v3/locations/nc_spm_08_grass7_root/processing_parallel but I am not so sure about the "general" ones with /api/v3/processing_parallel/batchjobs/1 and /api/v3/processing_parallel/jobs/1. It might be a bit confusing as usually the jobs can be found at the according ressource within actinia-core. I would like to discuss some alternatives here, maybe next week in person ;)

[anikaweinmann]

• I like the endpoint /api/v3/locations/nc_spm_08_grass7_root/processing_parallel but I am not so sure about the "general" ones with /api/v3/processing_parallel/batchjobs/1 and /api/v3/processing_parallel/jobs/1. It might be a bit confusing as usually the jobs can be found at the according ressource within actinia-core. I would like to discuss some alternatives here, maybe next week in person ;)

• /api/v3/resouces/USERID/batches/1 (Only users who are in the group that created the job are allowed to query it!)

• /api/v3/resouces/USERID/batches/1/jobs/1 (Only users who are in the group that created the job are allowed to query it!)

• /api/v3/resouces/USERID/jobs/resource_id_without_"resource_id"

  • Equal to /api/v3/resouces/USERID/resource_id_with_"resource_id" (will be done later in actinia_core)
  • for iterations all are returned
  • /api/v3/resouces/USERID/jobs/resource_id_without_"resource_id"/iterations"/ITERATION_NUMBER returns only one iteration
  • /api/v3/resouces/USERID/jobs/resource_id_without_"resource_id"/iterations/latest returns only the last iteration

[anikaweinmann]

@mmacata the endpoints are changed as discussed, please review again.
Dependencies are added to README in actinia-org/actinia-core#356

[mmacata]

Thanks a lot! Great :)