Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EPIC] Populate algorithm catalog #28

Open
5 of 11 tasks
jdries opened this issue Sep 12, 2024 · 14 comments
Open
5 of 11 tasks

[EPIC] Populate algorithm catalog #28

jdries opened this issue Sep 12, 2024 · 14 comments
Assignees

Comments

@jdries
Copy link
Contributor

jdries commented Sep 12, 2024

EPIC to add a first set of (existing) UDP's to the algorithm catalog.

Guidelines for creating examples will soon appear here:

https://esa-apex.github.io/apex_documentation/eo_service_usage.html

We currently consider these lists:

VITO:

Non-VITO:

@jdries
Copy link
Contributor Author

jdries commented Sep 12, 2024

@Patrick1G This is the overview issue, allowing to easily maintain a list of UDP's we would aim for in the MVP.
@JeroenVerstraelen @HansVRP We'll want to consider this for planning.

@Patrick1G
Copy link

@jdries that looks like good starting point.
We could consider a couple of other examples from the community examples repo (also to have a good balance with non VITO workflows)... The parcel delineation algo would certainly also be interesting for users, yet developed by VITO...

@Patrick1G
Copy link

oh and PS; what's the point of having an EODC and VITO version of biopar?

@HansVRP
Copy link
Contributor

HansVRP commented Sep 27, 2024

@jdries what requirements do we have on the input parameters for the to be included openEO processes?

bbox and temporal range?

@jdries
Copy link
Contributor Author

jdries commented Sep 27, 2024

@HansVRP that's usually the minimum, but it actually depends on the UDP.
Now this is considered public API, so once a parameter is introduced, changing it is not backwards compatible.
So the general recommendation is to start out with a minimal set.

@HansVRP
Copy link
Contributor

HansVRP commented Sep 27, 2024

Good to know there are no restrictions.
Some of the listed probably also have some parameters related to the used ML network ect.

@Patrick1G
Copy link

@jdries @JanssenBrm to be true to the APEx vision, we would (or will eventually) also expose other algorithms hosted o other platforms. Below is a listing of EOXhub algorithms from the NOR.. Several of those use an Application Package implementation..
I wonder if we could aggregate a few of these early on...

image

@jdries
Copy link
Contributor Author

jdries commented Oct 4, 2024

@Patrick1G this indeed looks like a nice collection to integrate, especially also very mature with respect to having pricing and so on.
The only prerequisite from our side is that we need the OGC Processes API to invoke it (or openEO, but that doesn't seem to be applicable here). I checked the docs, which mention an api on this page:
https://eurodatacube.com/documentation/generate_data_on_demand
but it doesn't look like OGC Processes at first sight. Could you check with EDC if they can give us such an endpoint, or should we reach out?

@Patrick1G
Copy link

@p3dr0
Could you make sure we have all of those algos integrated into the catalogue early on..
image

@Patrick1G
Copy link

@Patrick1G this indeed looks like a nice collection to integrate, especially also very mature with respect to having pricing and so on. The only prerequisite from our side is that we need the OGC Processes API to invoke it (or openEO, but that doesn't seem to be applicable here). I checked the docs, which mention an api on this page: https://eurodatacube.com/documentation/generate_data_on_demand but it doesn't look like OGC Processes at first sight. Could you check with EDC if they can give us such an endpoint, or should we reach out?

I asked EOX to look into this, but have not heard anything back (purposefully hesitant?)

I have asked PLES team to look into this in the meantime..

@p3dr0
Copy link
Member

p3dr0 commented Oct 9, 2024

added two examples on this pull request
#39
I'll add more after checking with @jdries the are ok

@Patrick1G
Copy link

@p3dr0 @JanssenBrm @psacra
For APEx to integrate the Elip and EDC/EOXhub services/algos above, APEx needs to have a valid subscription to all the relevant platforms, to be obtained from the NOR (now?). This should also cover testing requirements..

@p3dr0
Copy link
Member

p3dr0 commented Oct 17, 2024

We'd need to size it according to the planned test scenarios (daily, hour) and the duration (next 6 months? )
I'll update the list of services on the PR, add the metadata element missing and draft a NoR request for it

@jdries
Copy link
Contributor Author

jdries commented Oct 18, 2024

@p3dr0 see my other comment for the sizing: please adjust the frequency depending on the scenario cost. I would start from weekly frequency for cheap scenarios. Higher frequency seems like overkill, and because we are likely to run multiple scenarios against the same platform, we will still have a pretty high per platform frequency that allows us to detect general issues in a timely manner.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants