-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Set up initial benchmark for worldcereal #4
Comments
initial setup is done
|
instead of on pull also allow manual trigger
First benchmark batch job is now running, fully triggered from GitHub workflow:
|
So the basics are in place now. Quite some further finetuning and documentation to be covered (see |
to have a simpler use case than worldcereal_inference
because the worldcereal use case is still failing, I now added a very simple max NDVI UDP and benchmark scenario which now successfully runs in the benchmark workflow |
Initial benchmark setup, with a daily run can be checked at https://github.com/ESA-APEx/apex_algorithms/actions/workflows/benchmarks.yaml note that it sometimes works, and sometimes fails, but that is indication that the benchmark system works: one benchmark scenario (max_ndvi) finishes, while the worldcereal one does not work yet |
I think it's time to close this one: basics are in place, |
A simple initial benchmark workflow using the worldcereal scenario.
No regression test, no metrics
Github action, doesn't have to be recurrent yet.
The text was updated successfully, but these errors were encountered: