Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

recipe_globwat.yml takes more than 12 hours to run #2543

Closed
schlunma opened this issue Feb 18, 2022 · 1 comment · Fixed by #2548
Closed

recipe_globwat.yml takes more than 12 hours to run #2543

schlunma opened this issue Feb 18, 2022 · 1 comment · Fixed by #2548
Assignees

Comments

@schlunma
Copy link
Contributor

Describe the bug
recipe_globwat.yml didn't finish in a 12 hour-period (https://esmvaltool.dkrz.de/shared/esmvaltool/v2.5.0-test-rc2/recipe_globwat_20220213_145613/run/main_log_debug.txt). The reason for this is that it regrids the 30 years of daily data to a 2160x4320° grid (given by a target grid stored in our auxiliary data directory). After that it does a calculation for each of the 11323 days which takes about 30s for each individual day. --> Estimated run time > 90 hours (!).

I'm wondering if it's possible to reduce the time period of the data (we can leave the original time period in a comment). I tested the recipes with 30 days and just runs fine.

@SarahAlidoost I saw that you are an author of this recipe, what is your opinion?

@SarahAlidoost
Copy link
Contributor

Describe the bug recipe_globwat.yml didn't finish in a 12 hour-period (https://esmvaltool.dkrz.de/shared/esmvaltool/v2.5.0-test-rc2/recipe_globwat_20220213_145613/run/main_log_debug.txt). The reason for this is that it regrids the 30 years of daily data to a 2160x4320° grid (given by a target grid stored in our auxiliary data directory). After that it does a calculation for each of the 11323 days which takes about 30s for each individual day. --> Estimated run time > 90 hours (!).

I'm wondering if it's possible to reduce the time period of the data (we can leave the original time period in a comment). I tested the recipes with 30 days and just runs fine.

@SarahAlidoost I saw that you are an author of this recipe, what is your opinion?

Thanks, I think using the smaller time range should be fine too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants