Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixes and changes since august 13 #50

Open
wants to merge 81 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
81 commits
Select commit Hold shift + click to select a range
56da207
First version of tests/
senesis Jun 13, 2023
1de2bed
Improve tests/compare_results.sh
senesis Aug 17, 2023
c00875f
Orchidee vars are searched in [sechiba|stomate_ipcc]_history
senesis Aug 18, 2023
b856e45
Fix setenv_C-ESM-EP.sh re. pcocc-rs
senesis Aug 25, 2023
c381234
Polish presentation for libIGCM_guide.rst
senesis Aug 27, 2023
8ea339d
Update libIGCM_guide.rst
senesis Aug 27, 2023
246c741
Update libIGCM_guide.rst
senesis Aug 29, 2023
8f07e60
stage check_ref_comparison.sh
senesis Sep 8, 2023
3c199b6
Merge branch 'lighter' into with_tests
senesis Sep 8, 2023
fbb17f0
Fix tests/compare_results.sh
senesis Sep 8, 2023
223f94d
Don't set queue in standard_comparison/*/params*py
senesis Oct 3, 2023
84de707
Module used on spirit bu setenv_C-ESM-EP.sh is now env20230611_climaf…
senesis Oct 3, 2023
3011ca8
Delete libIGCM_guide.rst
senesis Oct 3, 2023
cc6098f
run_C-ESM-EP sets --ntasks at IDRIS and spirit.
senesis Oct 3, 2023
c99d5a2
run_C-ESM-EP.py uses subprocess.check_output rather than os.system
Oct 5, 2023
9daa663
Fix syntax for period in libIGCM_datasets.py
Oct 5, 2023
a7dbcf0
At TGCC, use /ccc/work instead of /ccc/workflash
Oct 5, 2023
9f0b049
Add libIGCM_debug.sh (for duplicating a cesemp_lite/ dir)
Oct 6, 2023
7a87864
Merge remote-tracking branch 'irene/lighter' into lighter
senesis Oct 6, 2023
143b684
Remove tests material (moved to another repository)
senesis Oct 6, 2023
967cd79
Merge branch 'lighter' of github into lighter
senesis Oct 6, 2023
cdad7c4
Add test/comparison/ in .gitignore
senesis Oct 9, 2023
4d132bb
Merge branch 'lighter' of ssh://github.com/jservonnat/C-ESM-EP into l…
senesis Oct 9, 2023
c3c3dd1
Fix verbose mode (by moving use of 'verbose' after reading it ...)
senesis Oct 11, 2023
1e53519
install_lite.sh ask user before superseding an existing cesmep_lite dir
senesis Oct 27, 2023
5e2355e
libIGCM_install.sh creates a link to R_SAVE
senesis Oct 30, 2023
2f6bc7c
Add kill-on-invalid-dep at IDRIS for auxiliary test job
senesis Oct 30, 2023
09d99a5
At TGCC, chmod +r on CESMEP_bandeau
senesis Nov 2, 2023
4aebbfc
libIGCM_post.sh sources setenv_C-ESM-EP.sh
senesis Nov 3, 2023
37bf78a
Fix typo in libIGCM_install.sh error message re. list of components
senesis Nov 3, 2023
08d562f
job_C-ESM-EP.sh : discard srun mpi option at IDRIS
senesis Nov 3, 2023
dc19803
At Idris, in job_C-ESM-EP.sh, bind /gpfsscratch to /gpfsssd/scratch
senesis Nov 3, 2023
725078e
Allow interactive run from comparison dir, incl with libIGCM
senesis Nov 8, 2023
1927f05
Handle do_parallel at TGCC
senesis Nov 8, 2023
fa3be31
Fix regression in job_C-ESM-EP.sh ($main -> $atlas_script)
senesis Nov 9, 2023
9466b0f
At TGCC, use shared images repositories for containers
senesis Nov 10, 2023
c09fb82
Set verbose to 'error' in params files; fix for 3D variables (histmth)
senesis Nov 12, 2023
0a7aa94
With libIGCM : Handle CesmepSlicesDuration (if provided)
Nov 13, 2023
658a055
Change altas output tree (with libIGCM). Handle QOS and time. Ease tr…
Nov 16, 2023
0a24d2f
Change altas output tree (with libIGCM). Handle QOS and time. Ease tr…
senesis Nov 16, 2023
530b65d
With libIGCM : Handle CesmepSlicesDuration (if provided)
senesis Nov 16, 2023
1897da0
libIGCM_post.sh adds comparison dir in PYTHONPATH
senesis Nov 16, 2023
de9730f
Fix plot_params for ta500 and ta700
senesis Dec 7, 2023
789cab0
Fix handling QOS
senesis Dec 7, 2023
7a63ad7
In component Atmosphere_Surface : avoid to set reference='default'
senesis Dec 7, 2023
186e534
With libIGCM : handle CesmepReferences from config.card
Dec 7, 2023
1195572
With libIGCM : handle CesmepReferences from config.card
Dec 7, 2023
cc204ba
With libIGCM : at install, check that reference simulation has some data
Dec 8, 2023
050818a
With libIGCM : at install, check that reference simulation has some data
Dec 8, 2023
956824d
Fix typo in custom_plot_params.py
senesis Dec 14, 2023
67fa590
A fix re. handling references list in main_C-ESM-EP.py
Feb 4, 2024
797bbb9
Merge remote-tracking branch 'irene/lighter' into lighter
senesis Feb 4, 2024
c0420fc
Improve handling references list (can include 'default')
Feb 6, 2024
906f22d
Fix params_Atmosphere_StdPressLev.py
senesis Feb 6, 2024
d26e701
Merge Improve handling references list (can include 'default')
senesis Feb 6, 2024
f874d9c
Fix NEMO_main re. list of references
Feb 6, 2024
1bf28b8
PEP008
Feb 8, 2024
04deb47
Fix diagnostics_MainTimeSeries for references list
Feb 8, 2024
c00d850
PEP008
Feb 8, 2024
ae22d20
In libIGCM_install.sh : add custom_name for references
Feb 8, 2024
bfe3e9b
Merge a few fixes re. references list
senesis Feb 8, 2024
c79bc71
Fix diagnostics_MainTimeSeries for references list
senesis Feb 9, 2024
d05c947
Fix on setting custom_name for libIGCM references
senesis Feb 27, 2024
17e2a56
another fix on setting custom_name for libIGCM references
senesis Feb 27, 2024
45e1818
Fix libIGCM_clean.sh
Mar 5, 2024
b773706
fix libIGCM_install.sh re. TagName on spirit
Mar 5, 2024
ab91abf
Display directory names when cleaning them
Mar 5, 2024
1992c30
Fix std_comparison/diagnostics_AtasExplorer.py re. climato_vars
Mar 11, 2024
a4d3b1c
libIGCM_install.sh handles CesmepInputFrequency and full references path
Mar 11, 2024
d97df30
Merge remote-tracking branch 'irene/lighter' into lighter
senesis Mar 11, 2024
0179db0
With libIGCM : allow to change segments of the data path (root, login…
Mar 12, 2024
3c09135
Merge remote-tracking branch 'irene/lighter' into lighter
senesis Mar 12, 2024
9d24c1d
SRF and SBG allows for MainTimeSeries and AtlasExplorer
senesis Jun 9, 2024
0059a37
Fix libIGCM_install.sh re. data frequency
senesis Jun 26, 2024
e75539c
At TGCC, job_C-ESM-EP.sh uses $CESMEP_CONTAINER
senesis Jun 28, 2024
37df0ca
Fix exporting $CESMEP_CONTAINER
Jun 30, 2024
e2aedec
At HPC centers, use a CLiMAF version from ~igcmg/Tools
Jul 3, 2024
fd8554a
job_C-ESM-EP.sh exports SLURM_JOBID to container
senesis Jul 3, 2024
2ce1249
Ensure last thredds_cp terminates OK. Fix thredds_cp path
senesis Jul 6, 2024
7c989a2
Add script 'push_to_centers.sh', for deploying a version at HPC centers
senesis Jul 14, 2024
78b3b2a
Fix errors in variable names (JobName vs ExperimentName...)
senesis Jul 18, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 6 additions & 4 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,9 @@
*log
*job.in
*last.out
/reference_comparison/AtlasExplorer/AtlasExplorer_reference_comparison_C-ESM-EP_*
/reference_comparison/AtlasExplorer/AtlasExplorer_reference_comparison_C-ESM-EP.e921695
/reference_comparison/AtlasExplorer/copy_html_error_page.sh.e921696
slurm-*.out
/*/*/*_comparison_C-ESM-EP_*
/*/*/copy_html_error_page.sh.e*
slurm-*.out
/test_comparison
/*/launched_jobs
/*/mailjob
162 changes: 0 additions & 162 deletions Documentation/libIGCM_guide.rst

This file was deleted.

4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,4 +8,6 @@ The result is a front html page with links to the html pages of the atlases of t
Atlas Explorer is an easy and flexible way to produce an html page showing climatologies and difference maps (with a reference) on a set of datasets (simulations, models, different periods…).
The main goal of the Atlas Explorer is to provide the user with a set of predefined features to assess a variable (plotting parameters, default observational reference) while keeping a lot of control on the diagnostics from only one parameter file.

The C-ESM-EP works on Ciclad and Curie at IPSL, and at CNRM.
The C-ESM-EP works on Spirit, Jean-Zay and Irene at IPSL, and at CNRM.

Its documentation lies on its [GitHub repository Wiki](https://github.com/jservonnat/C-ESM-EP/wiki)
23 changes: 16 additions & 7 deletions custom_plot_params.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,14 @@
# Created : S.Sénési - nov 2015
# Adapter : J.Servonnat - april 2016

from climaf.utils import ranges_to_string

dict_plot_params = {
'evap': {
'default': {'color': 'precip3_16lev', 'units': '', 'scale':86400},
'default': {'color': 'precip3_16lev', 'units': '', 'scale': 86400},
'full_field': {'colors': '0 0.1 0.5 1 2 3 4 5 6 7 8 9 10'},
'bias': {'min':-1,'max':1,'delta':0.01, 'color': 'BlueWhiteOrangeRed'},
'model_model': {'min':-0.7,'max':0.7,'delta':0.05, 'color': 'BlueWhiteOrangeRed'},
'bias': {'min': -1, 'max': 1, 'delta': 0.01, 'color': 'BlueWhiteOrangeRed'},
'model_model': {'min': -0.7, 'max': 0.7, 'delta': 0.05, 'color': 'BlueWhiteOrangeRed'},

},
'pr': {
Expand Down Expand Up @@ -57,9 +59,16 @@
# 'mrro': {'full_field': dict(colors='0 0.1 0.25 0.5 0.75 1 2 5')},
# 'mrros': {'full_field': dict(colors='0 0.1 0.25 0.5 0.75 1 2 5')},




# Next two entries in order to fix a typo in CLiMAF V3.0, for the 'full_field' entries
'ta700': {
'default': {'units': 'degC', 'color': 'BlueWhiteOrangeRed', 'offset': -273.15},
'full_field': {'colors': ranges_to_string(ranges=[[-40, 0, 10], [0, 25, 5]])},
'bias': {'min': -5, 'max': 5, 'delta': 1, 'offset': 0},
'model_model': {'min': -10, 'max': 10, 'delta': 1, 'offset': 0}},
'ta500': {
'default': {'units': 'degC', 'color': 'BlueWhiteOrangeRed', 'offset': -273.15},
'full_field': {'colors': ranges_to_string(ranges=[[-40, 0, 10], [0, 25, 5]])},
'bias': {'min': -5, 'max': 5, 'delta': 1, 'offset': 0},
'model_model': {'min': -10, 'max': 10, 'delta': 1, 'offset': 0}}

}

23 changes: 17 additions & 6 deletions install_lite.sh
Original file line number Diff line number Diff line change
Expand Up @@ -22,15 +22,27 @@
cesmep_dir=$(cd $(dirname $0) ; pwd) # Dir of current code
[ -h $cesmep_dir/share ] && echo "Cannot work from a lite install" && exit 1

target=${1?}
comparison=${2?}
target=${1?"Provide target directory as first argument"}
comparison=${2?"Provide comparison name as second argument"}
with_libIGCM=${3:-no} # If arg #3 is set, also link scripts used by libIGCM

target=$(cd $target ; pwd)
[ ! -d $target ] && \
echo "$0 : Must provide an existing directory as first argument" && exit 1
target=$target/cesmep_lite
if [ -d $target ] ; then
echo -e "\033[1;32mThere's already a C-ESM-EP lite install at $target."
echo -n -e " Do you want to supersede it (y/N) ? : \033[m"
read reponse
case ${reponse} in
oui|OUI|o|y|yes|YES)
echo "OK"
;;
non|NON|n|no|NO|*)
echo "No C-ESM-EP install !"
exit 9
;;
esac
chmod -R 777 $target
rm -fR $target
fi
Expand All @@ -52,20 +64,19 @@ fi
(cd $target; tar -xf - )

# Link a few files at C-ESM-EP root level
links="share job_C-ESM-EP.sh job_PMP_C-ESM-EP.sh locations.py"
links="share job_C-ESM-EP.sh job_PMP_C-ESM-EP.sh locations.py custom_obs_dict.py"
[ $with_libIGCM != no ] && links+=" libIGCM_clean.sh libIGCM_post.sh"
for file in $links; do
ln -sf $cesmep_dir/$file $target
done

# Copy some pyhton files (cannot link because of side effect in PYTHONPATH)
# Copy some python files (cannot link because of side effect in PYTHONPATH)
copies="run_C-ESM-EP.py main_C-ESM-EP.py"
for file in $copies; do
cp -f $cesmep_dir/$file $target
done


# Copy only files that will or could be changed
# Copy also files that will or could be changed
cp -f $cesmep_dir/settings.py $target

# Set root directory in setenv_C-ESM-EP.sh
Expand Down
Loading