Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update global_4denvar and global_enkf ctests to reflect GFS v17 #774

Merged

Conversation

RussTreadon-NOAA
Copy link
Contributor

@RussTreadon-NOAA RussTreadon-NOAA commented Jul 16, 2024

Description
Update global_4denvar and global_enkf ctest configurations to better align with GFS v17 configuration.

Resolves #759

Type of change

  • Maintenance - update global ctest configuration

How Has This Been Tested?

  1. install RussTreadon-NOAA/GSI:feature/global_ctests on Hera
  2. run global_4envar and global_enkf ctests

Both tests pass

Test project /scratch1/NCEPDEV/da/Russ.Treadon/git/gsi/global_ctests/build
    Start 1: global_4denvar
1/2 Test #1: global_4denvar ...................   Passed  1926.51 sec
    Start 6: global_enkf
2/2 Test #6: global_enkf ......................   Passed  755.75 sec

100% tests passed, 0 tests failed out of 2

Total Test time (real) = 2682.29 sec

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • New and existing tests pass with my changes

@RussTreadon-NOAA RussTreadon-NOAA self-assigned this Jul 16, 2024
@RussTreadon-NOAA
Copy link
Contributor Author

RussTreadon-NOAA commented Jul 16, 2024

WCOSS2 (Cactus) test
Install RussTreadon-NOAA:feature/global_ctests on Cactus. Run global ctests with following results

Test project /lfs/h2/emc/da/noscrub/russ.treadon/git/gsi/pr774/build
    Start 1: global_4denvar
1/2 Test #1: global_4denvar ...................   Passed  1684.42 sec
    Start 6: global_enkf
2/2 Test #6: global_enkf ......................   Passed  852.93 sec

100% tests passed, 0 tests failed out of 2

Total Test time (real) = 2537.53 sec

@RussTreadon-NOAA
Copy link
Contributor Author

Hercules test
Install RussTreadon-NOAA:feature/global_ctests on Hercules. Run global ctests with following results

Test project /work/noaa/da/rtreadon/git/gsi/pr774/build
    Start 1: global_4denvar
1/2 Test #1: global_4denvar ...................   Passed  2222.24 sec
    Start 6: global_enkf
2/2 Test #6: global_enkf ......................   Passed  1206.22 sec

100% tests passed, 0 tests failed out of 2

Total Test time (real) = 3428.47 sec

Copy link
Contributor

@azadeh-gh azadeh-gh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good.

@CatherineThomas-NOAA
Copy link
Collaborator

@RussTreadon-NOAA: Should the debug test also be updated? I see you added the imp_physics change, but it looks like that test is quite out of sync with regression_namelist.sh. I have the script comparison on Hera here:
/scratch1/NCEPDEV/da/Catherine.Thomas/gsi/russ_pr/regression/diff

Different parameters between scripts:

  • iterations
  • RO parameters: nsig_ext, gpstop, commgps*
  • incvars*
  • obslist

Missing parameters in regression_namelist_db.sh:

  • optconv=0.05,cao_check=.true.,ta2tb=.true.,
  • tcp*, *cads
  • dmesh(4)
  • hub_norm

@RussTreadon-NOAA
Copy link
Contributor Author

@CatherineThomas-NOAA , thank you for noting differences between the namelists in regression_namelists.sh and regression_namelists_db.sh.

The debug option traces back to svn. I am not aware of anyone who uses the debug ctests. I don't. When I want to test changes in debug mode, I build with BUILD_TYPE=Debug and run the standard suite of ctests. The wall times need to be increased when doing this. I'd be fine with removing the debug flag and associated scripting (namelists) from regression/.

The GSI Review team has talked about an overhaul of the GSI ctest suite. The checks performed by the test scripts need to be refactored. The current checks generate too many false positives. Run scripts should be cleaned up and standardized. Thus far, no one has found time to go through this cleanup, enhancing, and refactoring task.

@RussTreadon-NOAA
Copy link
Contributor Author

RussTreadon-NOAA commented Jul 19, 2024

Build RussTreadon-NOAA:feature/global_ctests at 11a80d6 on Cactus. Run global_ ctests with the folowing results

Test project /lfs/h2/emc/da/noscrub/russ.treadon/git/gsi/global_ctests/build
    Start 1: global_4denvar
1/2 Test #1: global_4denvar ...................   Passed  1683.88 sec
    Start 6: global_enkf
2/2 Test #6: global_enkf ......................   Passed  853.32 sec

100% tests passed, 0 tests failed out of 2

Total Test time (real) = 2537.24 sec

Copy link
Collaborator

@CatherineThomas-NOAA CatherineThomas-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your comments @RussTreadon-NOAA. Being able to run in debug mode using the standard ctests makes much more sense than using a separate debug script where we have to make changes in multiple places. Looks good to me. Approve.

@RussTreadon-NOAA RussTreadon-NOAA merged commit 3e27bb8 into NOAA-EMC:develop Jul 22, 2024
4 checks passed
@RussTreadon-NOAA RussTreadon-NOAA deleted the feature/global_ctests branch August 9, 2024 11:51
DavidHuber-NOAA added a commit to DavidHuber-NOAA/GSI that referenced this pull request Sep 6, 2024
* origin/develop:
  Move to contrib spack-stack on Jet (NOAA-EMC#787)
  a quick workaround for increasing the mpi task numbers on orion for ctest :: rrfs_3denvar_rdasens  (NOAA-EMC#788)
  Recover the capability of handling model fields from operation gfs.v16.3 (NOAA-EMC#785)
  fix a bug in deter_sfc_gmi (NOAA-EMC#781)
  add safeguard to thompson_reff (NOAA-EMC#779)
  Fix incorrect usage of real(i_kind) in mg_input.f90  (NOAA-EMC#760)
  Transition to Thompson Microphysics for Microwave All-sky Assimilation (NOAA-EMC#743)
  Format changes for EUMETSAT metop-sg and CADS debug fix (NOAA-EMC#773)
  Update global_4denvar and global_enkf ctests to reflect GFS v17 (NOAA-EMC#774)
  fix for cris-fsr memory corruption (NOAA-EMC#767)
  Gnssrwnd1.0 (NOAA-EMC#747)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update global_4denvar and global_enkf ctests to reflect GFS v17
3 participants