Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add options to customize execute_experiment.tpl #276

Merged
merged 14 commits into from
Jun 25, 2024

Conversation

scheibelp
Copy link
Collaborator

Closes #258

New variables supported in variables.yaml:

  • extra_cmd_opts: These appear as extra options to mpirun, srun, or whatever exec cmd is chosen by scheduler. Newlines can be used for organization, but are removed ("-x 1\n-y 2" becomes mpirun -x 1 -y 2 ...)
  • extra_batch_opts: This appear as batch directive lines at the top of the script
  • post_exec_cmds: inserted verbatim after the exec (whatever the main experiment binary is run)
  • pre_exec_cmds: like post_..., but before the experiment runs

This also provides a means to define a system or experiment-specific execute_experiment.tpl. The experiment can likewise choose to omit the allocation modifier, and thereby specify everything manually

@github-actions github-actions bot added experiment New or modified experiment configs New or modified system config labels Jun 11, 2024
@scheibelp
Copy link
Collaborator Author

@jdomke I'm curious if this PR addresses your needs

@scheibelp scheibelp changed the title Variables to insert into execute_experiment.tpl [WIP] Add options to customize execute_experiment.tpl Jun 11, 2024
@jdomke
Copy link
Collaborator

jdomke commented Jun 11, 2024

@jdomke I'm curious if this PR addresses your needs

from a quick look at it, it seems to be doing what i needed, but i have not tried it, do you need me to verify it before you merge, or should i wait until after and debug if necessary?

@scheibelp
Copy link
Collaborator Author

do you need me to verify it before you merge, or should i wait until after and debug if necessary?

Whichever you prefer: it sounds like you are fine with it being merged before you get a chance to test it, so I'll proceed with that assumption unless you say otherwise.

@scheibelp scheibelp changed the title [WIP] Add options to customize execute_experiment.tpl Add options to customize execute_experiment.tpl Jun 22, 2024
@pearce8 pearce8 merged commit 38b80d3 into LLNL:develop Jun 25, 2024
8 checks passed
daboehme pushed a commit that referenced this pull request Jul 10, 2024
* show example of not using allocation modifier

* restore test config

* I was hoping I could expand variables into lists; but I don't think that will work

* variable naming consistency

* refactor as multi-line strings vs string lists

* add test config; demonstrates an odd behavior for expansion of multi-line strings

* expand test config

* needed for emulating #258

* missing space

* style fix

* style fix 2

* forgot to re-add argument with new format

* relocate execute_experiment template
scheibelp added a commit that referenced this pull request Jul 26, 2024
scheibelp added a commit that referenced this pull request Jul 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
configs New or modified system config experiment New or modified experiment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants