Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for single multi-node task #1278

Closed
BoPeng opened this issue Jul 25, 2019 · 0 comments
Closed

Support for single multi-node task #1278

BoPeng opened this issue Jul 25, 2019 · 0 comments
Assignees
Labels

Comments

@BoPeng
Copy link
Contributor

BoPeng commented Jul 25, 2019

Related to #476 and #1277

Currently nodes is one of the task options that has not been implemented. This option is supposed to specify the number of nodes a single task runs, and a template is supposed to do something like

%PBS -l {nodes}:{cores}

sos execute task_id

to execute a multi-node task with id task_id.

However, because multi-node jobs require special way to start (e.g. mpiexec or mpirun) and sos execute cannot mimic this behavior, tasks are currently limited to single node only.

With the new -e option

sos execute -e pbs {task}

we are supposed to implement a PBS version of the task executor. Although this feature is designed to distribute multiple subtasks to multiple nodes, it would be nice to support single multi-node as well. This would involve the submission of a MPI job as follows:

task: nodes=5, cores=4
mpiexec ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant