Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proper CPU allocation when submitting to multiple GPU nodes #235

Open
vyasr opened this issue Feb 3, 2020 · 0 comments
Open

Proper CPU allocation when submitting to multiple GPU nodes #235

vyasr opened this issue Feb 3, 2020 · 0 comments
Labels
cluster submission Enhancements to the submission process documentation Writing or editing documentation

Comments

@vyasr
Copy link
Contributor

vyasr commented Feb 3, 2020

When requesting more GPUs than are available on a single node during submission, signac-flow needs to consider how the CPU tasks are distributed. It doesn't make sense to allocate all the CPU tasks onto a single node or do any math related to that. As suggested in #233, a sensible choice would be to evenly divide the CPU tasks per node, at least in cases where all jobs acquire full nodes. The question is more complicated in cases where there are shared nodes; we may just have to default to the dumb assumption and require users to provide their own templates to do more customized calculations. In that case, we probably should document more thoroughly what choices we've made in the signac-flow templates documentation.

@bdice bdice added the cluster submission Enhancements to the submission process label Feb 27, 2020
@atravitz atravitz added the documentation Writing or editing documentation label Mar 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cluster submission Enhancements to the submission process documentation Writing or editing documentation
Projects
None yet
Development

No branches or pull requests

3 participants