New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

idle jobs must self destruct #1

Open

bjuergens opened this issue Jun 29, 2018 · 0 comments

Collaborator

bjuergens commented Jun 29, 2018 •

edited

Loading

Problem: the jobs will never finish. REQUESTED_WALLTIME may or may not work

Ideas:

REQUESTED_WALLTIME does not know if the server is idle.
condor_ssh_to_job dies when the
Running Notebooks/Terminals - Shutdown automatically after specified time jupyter/notebook#1300 (comment)

possible solution:

set REQUESTED_WALLTIME to 8h (enough for the user to get all the work done)
set NotebookApp.shutdown_no_activity_timeout = 600
set MappingKernelManager.cull_idle_timeout = 600

result:

the server shuts down 20 minutes after the last kernel went idle
when there is still an open ssh connection at this point, the connection stays open, but won't
if the user forgets to log out, the job is culled after 8h

The text was updated successfully, but these errors were encountered:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment