Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When is it appropriate to switch between local processing and remote work on an HPC? #25

Closed
zscooper opened this issue Oct 12, 2018 · 1 comment

Comments

@zscooper
Copy link

I primarily run computational jobs locally on my macbook. It has a powerful enough processor to run most jobs, but I've occasionally run myself into week long processing jobs (distancing sequencing reads, clustering them, or creating phylogenetic trees) that render my macbook basically useless to me.

How big does a project have to get for it to be reasonable to use a remote HPC rather than patiently running jobs locally? I realize this is usually project and job specific, so I'm looking more for abstract guidelines on this type of decision.

@kubu4
Copy link
Collaborator

kubu4 commented Oct 12, 2018

Unfortunately, there isn't too much of a guide on this, as it can vary so greatly depending on your job. If you have access to, and understand how to use, a high performance computing (HPC) cluster, you should probably just use that.

Other bioinformatics-related activities (such as "basic" text processing, sorting, joining, file splitting, etc) can usually be handled by a personal computer without lengthy processing times.

@sr320 sr320 closed this as completed Oct 20, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants