Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HPC implementation for large videos #138

Open
NataliaFavila opened this issue Feb 27, 2024 · 1 comment
Open

HPC implementation for large videos #138

NataliaFavila opened this issue Feb 27, 2024 · 1 comment

Comments

@NataliaFavila
Copy link

Dear Biafra,

we are wondering if it would be possible to deploy ciatah for batch processing in a high performance computing cluster?
Is this something that you have done before or have any experience with?

We have large videos and even with temporal (to 5 Hz) and spatial (4x) downsampling, the process is using up our RAM (of around 300 GB).

Any other suggestion is also welcome!

Thank you!
Natalia

@bahanonu
Copy link
Owner

bahanonu commented Mar 2, 2024

@NataliaFavila
Yep! It's possible. I've run ciatah on HPCs previously, e.g. on Stanford's HPCs, and it works quite well (e.g. used to analyze 1000+ imaging sessions more quickly or for very large FOV movies).

Depending on your institute's setup, can run parallel processing or cross-node processing. Can either provide more details here or send me an email and we can see how to get it running on your system.

I'll see about updating the repository to add a HPC guide and example scripts as this has been asked previously.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants