Skip to content
This repository has been archived by the owner on Sep 30, 2023. It is now read-only.

expose batch size flag to cli #59

Merged
merged 1 commit into from
Aug 24, 2023
Merged

expose batch size flag to cli #59

merged 1 commit into from
Aug 24, 2023

Conversation

ravenscroftj
Copy link
Owner

Adding batch size flag to CLI which should allow users to reduce the size of processing batches having the effect of reducing acute memory consumption - the trade off is slightly slower inference

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant