Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reafactor: florencev2 batch processing #68

Merged
merged 5 commits into from
Sep 20, 2024

Conversation

hrnn
Copy link
Member

@hrnn hrnn commented Sep 19, 2024

The __call__ method now accepts lists of tasks, images, and prompts, allowing the model to process multiple inputs simultaneously. This change introduces a new _batch_image_call method that handles batch inference.

  • Input validation to handle both single and batch inputs
  • Adjusting the predict method to support batch processing
  • Ensuring outputs are clean by setting skip_special_tokens=True during decoding, e.g. <pad>.

@hrnn hrnn self-assigned this Sep 19, 2024
@hrnn hrnn changed the title feat: florencev2 batch processing reafactor: florencev2 batch processing Sep 20, 2024
@hrnn hrnn marked this pull request as ready for review September 20, 2024 12:13
@hrnn hrnn requested a review from andy-ldai September 20, 2024 12:22
@hrnn hrnn merged commit 8ead0c3 into landing-ai:main Sep 20, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants