Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/image shape filter #74

Merged
merged 5 commits into from
Nov 15, 2023
Merged

Feature/image shape filter #74

merged 5 commits into from
Nov 15, 2023

Conversation

HYLcool
Copy link
Collaborator

@HYLcool HYLcool commented Nov 15, 2023

  • Add image_shape_filter to filter out samples that contain images with out-of-range widths or heights.
  • Limit the version of pyarrow <= 13.0.0 to avoid useless FutureWarning
  • Convert a reg pattern string to raw string to avoid W605 warning

@HYLcool HYLcool self-assigned this Nov 15, 2023
@HYLcool HYLcool linked an issue Nov 15, 2023 that may be closed by this pull request
@HYLcool HYLcool added enhancement New feature or request dj:multimodal issues/PRs about multimodal data processing labels Nov 15, 2023
@HYLcool HYLcool added this to the Multimodal Support milestone Nov 15, 2023
Copy link
Collaborator

@zhijianma zhijianma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@HYLcool HYLcool merged commit de984f3 into main Nov 15, 2023
5 checks passed
@HYLcool HYLcool deleted the feature/image_shape_filter branch November 15, 2023 07:01
@HYLcool HYLcool added the dj:op issues/PRs about some specific OPs label Jan 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[MM] image_shape_filter
2 participants