Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NEW Model] Add BLIP Model & CLIP Interrogator #4676

Merged
merged 9 commits into from
Feb 10, 2023

Conversation

JunnYu
Copy link
Member

@JunnYu JunnYu commented Feb 7, 2023

PR types

New features

PR changes

Models

Description

  • 新增BLIP Mode
  • 新增图生文的CLIP Interrogator

使用步骤:

  • 安装本分支的paddlenlp
  • 进入ppdiffusers/examples/clip_interrogator
  • 安装依赖 requirements.txt, 里面的paddlenlp2.5.1是没有的,可删除
  • 参考README.md运行gradio界面。

@paddle-bot
Copy link

paddle-bot bot commented Feb 7, 2023

Thanks for your contribution!

@codecov
Copy link

codecov bot commented Feb 7, 2023

Codecov Report

Merging #4676 (0c13cfd) into develop (11928cb) will increase coverage by 0.65%.
The diff coverage is 81.80%.

@@             Coverage Diff             @@
##           develop    #4676      +/-   ##
===========================================
+ Coverage    43.25%   43.91%   +0.65%     
===========================================
  Files          435      440       +5     
  Lines        61973    63050    +1077     
===========================================
+ Hits         26807    27688     +881     
- Misses       35166    35362     +196     
Impacted Files Coverage Δ
paddlenlp/transformers/auto/modeling.py 80.55% <ø> (ø)
paddlenlp/transformers/image_processing_utils.py 68.02% <ø> (ø)
paddlenlp/transformers/blip/modeling_text.py 78.92% <78.92%> (ø)
paddlenlp/transformers/blip/modeling.py 80.00% <80.00%> (ø)
paddlenlp/transformers/blip/processing.py 88.23% <88.23%> (ø)
paddlenlp/transformers/blip/configuration.py 92.15% <92.15%> (ø)
paddlenlp/transformers/blip/image_processing.py 92.30% <92.30%> (ø)
paddlenlp/transformers/__init__.py 100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@JunnYu JunnYu requested a review from guoshengCS February 8, 2023 14:00
@@ -0,0 +1,95 @@
a 3D render
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

data目录下的内容是否放bos上面来下载呢,上面有个10W行的有点大了

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK,好的

@guoshengCS guoshengCS merged commit be70fc4 into PaddlePaddle:develop Feb 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants