Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【Qwen2-VL Inference】add qwen2-vl high performance inference #9575

Merged
merged 19 commits into from
Dec 20, 2024

Conversation

chang-wenbin
Copy link
Contributor

PR types

Performance optimization

PR changes

Models

Description

add qwen2-vl high performance inference

Copy link

paddle-bot bot commented Dec 5, 2024

Thanks for your contribution!

Copy link

codecov bot commented Dec 6, 2024

Codecov Report

Attention: Patch coverage is 2.63158% with 37 lines in your changes missing coverage. Please review.

Project coverage is 52.79%. Comparing base (9eb3cfe) to head (14f6b7e).
Report is 23 commits behind head on develop.

Files with missing lines Patch % Lines
...dlenlp/experimental/transformers/qwen2/modeling.py 0.00% 36 Missing ⚠️
paddlenlp/transformers/auto/configuration.py 50.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #9575      +/-   ##
===========================================
- Coverage    52.81%   52.79%   -0.02%     
===========================================
  Files          710      718       +8     
  Lines       111234   112252    +1018     
===========================================
+ Hits         58744    59263     +519     
- Misses       52490    52989     +499     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@@ -231,6 +231,8 @@ def __init__(self, mapping):
self._modules = {}

def __getitem__(self, key):
if key == "qwen2_vl":
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里也加上说明,告诉别人为什么这样改

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

此处trick当前保持,后续和autoconfig内容一同修改

@ZHUI ZHUI merged commit e91c2d3 into PaddlePaddle:develop Dec 20, 2024
9 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants