Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Inference] Support NNAdapter and ascend310 #35226

Merged
merged 22 commits into from
Sep 22, 2021
Merged

[Inference] Support NNAdapter and ascend310 #35226

merged 22 commits into from
Sep 22, 2021

Conversation

JZZ-NOTE
Copy link
Contributor

@JZZ-NOTE JZZ-NOTE commented Aug 27, 2021 •
edited by jiweibo
Loading

PR types

Others

PR changes

Others

Describe

1、子图支持NNAdapter使用ascend310预测
2、DEMO pr: PaddlePaddle/Paddle-Inference-Demo#162

ARM+Ascend310编译方法：

cmake .. -DWITH_PYTHON=ON \
         -DPYTHON_EXECUTABLE=`which python` \
         -DCMAKE_BUILD_TYPE=Release \
         -DON_INFER=ON \
         -DWITH_MKL=OFF \
         -DWITH_LITE=ON \
         -DLITE_WITH_NNADAPTER=ON \
         -DNNADAPTER_WITH_HUAWEI_ASCEND_NPU=ON \
         -DLITE_GIT_TAG=develop \
         -DNPU_SDK_ROOT=/usr/local/Ascend/ascend-toolkit/latest \
         -DWITH_ARM=ON

相关接口改动及影响：
增加了config.NNAdapter()的接口，来使用lite ascend310进行预测，对其它方向均没有侵入

@CLAassistant
Copy link

CLAassistant commented Aug 27, 2021 •
edited
Loading

CLA assistant check
All committers have signed the CLA.

@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

jiweibo
jiweibo reviewed Aug 27, 2021
View reviewed changes
cmake/external/lite.cmake Outdated Show resolved Hide resolved
jiweibo
jiweibo requested changes Aug 27, 2021
View reviewed changes
Copy link
Contributor

@jiweibo jiweibo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

后续需提供python侧接口

JZZ-NOTE and others added 18 commits September 14, 2021 16:24
@JZZ-NOTE
Merge branch 'develop' into 310_subgraph
8dad451
@jiweibo
fix WITH_PYTHON compile error
b84070b
@JZZ-NOTE
Merge pull request #2 from jiweibo/310_subgraph
d54f18a 
fix WITH_PYTHON=ON compile error
@JZZ-NOTE
modify files
99dc4e3
@JZZ-NOTE
Merge branch 'develop' of http://github.com/PaddlePaddle/Paddle into …
cd6c25b 
…310_subgraph
@JZZ-NOTE
modify file
264fe38
@JZZ-NOTE
Merge branch 'develop' of http://github.com/PaddlePaddle/Paddle into …
3da576f 
…310_subgraph
@jiweibo
add python api
d99f20c
@JZZ-NOTE
Merge pull request #3 from jiweibo/310_subgraph
36f1de0 
add python api
@JZZ-NOTE
modify paddle_build
d796d5f
@JZZ-NOTE
Merge branch 'develop' of http://github.com/PaddlePaddle/Paddle into …
04eedfd 
…310_subgraph
@JZZ-NOTE
Merge branch '310_subgraph' of https://github.com/JZZ-NOTE/Paddle int…
9602506 
…o 310_subgraph
@jiweibo
fix compile error for _release/v2.10
3137fe4
@JZZ-NOTE
Merge pull request #4 from jiweibo/310_subgraph
dd9fe8d 
fix lite cuda compile for lite branch _release/2.10
@jiweibo
fix test error.
fdc70bb
@JZZ-NOTE
Merge pull request #5 from jiweibo/310_subgraph
4272e9f 
fix test error.
@jiweibo
ci coverage.
6ed50e4
@JZZ-NOTE
Merge pull request #6 from jiweibo/310_subgraph
d85e499 
ci coverage
@jiweibo jiweibo mentioned this pull request Sep 20, 2021
Merged
jiweibo
jiweibo approved these changes Sep 22, 2021
View reviewed changes
Copy link
Contributor

@jiweibo jiweibo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

hong19860320
hong19860320 approved these changes Sep 22, 2021
View reviewed changes
Copy link
Contributor

@hong19860320 hong19860320 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

cmake/external/lite.cmake Show resolved Hide resolved
python/setup.py.in Show resolved Hide resolved
@shentanyue
Copy link
Contributor

LGTM

zhupengyang
zhupengyang approved these changes Sep 22, 2021
View reviewed changes
Copy link
Contributor

@zhupengyang zhupengyang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

lanxianghit
lanxianghit approved these changes Sep 22, 2021
View reviewed changes
Copy link
Contributor

@lanxianghit lanxianghit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for API change.

@jiweibo jiweibo merged commit 10e5304 into PaddlePaddle:develop Sep 22, 2021
ghost pushed a commit to piotrekobi/Paddle that referenced this pull request Sep 24, 2021
@JZZ-NOTE @piotrekobi
[Inference] Support NNAdapter and ascend310 (PaddlePaddle#35226)
829886e
AnnaTrainingG pushed a commit to AnnaTrainingG/Paddle that referenced this pull request Sep 29, 2021
@JZZ-NOTE @AnnaTrainingG
[Inference] Support NNAdapter and ascend310 (PaddlePaddle#35226)
def4aad
@JZZ-NOTE JZZ-NOTE deleted the 310_subgraph branch January 11, 2023 07:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jiweibo jiweibo jiweibo approved these changes

@hong19860320 hong19860320 hong19860320 approved these changes

@lanxianghit lanxianghit lanxianghit approved these changes

@zhupengyang zhupengyang zhupengyang approved these changes

@CheQiXiao CheQiXiao CheQiXiao approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
8 participants
@JZZ-NOTE @CLAassistant @shentanyue @hong19860320 @jiweibo @lanxianghit @zhupengyang @CheQiXiao